Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 935844 Details for
Bug 1139817
Storage Domain version 0 created when version 3 is requested
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log during domain create
vdsm-short.log (text/plain), 9.65 MB, created by
Adam Litke
on 2014-09-09 17:25:13 UTC
(
hide
)
Description:
vdsm log during domain create
Filename:
MIME Type:
Creator:
Adam Litke
Created:
2014-09-09 17:25:13 UTC
Size:
9.65 MB
patch
obsolete
>Thread-23::DEBUG::2014-09-09 11:32:57,438::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110212 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:32:57,438::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) (7393) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) (7393) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) (7393) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:57,439::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:32:58,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:32:58,785::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3403::DEBUG::2014-09-09 11:32:58,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:32:58,854::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:32:58,855::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3404::DEBUG::2014-09-09 11:32:58,855::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connectStorageServer' in bridge with {u'connectionParams': [{u'id': u'00000000-0000-0000-0000-000000000000', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >Thread-3404::DEBUG::2014-09-09 11:32:58,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`007048d3-123f-4eef-961f-d2c4b3f513c9`::moving from state init -> state preparing >Thread-3404::INFO::2014-09-09 11:32:58,856::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'00000000-0000-0000-0000-000000000000', u'port': u''}], options=None) >Thread-3404::DEBUG::2014-09-09 11:32:58,857::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-3404::DEBUG::2014-09-09 11:32:58,857::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 192.168.2.1:/home/storage/data2 /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 (cwd None) >Thread-19::DEBUG::2014-09-09 11:32:58,890::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-19::DEBUG::2014-09-09 11:32:58,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:58,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:58,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:58,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) (7394) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) (7394) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) DEBUG|(7394) Building response >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) (7394) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:58,891::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3404::DEBUG::2014-09-09 11:32:58,896::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-19::DEBUG::2014-09-09 11:32:58,896::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:58,896::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:32:58,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:58,897::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:58,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:58,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:58,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:58,897::__init__::225::IOProcess::(_processLogs) (7395) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:58,897::__init__::225::IOProcess::(_processLogs) (7395) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:58,898::__init__::225::IOProcess::(_processLogs) DEBUG|(7395) Building response >Thread-19::DEBUG::2014-09-09 11:32:58,898::__init__::225::IOProcess::(_processLogs) (7395) Queuing response >Thread-3404::DEBUG::2014-09-09 11:32:58,898::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-19::DEBUG::2014-09-09 11:32:58,898::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3404::DEBUG::2014-09-09 11:32:58,899::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain} >Thread-19::DEBUG::2014-09-09 11:32:58,899::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3404::INFO::2014-09-09 11:32:58,899::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'00000000-0000-0000-0000-000000000000'}]} >Thread-3404::DEBUG::2014-09-09 11:32:58,900::task::1191::Storage.TaskManager.Task::(prepare) Task=`007048d3-123f-4eef-961f-d2c4b3f513c9`::finished: {'statuslist': [{'status': 0, 'id': u'00000000-0000-0000-0000-000000000000'}]} >Thread-3404::DEBUG::2014-09-09 11:32:58,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`007048d3-123f-4eef-961f-d2c4b3f513c9`::moving from state preparing -> state finished >Thread-3404::DEBUG::2014-09-09 11:32:58,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3404::DEBUG::2014-09-09 11:32:58,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3404::DEBUG::2014-09-09 11:32:58,900::task::993::Storage.TaskManager.Task::(_decref) Task=`007048d3-123f-4eef-961f-d2c4b3f513c9`::ref 0 aborting False >Thread-3404::DEBUG::2014-09-09 11:32:58,900::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connectStorageServer' in bridge with [{'status': 0, 'id': u'00000000-0000-0000-0000-000000000000'}] >Thread-3404::DEBUG::2014-09-09 11:32:58,900::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:32:59,056::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:32:59,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3405::DEBUG::2014-09-09 11:32:59,057::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >Thread-3405::DEBUG::2014-09-09 11:32:59,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9c5d385-44f8-4dbd-9931-f87a98f87159`::moving from state init -> state preparing >Thread-3405::INFO::2014-09-09 11:32:59,057::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-3405::DEBUG::2014-09-09 11:32:59,059::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-19::DEBUG::2014-09-09 11:32:59,059::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,059::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:32:59,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,060::__init__::225::IOProcess::(_processLogs) (7396) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:59,060::__init__::225::IOProcess::(_processLogs) (7396) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:59,060::__init__::225::IOProcess::(_processLogs) (7396) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,060::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3405::DEBUG::2014-09-09 11:32:59,060::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-3405::DEBUG::2014-09-09 11:32:59,061::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain} >Thread-3405::INFO::2014-09-09 11:32:59,061::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3405::DEBUG::2014-09-09 11:32:59,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9c5d385-44f8-4dbd-9931-f87a98f87159`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3405::DEBUG::2014-09-09 11:32:59,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9c5d385-44f8-4dbd-9931-f87a98f87159`::moving from state preparing -> state finished >Thread-3405::DEBUG::2014-09-09 11:32:59,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3405::DEBUG::2014-09-09 11:32:59,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3405::DEBUG::2014-09-09 11:32:59,061::task::993::Storage.TaskManager.Task::(_decref) Task=`e9c5d385-44f8-4dbd-9931-f87a98f87159`::ref 0 aborting False >Thread-3405::DEBUG::2014-09-09 11:32:59,061::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-3405::DEBUG::2014-09-09 11:32:59,061::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:32:59,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:32:59,067::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3406::DEBUG::2014-09-09 11:32:59,067::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.create' in bridge with {u'domainClass': 1, u'typeArgs': u'192.168.2.1:/home/storage/data2', u'name': u'data2-nfs', u'domainType': 1, u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >Thread-3406::DEBUG::2014-09-09 11:32:59,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f9733c1-a367-4968-b853-de77457f5356`::moving from state init -> state preparing >Thread-3406::INFO::2014-09-09 11:32:59,068::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', domainName=u'data2-nfs', typeSpecificArg=u'192.168.2.1:/home/storage/data2', domClass=1, domVersion=0, options=None) >Thread-3406::DEBUG::2014-09-09 11:32:59,069::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-3406::DEBUG::2014-09-09 11:32:59,069::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3406::DEBUG::2014-09-09 11:32:59,069::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-3406::DEBUG::2014-09-09 11:32:59,069::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3406::DEBUG::2014-09-09 11:32:59,069::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-3406::DEBUG::2014-09-09 11:32:59,069::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-3406::DEBUG::2014-09-09 11:32:59,078::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3406::DEBUG::2014-09-09 11:32:59,080::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Dummy-97::DEBUG::2014-09-09 11:32:59,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:32:59,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897747 s, 11.4 MB/s\n'; <rc> = 0 >Thread-3406::DEBUG::2014-09-09 11:32:59,329::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-3406::DEBUG::2014-09-09 11:32:59,329::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,330::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,330::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,330::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,330::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,330::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,330::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3406::ERROR::2014-09-09 11:32:59,330::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3406::ERROR::2014-09-09 11:32:59,330::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3406::DEBUG::2014-09-09 11:32:59,330::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-3406::DEBUG::2014-09-09 11:32:59,331::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 85442237-be11-4bd0-b6c3-43ba60c1b87f (cwd None) >Thread-3406::DEBUG::2014-09-09 11:32:59,350::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n Volume group "85442237-be11-4bd0-b6c3-43ba60c1b87f" not found\n Skipping volume group 85442237-be11-4bd0-b6c3-43ba60c1b87f\n'; <rc> = 5 >Thread-3406::WARNING::2014-09-09 11:32:59,351::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!', ' Volume group "85442237-be11-4bd0-b6c3-43ba60c1b87f" not found', ' Skipping volume group 85442237-be11-4bd0-b6c3-43ba60c1b87f'] >Thread-3406::DEBUG::2014-09-09 11:32:59,351::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-09-09 11:32:59,353::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:32:59,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) (7397) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) (7397) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) (7397) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,355::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) (7398) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) (7398) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,356::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) (7399) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) (7399) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:59,357::__init__::225::IOProcess::(_processLogs) (7399) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,358::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:32:59,358::__init__::225::IOProcess::(_processLogs) (7398) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,358::__init__::225::IOProcess::(_processLogs) (7398) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,358::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-3406::ERROR::2014-09-09 11:32:59,359::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 85442237-be11-4bd0-b6c3-43ba60c1b87f not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f',) >Thread-3406::INFO::2014-09-09 11:32:59,359::nfsSD::69::Storage.StorageDomain::(create) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f domainName=data2-nfs remotePath=192.168.2.1:/home/storage/data2 domClass=1 >Thread-19::DEBUG::2014-09-09 11:32:59,360::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-19::DEBUG::2014-09-09 11:32:59,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,361::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,361::__init__::225::IOProcess::(_processLogs) (7400) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:32:59,362::__init__::225::IOProcess::(_processLogs) (7400) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:32:59,362::__init__::225::IOProcess::(_processLogs) (7400) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,362::__init__::225::IOProcess::(_processLogs) (7400) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,362::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,362::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,364::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,364::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:32:59,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,364::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,365::__init__::225::IOProcess::(_processLogs) (7401) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:32:59,365::__init__::225::IOProcess::(_processLogs) (7401) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:32:59,397::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7401) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,397::__init__::225::IOProcess::(_processLogs) (7401) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,397::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Message size is 121 >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) (7402) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:59,398::__init__::225::IOProcess::(_processLogs) (7402) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:59,399::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7402) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,400::__init__::225::IOProcess::(_processLogs) (7402) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,400::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,400::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:32:59,400::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,400::__init__::225::IOProcess::(_processLogs) Message size is 71 >Thread-19::DEBUG::2014-09-09 11:32:59,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) (7403) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) (7403) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) (7403) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) (7403) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,401::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Message size is 75 >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) (7404) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) (7404) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) (7404) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) (7404) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) Message size is 87 >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,403::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) (7405) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) (7405) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) (7405) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) (7405) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,404::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Message size is 91 >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) (7406) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,405::__init__::225::IOProcess::(_processLogs) (7406) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) (7406) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) (7406) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) Message size is 123 >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,406::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) (7407) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) (7407) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) (7407) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) (7407) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) Message size is 160 >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) (7408) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,408::__init__::225::IOProcess::(_processLogs) (7408) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,422::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7408) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,422::__init__::225::IOProcess::(_processLogs) (7408) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,424::__init__::225::IOProcess::(_processLogs) (7409) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,424::__init__::225::IOProcess::(_processLogs) (7409) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,440::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7409) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,440::__init__::225::IOProcess::(_processLogs) (7409) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,440::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,440::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) (7410) Finding callback 'truncate'... >Thread-19::DEBUG::2014-09-09 11:32:59,441::__init__::225::IOProcess::(_processLogs) (7410) Got request for method 'truncate' >Thread-19::DEBUG::2014-09-09 11:32:59,506::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7410) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,506::__init__::225::IOProcess::(_processLogs) (7410) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,506::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,508::__init__::225::IOProcess::(_processLogs) (7411) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:32:59,508::__init__::225::IOProcess::(_processLogs) (7411) Got request for method 'chmod' >Thread-19::DEBUG::2014-09-09 11:32:59,523::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7411) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,523::__init__::225::IOProcess::(_processLogs) (7411) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,523::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Message size is 210 >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) (7412) Finding callback 'truncate'... >Thread-19::DEBUG::2014-09-09 11:32:59,524::__init__::225::IOProcess::(_processLogs) (7412) Got request for method 'truncate' >Thread-19::DEBUG::2014-09-09 11:32:59,540::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7412) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,540::__init__::225::IOProcess::(_processLogs) (7412) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,540::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,540::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,540::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) (7413) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:32:59,541::__init__::225::IOProcess::(_processLogs) (7413) Got request for method 'chmod' >Thread-19::DEBUG::2014-09-09 11:32:59,590::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7413) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,590::__init__::225::IOProcess::(_processLogs) (7413) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,590::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,590::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) (7414) Finding callback 'truncate'... >Thread-19::DEBUG::2014-09-09 11:32:59,591::__init__::225::IOProcess::(_processLogs) (7414) Got request for method 'truncate' >Thread-19::DEBUG::2014-09-09 11:32:59,607::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7414) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,607::__init__::225::IOProcess::(_processLogs) (7414) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,607::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,607::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,607::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) (7415) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:32:59,608::__init__::225::IOProcess::(_processLogs) (7415) Got request for method 'chmod' >Thread-19::DEBUG::2014-09-09 11:32:59,623::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7415) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) (7415) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) Message size is 200 >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,625::__init__::225::IOProcess::(_processLogs) (7416) Finding callback 'truncate'... >Thread-19::DEBUG::2014-09-09 11:32:59,625::__init__::225::IOProcess::(_processLogs) (7416) Got request for method 'truncate' >Thread-19::DEBUG::2014-09-09 11:32:59,640::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7416) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,640::__init__::225::IOProcess::(_processLogs) (7416) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,642::__init__::225::IOProcess::(_processLogs) (7417) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:32:59,642::__init__::225::IOProcess::(_processLogs) (7417) Got request for method 'chmod' >Thread-19::DEBUG::2014-09-09 11:32:59,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7417) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,657::__init__::225::IOProcess::(_processLogs) (7417) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,658::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:32:59,658::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) (7418) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:32:59,659::__init__::225::IOProcess::(_processLogs) (7418) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:32:59,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7418) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,660::__init__::225::IOProcess::(_processLogs) (7418) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,660::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-19::DEBUG::2014-09-09 11:32:59,660::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-3406::DEBUG::2014-09-09 11:32:59,660::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-3406::DEBUG::2014-09-09 11:32:59,661::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-3406::DEBUG::2014-09-09 11:32:59,661::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-3406::DEBUG::2014-09-09 11:32:59,661::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', u'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=64fc4e3aab402841fdacc4592399f76ab01a99ac'] >Thread-19::DEBUG::2014-09-09 11:32:59,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,661::__init__::225::IOProcess::(_processLogs) Message size is 604 >Thread-19::DEBUG::2014-09-09 11:32:59,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,662::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,662::__init__::225::IOProcess::(_processLogs) (7419) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:32:59,662::__init__::225::IOProcess::(_processLogs) (7419) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:32:59,699::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7419) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,699::__init__::225::IOProcess::(_processLogs) (7419) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,699::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,700::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3406::WARNING::2014-09-09 11:32:59,699::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:32:59,700::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,700::__init__::225::IOProcess::(_processLogs) Message size is 292 >Thread-19::DEBUG::2014-09-09 11:32:59,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) (7420) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) (7420) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7420) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,701::__init__::225::IOProcess::(_processLogs) (7420) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,702::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,702::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-19::DEBUG::2014-09-09 11:32:59,702::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Message size is 71 >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) (7421) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,703::__init__::225::IOProcess::(_processLogs) (7421) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) (7421) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) (7421) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) Message size is 75 >Thread-19::DEBUG::2014-09-09 11:32:59,704::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) (7422) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) (7422) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) (7422) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) (7422) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,705::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) Message size is 87 >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) (7423) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) (7423) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,706::__init__::225::IOProcess::(_processLogs) (7423) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) (7423) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Message size is 91 >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) (7424) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) (7424) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) (7424) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) (7424) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,708::__init__::225::IOProcess::(_processLogs) Message size is 123 >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) (7425) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) (7425) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) (7425) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) (7425) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Message size is 160 >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) (7426) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,710::__init__::225::IOProcess::(_processLogs) (7426) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7426) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) (7426) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) (7427) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) (7427) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7427) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) (7427) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,712::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,712::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:32:59,713::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,713::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,713::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:32:59,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,714::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,714::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,714::__init__::225::IOProcess::(_processLogs) (7428) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:32:59,714::__init__::225::IOProcess::(_processLogs) (7428) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:32:59,733::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7428) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,733::__init__::225::IOProcess::(_processLogs) (7428) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,733::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,733::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:32:59,733::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,735::__init__::225::IOProcess::(_processLogs) (7429) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:32:59,735::__init__::225::IOProcess::(_processLogs) (7429) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:32:59,738::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7429) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,738::__init__::225::IOProcess::(_processLogs) (7429) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,738::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,738::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=64fc4e3aab402841fdacc4592399f76ab01a99ac'] >Thread-19::DEBUG::2014-09-09 11:32:59,739::__init__::225::IOProcess::(_processLogs) Sending response sized 458 >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) (7430) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) (7430) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7430) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,740::__init__::225::IOProcess::(_processLogs) (7430) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,742::__init__::225::IOProcess::(_processLogs) (7431) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:32:59,742::__init__::225::IOProcess::(_processLogs) (7431) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:32:59,743::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7431) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,744::__init__::225::IOProcess::(_processLogs) (7431) Queuing response >Thread-3406::DEBUG::2014-09-09 11:32:59,744::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:32:59,744::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3406::DEBUG::2014-09-09 11:32:59,745::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS' >Thread-19::DEBUG::2014-09-09 11:32:59,745::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3406::DEBUG::2014-09-09 11:32:59,745::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS' >Thread-3406::DEBUG::2014-09-09 11:32:59,745::clusterlock::95::Storage.Misc.excCmd::(initLock) /usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/leases 0 (cwd /usr/libexec/vdsm) >Thread-3406::DEBUG::2014-09-09 11:32:59,791::clusterlock::95::Storage.Misc.excCmd::(initLock) SUCCESS: <err> = ''; <rc> = 0 >Thread-3406::DEBUG::2014-09-09 11:32:59,792::sd::443::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-3406::DEBUG::2014-09-09 11:32:59,792::hsm::2691::Storage.HSM::(createStorageDomain) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain, 85442237-be11-4bd0-b6c3-43ba60c1b87f: storage.nfsSD.findDomain} >Thread-3406::INFO::2014-09-09 11:32:59,792::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-3406::DEBUG::2014-09-09 11:32:59,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f9733c1-a367-4968-b853-de77457f5356`::finished: None >Thread-3406::DEBUG::2014-09-09 11:32:59,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f9733c1-a367-4968-b853-de77457f5356`::moving from state preparing -> state finished >Thread-3406::DEBUG::2014-09-09 11:32:59,792::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3406::DEBUG::2014-09-09 11:32:59,792::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3406::DEBUG::2014-09-09 11:32:59,792::task::993::Storage.TaskManager.Task::(_decref) Task=`0f9733c1-a367-4968-b853-de77457f5356`::ref 0 aborting False >Thread-3406::DEBUG::2014-09-09 11:32:59,792::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.create' in bridge with True >Thread-3406::DEBUG::2014-09-09 11:32:59,793::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:32:59,796::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:32:59,797::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3410::DEBUG::2014-09-09 11:32:59,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`7571f370-d976-4e89-8072-8f5b7c2c30a1`::moving from state init -> state preparing >Thread-3410::INFO::2014-09-09 11:32:59,798::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', options=None) >Thread-3410::DEBUG::2014-09-09 11:32:59,798::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`c459adee-d527-4d1c-bdfd-f9d3b968b467`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2830' at 'getStorageDomainStats' >Thread-3410::DEBUG::2014-09-09 11:32:59,798::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3410::DEBUG::2014-09-09 11:32:59,798::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3410::DEBUG::2014-09-09 11:32:59,798::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`c459adee-d527-4d1c-bdfd-f9d3b968b467`::Granted request >Thread-3410::DEBUG::2014-09-09 11:32:59,799::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7571f370-d976-4e89-8072-8f5b7c2c30a1`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3410::DEBUG::2014-09-09 11:32:59,799::task::993::Storage.TaskManager.Task::(_decref) Task=`7571f370-d976-4e89-8072-8f5b7c2c30a1`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:32:59,799::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:32:59,799::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:32:59,799::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:32:59,799::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) (7432) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) (7432) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7432) Building response >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) (7432) Queuing response >Thread-19::DEBUG::2014-09-09 11:32:59,800::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3410::INFO::2014-09-09 11:32:59,801::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '283923972096', 'disktotal': '430684766208', 'mdafree': 0}} >Thread-19::DEBUG::2014-09-09 11:32:59,801::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3410::DEBUG::2014-09-09 11:32:59,801::task::1191::Storage.TaskManager.Task::(prepare) Task=`7571f370-d976-4e89-8072-8f5b7c2c30a1`::finished: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '283923972096', 'disktotal': '430684766208', 'mdafree': 0}} >Thread-3410::DEBUG::2014-09-09 11:32:59,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`7571f370-d976-4e89-8072-8f5b7c2c30a1`::moving from state preparing -> state finished >Thread-3410::DEBUG::2014-09-09 11:32:59,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3410::DEBUG::2014-09-09 11:32:59,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3410::DEBUG::2014-09-09 11:32:59,802::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3410::DEBUG::2014-09-09 11:32:59,802::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3410::DEBUG::2014-09-09 11:32:59,802::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3410::DEBUG::2014-09-09 11:32:59,802::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3410::DEBUG::2014-09-09 11:32:59,802::task::993::Storage.TaskManager.Task::(_decref) Task=`7571f370-d976-4e89-8072-8f5b7c2c30a1`::ref 0 aborting False >Thread-3410::DEBUG::2014-09-09 11:32:59,802::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:32:59,913::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3411::DEBUG::2014-09-09 11:32:59,913::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.disconnectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >JsonRpcServer::DEBUG::2014-09-09 11:32:59,913::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3411::DEBUG::2014-09-09 11:32:59,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`0504b921-6b94-411b-9fa1-6cf274255cf4`::moving from state init -> state preparing >Thread-3411::INFO::2014-09-09 11:32:59,914::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-3411::DEBUG::2014-09-09 11:32:59,915::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 (cwd None) >Thread-3411::DEBUG::2014-09-09 11:32:59,934::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-3411::DEBUG::2014-09-09 11:32:59,934::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3411::DEBUG::2014-09-09 11:32:59,934::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-3411::DEBUG::2014-09-09 11:32:59,934::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3411::DEBUG::2014-09-09 11:32:59,934::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-3411::DEBUG::2014-09-09 11:32:59,934::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-3411::DEBUG::2014-09-09 11:32:59,942::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3411::DEBUG::2014-09-09 11:32:59,944::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-3411::DEBUG::2014-09-09 11:32:59,960::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-3411::DEBUG::2014-09-09 11:32:59,960::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3411::DEBUG::2014-09-09 11:32:59,960::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3411::DEBUG::2014-09-09 11:32:59,960::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3411::DEBUG::2014-09-09 11:32:59,961::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3411::DEBUG::2014-09-09 11:32:59,961::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3411::DEBUG::2014-09-09 11:32:59,961::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3411::DEBUG::2014-09-09 11:32:59,961::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3411::INFO::2014-09-09 11:32:59,961::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3411::DEBUG::2014-09-09 11:32:59,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`0504b921-6b94-411b-9fa1-6cf274255cf4`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3411::DEBUG::2014-09-09 11:32:59,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`0504b921-6b94-411b-9fa1-6cf274255cf4`::moving from state preparing -> state finished >Thread-3411::DEBUG::2014-09-09 11:32:59,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3411::DEBUG::2014-09-09 11:32:59,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3411::DEBUG::2014-09-09 11:32:59,962::task::993::Storage.TaskManager.Task::(_decref) Task=`0504b921-6b94-411b-9fa1-6cf274255cf4`::ref 0 aborting False >Thread-3411::DEBUG::2014-09-09 11:32:59,962::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.disconnectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-3411::DEBUG::2014-09-09 11:32:59,962::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:00,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:00,068::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3412::DEBUG::2014-09-09 11:33:00,068::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >Thread-3412::DEBUG::2014-09-09 11:33:00,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d956474-cc2c-4c7f-9380-3a0f6aa45488`::moving from state init -> state preparing >Thread-3412::INFO::2014-09-09 11:33:00,069::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-3412::DEBUG::2014-09-09 11:33:00,071::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-3412::DEBUG::2014-09-09 11:33:00,071::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 192.168.2.1:/home/storage/data2 /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:00,096::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,096::__init__::225::IOProcess::(_processLogs) Message size is 122 >Thread-19::DEBUG::2014-09-09 11:33:00,096::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) (7433) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) (7433) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:00,097::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7433) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,098::__init__::225::IOProcess::(_processLogs) (7433) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:00,098::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3412::DEBUG::2014-09-09 11:33:00,102::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-19::DEBUG::2014-09-09 11:33:00,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,102::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:00,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,103::__init__::225::IOProcess::(_processLogs) (7434) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:00,103::__init__::225::IOProcess::(_processLogs) (7434) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:00,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7434) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,104::__init__::225::IOProcess::(_processLogs) (7434) Queuing response >Thread-3412::DEBUG::2014-09-09 11:33:00,104::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f',) >Thread-19::DEBUG::2014-09-09 11:33:00,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3412::DEBUG::2014-09-09 11:33:00,105::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain, 85442237-be11-4bd0-b6c3-43ba60c1b87f: storage.nfsSD.findDomain} >Thread-19::DEBUG::2014-09-09 11:33:00,105::__init__::225::IOProcess::(_processLogs) Sending response sized 146 >Thread-3412::INFO::2014-09-09 11:33:00,105::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3412::DEBUG::2014-09-09 11:33:00,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d956474-cc2c-4c7f-9380-3a0f6aa45488`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3412::DEBUG::2014-09-09 11:33:00,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d956474-cc2c-4c7f-9380-3a0f6aa45488`::moving from state preparing -> state finished >Thread-3412::DEBUG::2014-09-09 11:33:00,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3412::DEBUG::2014-09-09 11:33:00,106::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3412::DEBUG::2014-09-09 11:33:00,106::task::993::Storage.TaskManager.Task::(_decref) Task=`0d956474-cc2c-4c7f-9380-3a0f6aa45488`::ref 0 aborting False >Thread-3412::DEBUG::2014-09-09 11:33:00,106::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-3412::DEBUG::2014-09-09 11:33:00,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:00,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3413::DEBUG::2014-09-09 11:33:00,115::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.getInfo' in bridge with {u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >JsonRpcServer::DEBUG::2014-09-09 11:33:00,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3413::DEBUG::2014-09-09 11:33:00,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`55d86040-4789-45ef-99f0-4b9275110147`::moving from state init -> state preparing >Thread-3413::INFO::2014-09-09 11:33:00,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', options=None) >Thread-3413::DEBUG::2014-09-09 11:33:00,116::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-3413::DEBUG::2014-09-09 11:33:00,116::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3413::DEBUG::2014-09-09 11:33:00,116::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-3413::DEBUG::2014-09-09 11:33:00,116::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3413::DEBUG::2014-09-09 11:33:00,116::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-3413::DEBUG::2014-09-09 11:33:00,116::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-3413::DEBUG::2014-09-09 11:33:00,125::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3413::DEBUG::2014-09-09 11:33:00,126::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-3413::DEBUG::2014-09-09 11:33:00,141::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-3413::DEBUG::2014-09-09 11:33:00,142::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3413::DEBUG::2014-09-09 11:33:00,142::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3413::DEBUG::2014-09-09 11:33:00,142::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3413::DEBUG::2014-09-09 11:33:00,142::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3413::DEBUG::2014-09-09 11:33:00,142::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3413::DEBUG::2014-09-09 11:33:00,142::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3413::DEBUG::2014-09-09 11:33:00,142::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-09-09 11:33:00,144::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,145::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:00,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,145::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) (7435) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) (7435) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,147::__init__::225::IOProcess::(_processLogs) (7436) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:00,147::__init__::225::IOProcess::(_processLogs) (7436) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:00,147::__init__::225::IOProcess::(_processLogs) (7435) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,148::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,149::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:00,149::__init__::225::IOProcess::(_processLogs) (7435) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,151::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json...Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,153::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-3413::DEBUG::2014-09-09 11:33:00,153::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) (7437) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) (7437) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) (7437) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) (7437) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:00,154::__init__::225::IOProcess::(_processLogs) DEBUG|(7436) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,155::__init__::225::IOProcess::(_processLogs) (7436) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,155::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:00,155::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:33:00,155::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) (7438) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:00,156::__init__::225::IOProcess::(_processLogs) (7438) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:00,216::__init__::225::IOProcess::(_processLogs) DEBUG|(7438) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,217::__init__::225::IOProcess::(_processLogs) (7438) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,217::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3413::DEBUG::2014-09-09 11:33:00,217::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:00,217::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,218::__init__::225::IOProcess::(_processLogs) (7439) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:00,219::__init__::225::IOProcess::(_processLogs) (7439) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:00,222::__init__::225::IOProcess::(_processLogs) DEBUG|(7439) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,222::__init__::225::IOProcess::(_processLogs) (7439) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,222::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3413::DEBUG::2014-09-09 11:33:00,222::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=64fc4e3aab402841fdacc4592399f76ab01a99ac'] >Thread-19::DEBUG::2014-09-09 11:33:00,223::__init__::225::IOProcess::(_processLogs) Sending response sized 458 >Thread-19::DEBUG::2014-09-09 11:33:00,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) (7440) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) (7440) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:00,224::__init__::225::IOProcess::(_processLogs) (7440) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) (7440) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,225::__init__::225::IOProcess::(_processLogs) (7441) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:00,226::__init__::225::IOProcess::(_processLogs) (7441) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:00,227::__init__::225::IOProcess::(_processLogs) DEBUG|(7441) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,227::__init__::225::IOProcess::(_processLogs) (7441) Queuing response >Thread-3413::DEBUG::2014-09-09 11:33:00,228::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:00,228::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3413::INFO::2014-09-09 11:33:00,228::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:33:00,228::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3413::INFO::2014-09-09 11:33:00,228::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-3413::INFO::2014-09-09 11:33:00,229::fileSD::341::Storage.StorageDomain::(validate) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:33:00,229::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:00,229::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:33:00,229::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:00,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:00,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:00,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:00,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:00,230::__init__::225::IOProcess::(_processLogs) (7442) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:00,230::__init__::225::IOProcess::(_processLogs) (7442) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:00,231::__init__::225::IOProcess::(_processLogs) DEBUG|(7442) Building response >Thread-19::DEBUG::2014-09-09 11:33:00,231::__init__::225::IOProcess::(_processLogs) (7442) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:00,232::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3413::DEBUG::2014-09-09 11:33:00,232::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=64fc4e3aab402841fdacc4592399f76ab01a99ac'] >Thread-19::DEBUG::2014-09-09 11:33:00,232::__init__::225::IOProcess::(_processLogs) Sending response sized 458 >Thread-3413::DEBUG::2014-09-09 11:33:00,233::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`3e13fbaa-b757-4f6f-9a4c-e8305d5c6051`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-3413::DEBUG::2014-09-09 11:33:00,233::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3413::DEBUG::2014-09-09 11:33:00,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3413::DEBUG::2014-09-09 11:33:00,233::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`3e13fbaa-b757-4f6f-9a4c-e8305d5c6051`::Granted request >Thread-3413::DEBUG::2014-09-09 11:33:00,234::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`55d86040-4789-45ef-99f0-4b9275110147`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3413::DEBUG::2014-09-09 11:33:00,234::task::993::Storage.TaskManager.Task::(_decref) Task=`55d86040-4789-45ef-99f0-4b9275110147`::ref 1 aborting False >Thread-3413::INFO::2014-09-09 11:33:00,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'85442237-be11-4bd0-b6c3-43ba60c1b87f', 'version': '0', 'role': 'Regular', 'remotePath': '192.168.2.1:/home/storage/data2', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'data2-nfs'}} >Thread-3413::DEBUG::2014-09-09 11:33:00,235::task::1191::Storage.TaskManager.Task::(prepare) Task=`55d86040-4789-45ef-99f0-4b9275110147`::finished: {'info': {'uuid': u'85442237-be11-4bd0-b6c3-43ba60c1b87f', 'version': '0', 'role': 'Regular', 'remotePath': '192.168.2.1:/home/storage/data2', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'data2-nfs'}} >Thread-3413::DEBUG::2014-09-09 11:33:00,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`55d86040-4789-45ef-99f0-4b9275110147`::moving from state preparing -> state finished >Thread-3413::DEBUG::2014-09-09 11:33:00,235::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3413::DEBUG::2014-09-09 11:33:00,235::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3413::DEBUG::2014-09-09 11:33:00,235::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3413::DEBUG::2014-09-09 11:33:00,236::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3413::DEBUG::2014-09-09 11:33:00,236::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3413::DEBUG::2014-09-09 11:33:00,236::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3413::DEBUG::2014-09-09 11:33:00,236::task::993::Storage.TaskManager.Task::(_decref) Task=`55d86040-4789-45ef-99f0-4b9275110147`::ref 0 aborting False >Thread-3413::WARNING::2014-09-09 11:33:00,236::Bridge::210::root::(_typeFixup) Fixing up type StorageDomainInfo >Thread-3413::WARNING::2014-09-09 11:33:00,236::Bridge::448::root::(fieldClone) fieldClone: class -> domainClass >Thread-3413::DEBUG::2014-09-09 11:33:00,236::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.getInfo' in bridge with {'uuid': u'85442237-be11-4bd0-b6c3-43ba60c1b87f', 'domainClass': 'Data', 'version': '0', 'role': 'Regular', 'remotePath': '192.168.2.1:/home/storage/data2', 'type': 'NFS', 'class': 'Data', 'pool': [], 'name': 'data2-nfs'} >Thread-3413::DEBUG::2014-09-09 11:33:00,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:00,240::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:00,241::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3417::DEBUG::2014-09-09 11:33:00,241::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.attach' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >Thread-3417::DEBUG::2014-09-09 11:33:00,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::moving from state init -> state preparing >Thread-3417::INFO::2014-09-09 11:33:00,242::logUtils::44::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3417::DEBUG::2014-09-09 11:33:00,242::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1b734625-a8cf-4ada-960e-ee005a92a043`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1190' at 'attachStorageDomain' >Thread-3417::DEBUG::2014-09-09 11:33:00,242::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-3417::DEBUG::2014-09-09 11:33:00,242::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-3417::DEBUG::2014-09-09 11:33:00,242::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1b734625-a8cf-4ada-960e-ee005a92a043`::Granted request >Thread-3417::DEBUG::2014-09-09 11:33:00,242::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (exclusive) >Thread-3417::DEBUG::2014-09-09 11:33:00,242::task::993::Storage.TaskManager.Task::(_decref) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::ref 1 aborting False >Thread-3417::DEBUG::2014-09-09 11:33:00,243::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`acbbf481-cd36-4ec0-8615-47b6355c5afe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1191' at 'attachStorageDomain' >Thread-3417::DEBUG::2014-09-09 11:33:00,243::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'exclusive' >Thread-3417::DEBUG::2014-09-09 11:33:00,243::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'exclusive' (1 active user) >Thread-3417::DEBUG::2014-09-09 11:33:00,243::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`acbbf481-cd36-4ec0-8615-47b6355c5afe`::Granted request >Thread-3417::DEBUG::2014-09-09 11:33:00,243::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (exclusive) >Thread-3417::DEBUG::2014-09-09 11:33:00,243::task::993::Storage.TaskManager.Task::(_decref) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::ref 1 aborting False >Thread-3417::INFO::2014-09-09 11:33:00,243::sp::876::Storage.StoragePool::(attachSD) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f spUUID=5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-3417::DEBUG::2014-09-09 11:33:00,245::clusterlock::112::Storage.SafeLease::(acquireHostId) Host id for domain 85442237-be11-4bd0-b6c3-43ba60c1b87f successfully acquired (id: 2) >Thread-3417::DEBUG::2014-09-09 11:33:00,245::clusterlock::129::Storage.SafeLease::(acquire) Acquiring cluster lock for domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3417::DEBUG::2014-09-09 11:33:00,245::clusterlock::143::Storage.Misc.excCmd::(acquire) /usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /usr/bin/su vdsm -s /bin/sh -c '/usr/libexec/vdsm/spmprotect.sh start 85442237-be11-4bd0-b6c3-43ba60c1b87f 2 5 /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/leases 60000 10000 3' (cwd /usr/libexec/vdsm) >Dummy-97::DEBUG::2014-09-09 11:33:01,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:01,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902405 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:01,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:01,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3418::DEBUG::2014-09-09 11:33:01,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) (7443) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:02,362::__init__::225::IOProcess::(_processLogs) (7443) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:02,363::__init__::225::IOProcess::(_processLogs) DEBUG|(7443) Building response >Thread-19::DEBUG::2014-09-09 11:33:02,363::__init__::225::IOProcess::(_processLogs) (7443) Queuing response >Thread-24::DEBUG::2014-09-09 11:33:02,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:02,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:02,368::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:33:02,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.0009934 s, 507 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:02,371::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:02,371::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:02,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:02,371::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) (7444) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) (7444) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) DEBUG|(7444) Building response >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) (7444) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:02,372::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:02,373::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:02,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:02,373::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:33:02,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) (7445) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) (7445) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) (7445) Building response >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) (7445) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:02,374::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:02,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) (7446) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) (7446) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) (7446) Building response >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) (7446) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:33:02,376::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) (7447) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) (7447) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) (7447) Building response >Thread-19::DEBUG::2014-09-09 11:33:02,377::__init__::225::IOProcess::(_processLogs) (7447) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:02,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:02,378::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:33:03,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:03,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898164 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:04,803::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:04,804::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3419::DEBUG::2014-09-09 11:33:04,805::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:05,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:05,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896693 s, 11.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:33:07,440::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:33:07,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) (7448) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) (7448) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:07,443::__init__::225::IOProcess::(_processLogs) DEBUG|(7448) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) (7448) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,444::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) (7449) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) (7449) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,446::__init__::225::IOProcess::(_processLogs) (7450) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:07,446::__init__::225::IOProcess::(_processLogs) (7450) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:07,446::__init__::225::IOProcess::(_processLogs) DEBUG|(7449) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,446::__init__::225::IOProcess::(_processLogs) (7449) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,447::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:07,447::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:33:07,447::__init__::225::IOProcess::(_processLogs) DEBUG|(7450) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,447::__init__::225::IOProcess::(_processLogs) (7450) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,448::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:07,449::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 11:33:07,450::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:33:07,450::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,450::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:33:07,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,451::__init__::225::IOProcess::(_processLogs) (7451) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:07,451::__init__::225::IOProcess::(_processLogs) (7451) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:07,469::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7451) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,469::__init__::225::IOProcess::(_processLogs) (7451) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,470::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:07,470::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:07,470::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) (7452) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:07,471::__init__::225::IOProcess::(_processLogs) (7452) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:07,474::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7452) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,474::__init__::225::IOProcess::(_processLogs) (7452) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,474::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:07,474::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:33:07,474::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 11:33:07,475::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,475::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:33:07,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) (7453) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) (7453) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) (7453) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) (7453) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) (7454) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:07,477::__init__::225::IOProcess::(_processLogs) (7454) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:07,478::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7454) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,478::__init__::225::IOProcess::(_processLogs) (7454) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,479::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:07,479::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:07,479::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:33:07,479::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 11:33:07,480::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,481::__init__::225::IOProcess::(_processLogs) (7455) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:07,481::__init__::225::IOProcess::(_processLogs) (7455) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:07,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7455) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,481::__init__::225::IOProcess::(_processLogs) (7455) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:07,482::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:07,482::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:33:07,488::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111867 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) (7456) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:07,489::__init__::225::IOProcess::(_processLogs) (7456) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:07,490::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7456) Building response >Thread-19::DEBUG::2014-09-09 11:33:07,490::__init__::225::IOProcess::(_processLogs) (7456) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:07,490::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:07,490::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:33:07,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:07,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089654 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:07,814::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:07,814::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3423::DEBUG::2014-09-09 11:33:07,815::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:09,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:09,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896711 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:10,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:10,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3424::DEBUG::2014-09-09 11:33:10,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`87f6cd79-77a1-489b-af53-4b948b9e1f59`::moving from state init -> state preparing >Thread-3424::INFO::2014-09-09 11:33:10,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3424::INFO::2014-09-09 11:33:10,827::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111867', 'lastCheck': '3.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009934', 'lastCheck': '8.5', 'valid': True}} >Thread-3424::DEBUG::2014-09-09 11:33:10,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`87f6cd79-77a1-489b-af53-4b948b9e1f59`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111867', 'lastCheck': '3.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009934', 'lastCheck': '8.5', 'valid': True}} >Thread-3424::DEBUG::2014-09-09 11:33:10,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`87f6cd79-77a1-489b-af53-4b948b9e1f59`::moving from state preparing -> state finished >Thread-3424::DEBUG::2014-09-09 11:33:10,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3424::DEBUG::2014-09-09 11:33:10,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3424::DEBUG::2014-09-09 11:33:10,828::task::993::Storage.TaskManager.Task::(_decref) Task=`87f6cd79-77a1-489b-af53-4b948b9e1f59`::ref 0 aborting False >Thread-3424::DEBUG::2014-09-09 11:33:10,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:10,835::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:10,836::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3425::DEBUG::2014-09-09 11:33:10,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:11,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:11,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896525 s, 11.4 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:33:12,377::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:33:12,379::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,379::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:12,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) (7457) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) (7457) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7457) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,380::__init__::225::IOProcess::(_processLogs) (7457) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,381::__init__::225::IOProcess::(_processLogs) (7458) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) (7458) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) (7459) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:12,382::__init__::225::IOProcess::(_processLogs) (7459) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7459) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) (7459) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) (7458) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) (7458) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,383::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-24::DEBUG::2014-09-09 11:33:12,385::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:33:12,385::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,385::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:33:12,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,385::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,386::__init__::225::IOProcess::(_processLogs) (7460) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:12,386::__init__::225::IOProcess::(_processLogs) (7460) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:12,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7460) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,404::__init__::225::IOProcess::(_processLogs) (7460) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:33:12,405::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:12,405::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:12,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) (7461) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:12,406::__init__::225::IOProcess::(_processLogs) (7461) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:12,410::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7461) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,410::__init__::225::IOProcess::(_processLogs) (7461) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,410::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:33:12,410::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=db9437313b925c8c90666a5b2cbfdac59b1332b8'] >Thread-19::DEBUG::2014-09-09 11:33:12,410::__init__::225::IOProcess::(_processLogs) Sending response sized 726 >Thread-19::DEBUG::2014-09-09 11:33:12,411::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,411::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:33:12,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) (7462) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) (7462) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7462) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) (7462) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,412::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,413::__init__::225::IOProcess::(_processLogs) (7463) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:12,414::__init__::225::IOProcess::(_processLogs) (7463) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:12,414::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7463) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,415::__init__::225::IOProcess::(_processLogs) (7463) Queuing response >Thread-24::DEBUG::2014-09-09 11:33:12,415::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:12,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::INFO::2014-09-09 11:33:12,415::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:33:12,416::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-24::INFO::2014-09-09 11:33:12,416::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:33:12,416::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:12,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,417::__init__::225::IOProcess::(_processLogs) (7464) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:12,417::__init__::225::IOProcess::(_processLogs) (7464) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:12,417::__init__::225::IOProcess::(_processLogs) (7464) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,417::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:33:12,418::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:33:12,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000930387 s, 542 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:12,425::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:12,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,425::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:12,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,426::__init__::225::IOProcess::(_processLogs) (7465) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:12,426::__init__::225::IOProcess::(_processLogs) (7465) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:12,426::__init__::225::IOProcess::(_processLogs) (7465) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,426::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:12,427::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:33:12,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) (7466) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) (7466) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) (7466) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) (7466) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) (7467) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) (7467) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) (7467) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) (7467) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:12,429::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:33:12,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:12,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:12,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:12,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:12,430::__init__::225::IOProcess::(_processLogs) (7468) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:12,430::__init__::225::IOProcess::(_processLogs) (7468) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:12,431::__init__::225::IOProcess::(_processLogs) (7468) Building response >Thread-19::DEBUG::2014-09-09 11:33:12,431::__init__::225::IOProcess::(_processLogs) (7468) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:12,431::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:12,431::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:33:13,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:13,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:13,901::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3429::DEBUG::2014-09-09 11:33:13,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:13,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898751 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:33:15,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:16,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896148 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:16,914::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:16,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3430::DEBUG::2014-09-09 11:33:16,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:17,491::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:17,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:17,491::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:17,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:17,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:17,492::__init__::225::IOProcess::(_processLogs) (7469) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:17,492::__init__::225::IOProcess::(_processLogs) (7469) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:17,492::__init__::225::IOProcess::(_processLogs) (7469) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:17,492::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:33:17,493::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:33:17,499::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109551 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) (7470) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:17,500::__init__::225::IOProcess::(_processLogs) (7470) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:17,501::__init__::225::IOProcess::(_processLogs) (7470) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:17,501::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:33:18,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:18,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089795 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:19,923::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:19,925::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3431::DEBUG::2014-09-09 11:33:19,928::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:20,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:20,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0947241 s, 10.8 MB/s\n'; <rc> = 0 >Thread-3417::DEBUG::2014-09-09 11:33:20,410::clusterlock::143::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = '/bin/cat: /var/run/vdsm/vdsmd.pid: No such file or directory\n'; <rc> = 0 >Thread-3417::DEBUG::2014-09-09 11:33:20,410::clusterlock::146::Storage.SafeLease::(acquire) Clustered lock acquired successfully >Thread-19::DEBUG::2014-09-09 11:33:20,410::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:33:20,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:20,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:20,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:20,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:20,411::__init__::225::IOProcess::(_processLogs) (7471) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:20,411::__init__::225::IOProcess::(_processLogs) (7471) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:20,414::__init__::225::IOProcess::(_processLogs) (7471) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:20,414::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:20,414::__init__::225::IOProcess::(_processLogs) Sending response sized 458 >Thread-3417::DEBUG::2014-09-09 11:33:20,414::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=64fc4e3aab402841fdacc4592399f76ab01a99ac'] >Thread-3417::DEBUG::2014-09-09 11:33:20,415::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-3417::DEBUG::2014-09-09 11:33:20,415::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-3417::DEBUG::2014-09-09 11:33:20,415::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a566b40ee76cb276b6f19473370fb1cdb96502fb'] >Thread-19::DEBUG::2014-09-09 11:33:20,415::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) (7472) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:33:20,416::__init__::225::IOProcess::(_processLogs) (7472) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:33:20,490::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7472) Building response >Thread-19::DEBUG::2014-09-09 11:33:20,490::__init__::225::IOProcess::(_processLogs) (7472) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:20,490::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Generating json... >Thread-3417::WARNING::2014-09-09 11:33:20,490::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:33:20,491::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:33:20,491::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:20,491::__init__::225::IOProcess::(_processLogs) Message size is 292 >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) (7473) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) (7473) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7473) Building response >Thread-19::DEBUG::2014-09-09 11:33:20,492::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7473) Queuing response >Thread-3417::DEBUG::2014-09-09 11:33:20,493::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-19::DEBUG::2014-09-09 11:33:20,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3417::DEBUG::2014-09-09 11:33:20,493::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-19::DEBUG::2014-09-09 11:33:20,494::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3417::DEBUG::2014-09-09 11:33:20,494::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-3417::DEBUG::2014-09-09 11:33:20,494::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', u'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=245807057b0dd8f851cc6ad4982d74153eb3f5dd'] >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Message size is 935 >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) (7474) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:33:20,495::__init__::225::IOProcess::(_processLogs) (7474) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:33:20,542::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7474) Building response >Thread-19::DEBUG::2014-09-09 11:33:20,542::__init__::225::IOProcess::(_processLogs) (7474) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:20,542::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Generating json... >Thread-3417::WARNING::2014-09-09 11:33:20,542::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:33:20,543::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:33:20,543::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) Message size is 290 >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) (7475) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:33:20,544::__init__::225::IOProcess::(_processLogs) (7475) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:33:20,547::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7475) Building response >Thread-19::DEBUG::2014-09-09 11:33:20,547::__init__::225::IOProcess::(_processLogs) (7475) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:20,547::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Generating json... >Thread-3417::DEBUG::2014-09-09 11:33:20,547::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-19::DEBUG::2014-09-09 11:33:20,548::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3417::INFO::2014-09-09 11:33:20,548::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3417::DEBUG::2014-09-09 11:33:20,548::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3417::INFO::2014-09-09 11:33:20,549::clusterlock::159::Storage.SafeLease::(release) Releasing cluster lock for domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3417::DEBUG::2014-09-09 11:33:20,549::clusterlock::161::Storage.Misc.excCmd::(release) /usr/libexec/vdsm/spmstop.sh 85442237-be11-4bd0-b6c3-43ba60c1b87f (cwd /usr/libexec/vdsm) >Thread-3417::DEBUG::2014-09-09 11:33:21,563::clusterlock::161::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0 >Thread-3417::DEBUG::2014-09-09 11:33:21,564::clusterlock::166::Storage.SafeLease::(release) Cluster lock released successfully >Thread-3417::DEBUG::2014-09-09 11:33:21,564::clusterlock::116::Storage.SafeLease::(releaseHostId) Host id for domain 85442237-be11-4bd0-b6c3-43ba60c1b87f released successfully (id: 2) >Thread-3417::DEBUG::2014-09-09 11:33:21,564::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-3417::DEBUG::2014-09-09 11:33:21,564::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3417::DEBUG::2014-09-09 11:33:21,565::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3417::INFO::2014-09-09 11:33:21,565::logUtils::47::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-3417::DEBUG::2014-09-09 11:33:21,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::finished: None >Thread-3417::DEBUG::2014-09-09 11:33:21,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::moving from state preparing -> state finished >Thread-3417::DEBUG::2014-09-09 11:33:21,565::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>, u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3417::DEBUG::2014-09-09 11:33:21,565::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3417::DEBUG::2014-09-09 11:33:21,565::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3417::DEBUG::2014-09-09 11:33:21,565::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3417::DEBUG::2014-09-09 11:33:21,565::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3417::DEBUG::2014-09-09 11:33:21,566::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3417::DEBUG::2014-09-09 11:33:21,566::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3417::DEBUG::2014-09-09 11:33:21,566::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3417::DEBUG::2014-09-09 11:33:21,566::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3417::DEBUG::2014-09-09 11:33:21,566::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3417::DEBUG::2014-09-09 11:33:21,566::task::993::Storage.TaskManager.Task::(_decref) Task=`23b2839b-a1d0-4a48-91f4-1c7e829897ca`::ref 0 aborting False >Thread-3417::DEBUG::2014-09-09 11:33:21,566::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.attach' in bridge with True >Thread-3417::DEBUG::2014-09-09 11:33:21,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:21,572::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3432::DEBUG::2014-09-09 11:33:21,572::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:33:21,572::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3432::DEBUG::2014-09-09 11:33:21,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5d3d6fc-7a40-4f19-86e3-1d24b46f21c8`::moving from state init -> state preparing >Thread-3432::INFO::2014-09-09 11:33:21,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3432::INFO::2014-09-09 11:33:21,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3432::DEBUG::2014-09-09 11:33:21,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5d3d6fc-7a40-4f19-86e3-1d24b46f21c8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3432::DEBUG::2014-09-09 11:33:21,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5d3d6fc-7a40-4f19-86e3-1d24b46f21c8`::moving from state preparing -> state finished >Thread-3432::DEBUG::2014-09-09 11:33:21,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3432::DEBUG::2014-09-09 11:33:21,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3432::DEBUG::2014-09-09 11:33:21,574::task::993::Storage.TaskManager.Task::(_decref) Task=`c5d3d6fc-7a40-4f19-86e3-1d24b46f21c8`::ref 0 aborting False >Thread-3432::DEBUG::2014-09-09 11:33:21,574::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3432::DEBUG::2014-09-09 11:33:21,574::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:21,646::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:21,646::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3433::DEBUG::2014-09-09 11:33:21,646::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3433::DEBUG::2014-09-09 11:33:21,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`c90ed28a-9639-4bfd-aec6-d0321b5490c7`::moving from state init -> state preparing >Thread-3433::INFO::2014-09-09 11:33:21,647::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3433::DEBUG::2014-09-09 11:33:21,648::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7402a852-a753-45c3-9770-cc9b11787bbf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3433::DEBUG::2014-09-09 11:33:21,648::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3433::DEBUG::2014-09-09 11:33:21,648::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3433::DEBUG::2014-09-09 11:33:21,648::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7402a852-a753-45c3-9770-cc9b11787bbf`::Granted request >Thread-3433::DEBUG::2014-09-09 11:33:21,648::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c90ed28a-9639-4bfd-aec6-d0321b5490c7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3433::DEBUG::2014-09-09 11:33:21,648::task::993::Storage.TaskManager.Task::(_decref) Task=`c90ed28a-9639-4bfd-aec6-d0321b5490c7`::ref 1 aborting False >Thread-3433::INFO::2014-09-09 11:33:21,650::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': u'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {u'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': u'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, u'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': u'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-3433::DEBUG::2014-09-09 11:33:21,650::task::1191::Storage.TaskManager.Task::(prepare) Task=`c90ed28a-9639-4bfd-aec6-d0321b5490c7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': u'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {u'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': u'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, u'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': u'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-3433::DEBUG::2014-09-09 11:33:21,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`c90ed28a-9639-4bfd-aec6-d0321b5490c7`::moving from state preparing -> state finished >Thread-3433::DEBUG::2014-09-09 11:33:21,650::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3433::DEBUG::2014-09-09 11:33:21,650::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3433::DEBUG::2014-09-09 11:33:21,650::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3433::DEBUG::2014-09-09 11:33:21,650::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3433::DEBUG::2014-09-09 11:33:21,650::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3433::DEBUG::2014-09-09 11:33:21,650::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3433::DEBUG::2014-09-09 11:33:21,651::task::993::Storage.TaskManager.Task::(_decref) Task=`c90ed28a-9639-4bfd-aec6-d0321b5490c7`::ref 0 aborting False >Thread-3433::DEBUG::2014-09-09 11:33:21,651::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': u'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {u'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': u'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, u'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': u'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': u'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-3433::DEBUG::2014-09-09 11:33:21,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:21,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:21,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3434::DEBUG::2014-09-09 11:33:21,680::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.getImages' in bridge with {u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >Thread-3434::DEBUG::2014-09-09 11:33:21,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3250246-5b88-46f0-b223-191219263255`::moving from state init -> state preparing >Thread-3434::INFO::2014-09-09 11:33:21,681::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', options=None) >Thread-3434::DEBUG::2014-09-09 11:33:21,681::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`8bb9301b-ffc2-432a-8736-b0eaf6569b82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3304' at 'getImagesList' >Thread-3434::DEBUG::2014-09-09 11:33:21,681::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3434::DEBUG::2014-09-09 11:33:21,681::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3434::DEBUG::2014-09-09 11:33:21,681::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`8bb9301b-ffc2-432a-8736-b0eaf6569b82`::Granted request >Thread-3434::DEBUG::2014-09-09 11:33:21,682::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c3250246-5b88-46f0-b223-191219263255`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3434::DEBUG::2014-09-09 11:33:21,682::task::993::Storage.TaskManager.Task::(_decref) Task=`c3250246-5b88-46f0-b223-191219263255`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:33:21,682::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,682::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:33:21,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,682::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) (7476) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) (7476) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7476) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) (7476) Queuing response >Thread-3434::INFO::2014-09-09 11:33:21,683::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': []} >Thread-19::DEBUG::2014-09-09 11:33:21,683::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Generating json... >Thread-3434::DEBUG::2014-09-09 11:33:21,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3250246-5b88-46f0-b223-191219263255`::finished: {'imageslist': []} >Thread-19::DEBUG::2014-09-09 11:33:21,684::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3434::DEBUG::2014-09-09 11:33:21,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3250246-5b88-46f0-b223-191219263255`::moving from state preparing -> state finished >Thread-3434::DEBUG::2014-09-09 11:33:21,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3434::DEBUG::2014-09-09 11:33:21,685::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3434::DEBUG::2014-09-09 11:33:21,685::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3434::DEBUG::2014-09-09 11:33:21,685::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3434::DEBUG::2014-09-09 11:33:21,685::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3434::DEBUG::2014-09-09 11:33:21,685::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3434::DEBUG::2014-09-09 11:33:21,685::task::993::Storage.TaskManager.Task::(_decref) Task=`c3250246-5b88-46f0-b223-191219263255`::ref 0 aborting False >Thread-3434::DEBUG::2014-09-09 11:33:21,685::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.getImages' in bridge with [] >Thread-3434::DEBUG::2014-09-09 11:33:21,685::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:21,747::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:21,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3435::DEBUG::2014-09-09 11:33:21,747::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >Thread-3435::DEBUG::2014-09-09 11:33:21,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e198c84-09dd-4582-b8ec-493897dca02f`::moving from state init -> state preparing >Thread-3435::INFO::2014-09-09 11:33:21,748::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-3435::DEBUG::2014-09-09 11:33:21,750::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,750::__init__::225::IOProcess::(_processLogs) (7477) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,751::__init__::225::IOProcess::(_processLogs) (7477) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,751::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|(7477) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,751::__init__::225::IOProcess::(_processLogs) (7477) Queuing response >Thread-3435::DEBUG::2014-09-09 11:33:21,751::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f',) >Thread-19::DEBUG::2014-09-09 11:33:21,751::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Generating json... >Thread-3435::DEBUG::2014-09-09 11:33:21,752::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain, 85442237-be11-4bd0-b6c3-43ba60c1b87f: storage.nfsSD.findDomain} >Thread-19::DEBUG::2014-09-09 11:33:21,752::__init__::225::IOProcess::(_processLogs) Sending response sized 146 >Thread-3435::INFO::2014-09-09 11:33:21,752::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3435::DEBUG::2014-09-09 11:33:21,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e198c84-09dd-4582-b8ec-493897dca02f`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-3435::DEBUG::2014-09-09 11:33:21,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e198c84-09dd-4582-b8ec-493897dca02f`::moving from state preparing -> state finished >Thread-3435::DEBUG::2014-09-09 11:33:21,753::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3435::DEBUG::2014-09-09 11:33:21,753::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3435::DEBUG::2014-09-09 11:33:21,753::task::993::Storage.TaskManager.Task::(_decref) Task=`7e198c84-09dd-4582-b8ec-493897dca02f`::ref 0 aborting False >Thread-3435::DEBUG::2014-09-09 11:33:21,753::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-3435::DEBUG::2014-09-09 11:33:21,753::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:21,756::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3436::DEBUG::2014-09-09 11:33:21,757::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.activate' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >JsonRpcServer::DEBUG::2014-09-09 11:33:21,757::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3436::DEBUG::2014-09-09 11:33:21,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::moving from state init -> state preparing >Thread-3436::INFO::2014-09-09 11:33:21,758::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3436::DEBUG::2014-09-09 11:33:21,758::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0bae7c70-b5e6-4f2f-913c-022012c6d4e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1249' at 'activateStorageDomain' >Thread-3436::DEBUG::2014-09-09 11:33:21,758::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-3436::DEBUG::2014-09-09 11:33:21,759::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-3436::DEBUG::2014-09-09 11:33:21,759::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0bae7c70-b5e6-4f2f-913c-022012c6d4e4`::Granted request >Thread-3436::DEBUG::2014-09-09 11:33:21,759::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (exclusive) >Thread-3436::DEBUG::2014-09-09 11:33:21,759::task::993::Storage.TaskManager.Task::(_decref) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::ref 1 aborting False >Thread-3436::DEBUG::2014-09-09 11:33:21,759::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`30aca6b1-b50a-4b72-b837-944dbe745d95`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1250' at 'activateStorageDomain' >Thread-3436::DEBUG::2014-09-09 11:33:21,759::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'exclusive' >Thread-3436::DEBUG::2014-09-09 11:33:21,759::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'exclusive' (1 active user) >Thread-3436::DEBUG::2014-09-09 11:33:21,759::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`30aca6b1-b50a-4b72-b837-944dbe745d95`::Granted request >Thread-3436::DEBUG::2014-09-09 11:33:21,760::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (exclusive) >Thread-3436::DEBUG::2014-09-09 11:33:21,760::task::993::Storage.TaskManager.Task::(_decref) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::ref 1 aborting False >Thread-3436::INFO::2014-09-09 11:33:21,760::sp::1031::Storage.StoragePool::(activateSD) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f spUUID=5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-3436::DEBUG::2014-09-09 11:33:21,760::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-3436::DEBUG::2014-09-09 11:33:21,760::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3436::DEBUG::2014-09-09 11:33:21,760::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-3436::DEBUG::2014-09-09 11:33:21,760::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3436::DEBUG::2014-09-09 11:33:21,760::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-3436::DEBUG::2014-09-09 11:33:21,760::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-3436::DEBUG::2014-09-09 11:33:21,770::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3436::DEBUG::2014-09-09 11:33:21,772::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-3436::DEBUG::2014-09-09 11:33:21,811::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-3436::DEBUG::2014-09-09 11:33:21,812::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3436::DEBUG::2014-09-09 11:33:21,812::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3436::DEBUG::2014-09-09 11:33:21,812::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3436::DEBUG::2014-09-09 11:33:21,812::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3436::DEBUG::2014-09-09 11:33:21,812::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3436::DEBUG::2014-09-09 11:33:21,812::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3436::DEBUG::2014-09-09 11:33:21,812::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-09-09 11:33:21,814::__init__::225::IOProcess::(_processLogs) Sending response sized 458DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,814::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) (7478) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,815::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,816::__init__::225::IOProcess::(_processLogs) (7478) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,817::__init__::225::IOProcess::(_processLogs) (7478) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,818::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:21,820::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,820::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:21,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3436::DEBUG::2014-09-09 11:33:21,822::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:33:21,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) (7479) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) (7479) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7479) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) (7479) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:33:21,823::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) (7480) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,824::__init__::225::IOProcess::(_processLogs) (7480) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) (7480) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) (7480) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,826::__init__::225::IOProcess::(_processLogs) (7481) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:21,826::__init__::225::IOProcess::(_processLogs) (7481) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:21,859::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7481) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,859::__init__::225::IOProcess::(_processLogs) (7481) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,859::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:21,860::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:21,860::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:21,860::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) (7482) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:21,861::__init__::225::IOProcess::(_processLogs) (7482) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:21,864::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7482) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,864::__init__::225::IOProcess::(_processLogs) (7482) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,864::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:21,864::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a566b40ee76cb276b6f19473370fb1cdb96502fb'] >Thread-19::DEBUG::2014-09-09 11:33:21,864::__init__::225::IOProcess::(_processLogs) Sending response sized 506 >Thread-19::DEBUG::2014-09-09 11:33:21,865::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,865::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:33:21,865::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) (7483) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) (7483) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7483) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) (7483) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,866::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) (7484) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,867::__init__::225::IOProcess::(_processLogs) (7484) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,868::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7484) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,868::__init__::225::IOProcess::(_processLogs) (7484) Queuing response >Thread-3436::DEBUG::2014-09-09 11:33:21,868::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:21,868::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Generating json... >Thread-3436::INFO::2014-09-09 11:33:21,868::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:33:21,869::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3436::INFO::2014-09-09 11:33:21,869::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-3436::INFO::2014-09-09 11:33:21,869::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3436::DEBUG::2014-09-09 11:33:21,869::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3436::DEBUG::2014-09-09 11:33:21,870::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-3436::DEBUG::2014-09-09 11:33:21,870::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-3436::DEBUG::2014-09-09 11:33:21,870::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-3436::DEBUG::2014-09-09 11:33:21,870::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-3436::DEBUG::2014-09-09 11:33:21,870::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:33:21,870::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,870::__init__::225::IOProcess::(_processLogs) Message size is 676 >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) (7485) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:33:21,871::__init__::225::IOProcess::(_processLogs) (7485) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:33:21,909::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7485) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,909::__init__::225::IOProcess::(_processLogs) (7485) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,910::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Generating json... >Thread-3436::WARNING::2014-09-09 11:33:21,910::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:33:21,910::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) Message size is 292 >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) (7486) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:33:21,911::__init__::225::IOProcess::(_processLogs) (7486) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:33:21,912::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7486) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,912::__init__::225::IOProcess::(_processLogs) (7486) Queuing response >Thread-3436::DEBUG::2014-09-09 11:33:21,912::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-19::DEBUG::2014-09-09 11:33:21,912::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,913::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:21,914::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) (7487) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,915::__init__::225::IOProcess::(_processLogs) (7487) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,916::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,916::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:21,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,916::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,918::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,919::__init__::225::IOProcess::(_processLogs) (7488) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,920::__init__::225::IOProcess::(_processLogs) (7488) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,921::__init__::225::IOProcess::(_processLogs) (7487) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,922::__init__::225::IOProcess::(_processLogs) (7487) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:21,922::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:33:21,923::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:21,923::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,923::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:21,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) (7489) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) (7489) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7489) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) (7489) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,924::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) (7488) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) (7488) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:33:21,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,926::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,926::__init__::225::IOProcess::(_processLogs) (7490) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:21,926::__init__::225::IOProcess::(_processLogs) (7490) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:21,943::__init__::225::IOProcess::(_processLogs) (7478) Got request for method 'glob'DEBUG|(7490) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,943::__init__::225::IOProcess::(_processLogs) (7490) Queuing response >Thread-3436::DEBUG::2014-09-09 11:33:21,943::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:21,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,944::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:21,944::__init__::225::IOProcess::(_processLogs) (7490) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,944::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:33:21,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,945::__init__::225::IOProcess::(_processLogs) (7490) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,945::__init__::225::IOProcess::(_processLogs) (7491) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:21,945::__init__::225::IOProcess::(_processLogs) (7491) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:21,948::__init__::225::IOProcess::(_processLogs) (7490) Queuing responseDEBUG|(7491) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,948::__init__::225::IOProcess::(_processLogs) (7491) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,948::__init__::225::IOProcess::(_processLogs) (7490) Queuing responseDEBUG|Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:21,948::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:33:21,948::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-19::DEBUG::2014-09-09 11:33:21,949::__init__::225::IOProcess::(_processLogs) (7490) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,949::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:33:21,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) (7492) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) (7492) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|(7492) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) (7492) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,950::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) (7493) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:21,951::__init__::225::IOProcess::(_processLogs) (7493) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:21,952::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|(7493) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,952::__init__::225::IOProcess::(_processLogs) (7493) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,952::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:21,952::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:21,952::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3436::INFO::2014-09-09 11:33:21,952::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3436::INFO::2014-09-09 11:33:21,953::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-3436::DEBUG::2014-09-09 11:33:21,953::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-3436::DEBUG::2014-09-09 11:33:21,953::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-3436::DEBUG::2014-09-09 11:33:21,953::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', u'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Message size is 931 >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) (7494) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:33:21,954::__init__::225::IOProcess::(_processLogs) (7494) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:33:21,993::__init__::225::IOProcess::(_processLogs) DEBUG|(7494) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,993::__init__::225::IOProcess::(_processLogs) (7494) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,994::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3436::WARNING::2014-09-09 11:33:21,994::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:33:21,994::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) Message size is 290 >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) (7495) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:33:21,995::__init__::225::IOProcess::(_processLogs) (7495) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:33:21,997::__init__::225::IOProcess::(_processLogs) DEBUG|(7495) Building response >Thread-19::DEBUG::2014-09-09 11:33:21,997::__init__::225::IOProcess::(_processLogs) (7495) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:21,997::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:21,997::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-19::DEBUG::2014-09-09 11:33:21,998::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3436::DEBUG::2014-09-09 11:33:21,998::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-3436::DEBUG::2014-09-09 11:33:21,998::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3436::INFO::2014-09-09 11:33:21,998::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3436::DEBUG::2014-09-09 11:33:21,999::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `5745e11d-81b4-4d82-8fed-c8a22ec23383` started monitoring domain `85442237-be11-4bd0-b6c3-43ba60c1b87f` >Thread-3443::DEBUG::2014-09-09 11:33:21,999::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3436::DEBUG::2014-09-09 11:33:21,999::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3436::INFO::2014-09-09 11:33:22,000::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-19::DEBUG::2014-09-09 11:33:22,000::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-3436::DEBUG::2014-09-09 11:33:22,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::finished: None >Thread-19::DEBUG::2014-09-09 11:33:22,001::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-3436::DEBUG::2014-09-09 11:33:22,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-09-09 11:33:22,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3436::DEBUG::2014-09-09 11:33:22,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>, u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-09-09 11:33:22,002::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3436::DEBUG::2014-09-09 11:33:22,002::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 11:33:22,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3436::DEBUG::2014-09-09 11:33:22,003::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-19::DEBUG::2014-09-09 11:33:22,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-3436::DEBUG::2014-09-09 11:33:22,004::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-19::DEBUG::2014-09-09 11:33:22,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-3436::DEBUG::2014-09-09 11:33:22,004::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-09-09 11:33:22,004::__init__::225::IOProcess::(_processLogs) (7496) Finding callback 'statvfs'... >Thread-3436::DEBUG::2014-09-09 11:33:22,005::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-19::DEBUG::2014-09-09 11:33:22,005::__init__::225::IOProcess::(_processLogs) (7496) Got request for method 'statvfs' >Thread-3436::DEBUG::2014-09-09 11:33:22,006::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-19::DEBUG::2014-09-09 11:33:22,006::__init__::225::IOProcess::(_processLogs) DEBUG|(7496) Building response >Thread-3443::DEBUG::2014-09-09 11:33:22,007::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3436::DEBUG::2014-09-09 11:33:22,007::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-19::DEBUG::2014-09-09 11:33:22,007::__init__::225::IOProcess::(_processLogs) (7496) Queuing response >Thread-3436::DEBUG::2014-09-09 11:33:22,012::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-09-09 11:33:22,013::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3436::DEBUG::2014-09-09 11:33:22,013::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-19::DEBUG::2014-09-09 11:33:22,013::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3436::DEBUG::2014-09-09 11:33:22,014::task::993::Storage.TaskManager.Task::(_decref) Task=`6071362e-2fe5-424c-b35c-5d6d8ee32f31`::ref 0 aborting False >Thread-3443::DEBUG::2014-09-09 11:33:22,014::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000943993 s, 376 kB/s\n'; <rc> = 0 >Thread-3436::DEBUG::2014-09-09 11:33:22,015::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.activate' in bridge with True >Thread-19::DEBUG::2014-09-09 11:33:22,016::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-3436::DEBUG::2014-09-09 11:33:22,016::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:22,016::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:22,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,018::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-3443::DEBUG::2014-09-09 11:33:22,019::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain 85442237-be11-4bd0-b6c3-43ba60c1b87f changed its status to Valid >Thread-19::DEBUG::2014-09-09 11:33:22,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-3444::DEBUG::2014-09-09 11:33:22,020::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-19::DEBUG::2014-09-09 11:33:22,020::__init__::225::IOProcess::(_processLogs) (7497) Finding callback 'statvfs'... >Thread-3444::DEBUG::2014-09-09 11:33:22,020::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-19::DEBUG::2014-09-09 11:33:22,021::__init__::225::IOProcess::(_processLogs) (7497) Got request for method 'statvfs' >Thread-3444::DEBUG::2014-09-09 11:33:22,021::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-3445::INFO::2014-09-09 11:33:22,022::clientIF::136::vds::(contEIOVms) vmContainerLock acquired >Thread-19::DEBUG::2014-09-09 11:33:22,022::__init__::225::IOProcess::(_processLogs) (7497) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,023::__init__::225::IOProcess::(_processLogs) (7497) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,023::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,023::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:22,051::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:22,052::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3446::DEBUG::2014-09-09 11:33:22,052::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connect' in bridge with {u'masterVersion': 1, u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'scsiKey': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'masterSdUUID': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', u'hostID': 2} >Thread-3446::DEBUG::2014-09-09 11:33:22,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a6ef19b-6f21-4de4-ae9f-1f9576e2be25`::moving from state init -> state preparing >Thread-3446::INFO::2014-09-09 11:33:22,053::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', hostID=2, msdUUID=u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', masterVersion=1, domainsMap=None, options=None) >Thread-3446::DEBUG::2014-09-09 11:33:22,053::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`1d32498c-0807-4917-abef-4141f5f8bf1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-3446::DEBUG::2014-09-09 11:33:22,053::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-3446::DEBUG::2014-09-09 11:33:22,053::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-3446::DEBUG::2014-09-09 11:33:22,053::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`1d32498c-0807-4917-abef-4141f5f8bf1b`::Granted request >Thread-3446::DEBUG::2014-09-09 11:33:22,053::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fb61d6a6-339c-49b7-aa4b-30f1a1426dff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-3446::DEBUG::2014-09-09 11:33:22,054::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3446::DEBUG::2014-09-09 11:33:22,054::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3446::DEBUG::2014-09-09 11:33:22,054::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fb61d6a6-339c-49b7-aa4b-30f1a1426dff`::Granted request >Thread-3446::DEBUG::2014-09-09 11:33:22,054::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,054::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,054::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,054::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,054::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,055::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,055::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-3446::DEBUG::2014-09-09 11:33:22,055::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3446::DEBUG::2014-09-09 11:33:22,055::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-3446::DEBUG::2014-09-09 11:33:22,055::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3446::DEBUG::2014-09-09 11:33:22,055::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-3446::DEBUG::2014-09-09 11:33:22,055::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-3446::DEBUG::2014-09-09 11:33:22,063::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3446::DEBUG::2014-09-09 11:33:22,065::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-3446::DEBUG::2014-09-09 11:33:22,079::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-3446::DEBUG::2014-09-09 11:33:22,079::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,079::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,079::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,079::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,080::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,080::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,080::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,082::__init__::225::IOProcess::(_processLogs) (7498) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,083::__init__::225::IOProcess::(_processLogs) (7498) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,083::__init__::225::IOProcess::(_processLogs) DEBUG|(7498) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,083::__init__::225::IOProcess::(_processLogs) (7498) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,083::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) (7499) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) (7499) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:22,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) (7500) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) (7500) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,085::__init__::225::IOProcess::(_processLogs) DEBUG|(7500) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) (7500) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) (7499) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) (7499) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,086::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-3446::DEBUG::2014-09-09 11:33:22,087::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) (7501) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:22,088::__init__::225::IOProcess::(_processLogs) (7501) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:22,119::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7501) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,119::__init__::225::IOProcess::(_processLogs) (7501) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,119::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3446::DEBUG::2014-09-09 11:33:22,119::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:22,119::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,121::__init__::225::IOProcess::(_processLogs) (7502) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:22,121::__init__::225::IOProcess::(_processLogs) (7502) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:22,124::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7502) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,124::__init__::225::IOProcess::(_processLogs) (7502) Queuing response >Thread-3446::DEBUG::2014-09-09 11:33:22,124::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:33:22,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) (7503) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:22,126::__init__::225::IOProcess::(_processLogs) (7503) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:22,127::__init__::225::IOProcess::(_processLogs) DEBUG|(7503) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,127::__init__::225::IOProcess::(_processLogs) (7503) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,129::__init__::225::IOProcess::(_processLogs) (7504) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,129::__init__::225::IOProcess::(_processLogs) (7504) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,129::__init__::225::IOProcess::(_processLogs) DEBUG|(7504) Building response >Thread-3446::DEBUG::2014-09-09 11:33:22,129::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:22,129::__init__::225::IOProcess::(_processLogs) (7504) Queuing response >Thread-3446::INFO::2014-09-09 11:33:22,129::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:33:22,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3446::INFO::2014-09-09 11:33:22,130::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:33:22,130::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3446::DEBUG::2014-09-09 11:33:22,131::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf verified, version 1 >Thread-3446::DEBUG::2014-09-09 11:33:22,131::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-3446::DEBUG::2014-09-09 11:33:22,131::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-3446::DEBUG::2014-09-09 11:33:22,131::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-3446::DEBUG::2014-09-09 11:33:22,131::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-3446::WARNING::2014-09-09 11:33:22,131::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 already exists >Thread-3446::DEBUG::2014-09-09 11:33:22,132::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-3446::DEBUG::2014-09-09 11:33:22,132::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e453999e-ec9f-420b-941c-a9f9cc4432bb 85442237-be11-4bd0-b6c3-43ba60c1b87f (cwd None) >Thread-3446::DEBUG::2014-09-09 11:33:22,149::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found\n Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb\n Volume group "85442237-be11-4bd0-b6c3-43ba60c1b87f" not found\n Skipping volume group 85442237-be11-4bd0-b6c3-43ba60c1b87f\n'; <rc> = 5 >Thread-3446::WARNING::2014-09-09 11:33:22,150::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!', ' Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found', ' Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb', ' Volume group "85442237-be11-4bd0-b6c3-43ba60c1b87f" not found', ' Skipping volume group 85442237-be11-4bd0-b6c3-43ba60c1b87f'] >Thread-3446::DEBUG::2014-09-09 11:33:22,150::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-09-09 11:33:22,151::__init__::225::IOProcess::(_processLogs) (7504) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) (7505) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,153::__init__::225::IOProcess::(_processLogs) (7505) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,154::__init__::225::IOProcess::(_processLogs) (7504) Queuing responseDEBUG|(7505) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,154::__init__::225::IOProcess::(_processLogs) (7505) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,154::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:22,154::__init__::225::IOProcess::(_processLogs) (7504) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,154::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) (7506) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) (7506) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) (7507) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) (7507) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) (7507) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:22,156::__init__::225::IOProcess::(_processLogs) (7506) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,157::__init__::225::IOProcess::(_processLogs) (7506) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,157::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-3446::INFO::2014-09-09 11:33:22,157::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-3446::DEBUG::2014-09-09 11:33:22,157::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-3446::INFO::2014-09-09 11:33:22,157::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3446::DEBUG::2014-09-09 11:33:22,157::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-3446::INFO::2014-09-09 11:33:22,158::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-3446::DEBUG::2014-09-09 11:33:22,158::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-3446::INFO::2014-09-09 11:33:22,158::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-3446::DEBUG::2014-09-09 11:33:22,158::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-3446::DEBUG::2014-09-09 11:33:22,158::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3446::DEBUG::2014-09-09 11:33:22,158::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3446::DEBUG::2014-09-09 11:33:22,158::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3446::DEBUG::2014-09-09 11:33:22,158::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3446::DEBUG::2014-09-09 11:33:22,158::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-3446::DEBUG::2014-09-09 11:33:22,159::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-3446::DEBUG::2014-09-09 11:33:22,159::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-3446::DEBUG::2014-09-09 11:33:22,159::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-3446::INFO::2014-09-09 11:33:22,159::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-3446::DEBUG::2014-09-09 11:33:22,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a6ef19b-6f21-4de4-ae9f-1f9576e2be25`::finished: True >Thread-3446::DEBUG::2014-09-09 11:33:22,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a6ef19b-6f21-4de4-ae9f-1f9576e2be25`::moving from state preparing -> state finished >Thread-3446::DEBUG::2014-09-09 11:33:22,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3446::DEBUG::2014-09-09 11:33:22,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3446::DEBUG::2014-09-09 11:33:22,159::task::993::Storage.TaskManager.Task::(_decref) Task=`5a6ef19b-6f21-4de4-ae9f-1f9576e2be25`::ref 0 aborting False >Thread-3446::DEBUG::2014-09-09 11:33:22,159::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connect' in bridge with True >Thread-3446::DEBUG::2014-09-09 11:33:22,159::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:22,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:22,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900437 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) (7508) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:22,431::__init__::225::IOProcess::(_processLogs) (7508) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:22,432::__init__::225::IOProcess::(_processLogs) (7508) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,432::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:33:22,432::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:33:22,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000996972 s, 550 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) (7509) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:22,440::__init__::225::IOProcess::(_processLogs) (7509) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:22,441::__init__::225::IOProcess::(_processLogs) (7509) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,441::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:33:22,441::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) (7510) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) (7510) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) (7510) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) (7510) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:22,442::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) (7511) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) (7511) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) (7511) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,443::__init__::225::IOProcess::(_processLogs) (7511) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,444::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:22,444::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:33:22,444::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:22,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) (7512) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) (7512) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) (7512) Building response >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) (7512) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:22,445::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:22,937::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:22,937::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3453::DEBUG::2014-09-09 11:33:22,938::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:24,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:24,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897755 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:25,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:25,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3454::DEBUG::2014-09-09 11:33:25,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`a16484d3-4c77-4133-9e7b-3f08bdf365f6`::moving from state init -> state preparing >Thread-3454::INFO::2014-09-09 11:33:25,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3454::INFO::2014-09-09 11:33:25,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109551', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000996972', 'lastCheck': '3.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000943993', 'lastCheck': '3.9', 'valid': True}} >Thread-3454::DEBUG::2014-09-09 11:33:25,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`a16484d3-4c77-4133-9e7b-3f08bdf365f6`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109551', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000996972', 'lastCheck': '3.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000943993', 'lastCheck': '3.9', 'valid': True}} >Thread-3454::DEBUG::2014-09-09 11:33:25,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`a16484d3-4c77-4133-9e7b-3f08bdf365f6`::moving from state preparing -> state finished >Thread-3454::DEBUG::2014-09-09 11:33:25,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3454::DEBUG::2014-09-09 11:33:25,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3454::DEBUG::2014-09-09 11:33:25,948::task::993::Storage.TaskManager.Task::(_decref) Task=`a16484d3-4c77-4133-9e7b-3f08bdf365f6`::ref 0 aborting False >Thread-3454::DEBUG::2014-09-09 11:33:25,948::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:25,959::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:25,959::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3455::DEBUG::2014-09-09 11:33:25,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:26,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:26,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897841 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:27,503::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) (7513) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:27,504::__init__::225::IOProcess::(_processLogs) (7513) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:27,505::__init__::225::IOProcess::(_processLogs) (7513) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:27,505::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:27,505::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:27,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) (7514) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) (7514) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,506::__init__::225::IOProcess::(_processLogs) (7515) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:27,507::__init__::225::IOProcess::(_processLogs) (7515) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:27,507::__init__::225::IOProcess::(_processLogs) (7515) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,507::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:27,508::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:27,508::__init__::225::IOProcess::(_processLogs) (7514) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,509::__init__::225::IOProcess::(_processLogs) (7514) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:27,511::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-23::DEBUG::2014-09-09 11:33:27,512::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:33:27,512::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) (7516) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:27,513::__init__::225::IOProcess::(_processLogs) (7516) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:33:27,530::__init__::225::IOProcess::(_processLogs) DEBUG|(7516) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,530::__init__::225::IOProcess::(_processLogs) (7516) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,530::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:27,530::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:27,530::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,531::__init__::225::IOProcess::(_processLogs) (7517) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:27,532::__init__::225::IOProcess::(_processLogs) (7517) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:27,534::__init__::225::IOProcess::(_processLogs) DEBUG|(7517) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,534::__init__::225::IOProcess::(_processLogs) (7517) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,534::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:27,534::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:33:27,534::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 11:33:27,535::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) (7518) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) (7518) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:27,536::__init__::225::IOProcess::(_processLogs) (7518) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) (7518) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,537::__init__::225::IOProcess::(_processLogs) (7519) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:27,538::__init__::225::IOProcess::(_processLogs) (7519) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:27,538::__init__::225::IOProcess::(_processLogs) DEBUG|(7519) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,538::__init__::225::IOProcess::(_processLogs) (7519) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,538::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:27,538::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:27,538::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:33:27,539::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 11:33:27,539::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:33:27,539::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:27,539::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:27,539::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) (7520) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) (7520) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) DEBUG|(7520) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) (7520) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,540::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:33:27,541::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:27,541::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:33:27,547::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104348 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) (7521) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:27,549::__init__::225::IOProcess::(_processLogs) (7521) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:27,550::__init__::225::IOProcess::(_processLogs) DEBUG|(7521) Building response >Thread-19::DEBUG::2014-09-09 11:33:27,550::__init__::225::IOProcess::(_processLogs) (7521) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:27,550::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:27,551::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:33:28,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:28,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089825 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:29,021::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:29,021::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3459::DEBUG::2014-09-09 11:33:29,022::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:30,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:30,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897733 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:31,684::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:31,685::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3460::DEBUG::2014-09-09 11:33:31,685::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3460::DEBUG::2014-09-09 11:33:31,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e34dc98-e745-4a57-8c1d-6c5aa2132c02`::moving from state init -> state preparing >Thread-3460::INFO::2014-09-09 11:33:31,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3460::INFO::2014-09-09 11:33:31,686::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3460::DEBUG::2014-09-09 11:33:31,686::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e34dc98-e745-4a57-8c1d-6c5aa2132c02`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3460::DEBUG::2014-09-09 11:33:31,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e34dc98-e745-4a57-8c1d-6c5aa2132c02`::moving from state preparing -> state finished >Thread-3460::DEBUG::2014-09-09 11:33:31,687::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3460::DEBUG::2014-09-09 11:33:31,687::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3460::DEBUG::2014-09-09 11:33:31,687::task::993::Storage.TaskManager.Task::(_decref) Task=`7e34dc98-e745-4a57-8c1d-6c5aa2132c02`::ref 0 aborting False >Thread-3460::DEBUG::2014-09-09 11:33:31,687::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3460::DEBUG::2014-09-09 11:33:31,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:31,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:31,715::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3461::DEBUG::2014-09-09 11:33:31,715::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3461::DEBUG::2014-09-09 11:33:31,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`36d88663-bcbf-4683-9156-f0773e5a5054`::moving from state init -> state preparing >Thread-3461::INFO::2014-09-09 11:33:31,716::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3461::DEBUG::2014-09-09 11:33:31,716::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`257170d8-1bb4-4348-9f41-f33497a271f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3461::DEBUG::2014-09-09 11:33:31,716::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3461::DEBUG::2014-09-09 11:33:31,716::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3461::DEBUG::2014-09-09 11:33:31,716::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`257170d8-1bb4-4348-9f41-f33497a271f3`::Granted request >Thread-3461::DEBUG::2014-09-09 11:33:31,717::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`36d88663-bcbf-4683-9156-f0773e5a5054`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3461::DEBUG::2014-09-09 11:33:31,717::task::993::Storage.TaskManager.Task::(_decref) Task=`36d88663-bcbf-4683-9156-f0773e5a5054`::ref 1 aborting False >Thread-3461::INFO::2014-09-09 11:33:31,718::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3461::DEBUG::2014-09-09 11:33:31,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`36d88663-bcbf-4683-9156-f0773e5a5054`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3461::DEBUG::2014-09-09 11:33:31,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`36d88663-bcbf-4683-9156-f0773e5a5054`::moving from state preparing -> state finished >Thread-3461::DEBUG::2014-09-09 11:33:31,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3461::DEBUG::2014-09-09 11:33:31,719::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3461::DEBUG::2014-09-09 11:33:31,719::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3461::DEBUG::2014-09-09 11:33:31,719::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3461::DEBUG::2014-09-09 11:33:31,719::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3461::DEBUG::2014-09-09 11:33:31,719::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3461::DEBUG::2014-09-09 11:33:31,719::task::993::Storage.TaskManager.Task::(_decref) Task=`36d88663-bcbf-4683-9156-f0773e5a5054`::ref 0 aborting False >Thread-3461::DEBUG::2014-09-09 11:33:31,719::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3461::DEBUG::2014-09-09 11:33:31,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) (7522) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:32,022::__init__::225::IOProcess::(_processLogs) (7522) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) (7523) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) (7523) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) (7524) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) (7524) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) (7524) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,025::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:33:32,025::__init__::225::IOProcess::(_processLogs) (7522) Building response >Thread-19::DEBUG::2014-09-09 11:33:32,025::__init__::225::IOProcess::(_processLogs) (7522) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,025::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:33:32,025::__init__::225::IOProcess::(_processLogs) (7523) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,027::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-3443::DEBUG::2014-09-09 11:33:32,029::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:33:32,029::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:33:32,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,030::__init__::225::IOProcess::(_processLogs) (7525) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:33:32,030::__init__::225::IOProcess::(_processLogs) (7525) Got request for method 'touch' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:32,030::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:32,031::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3465::DEBUG::2014-09-09 11:33:32,031::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:32,073::__init__::225::IOProcess::(_processLogs) (7525) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,073::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3443::DEBUG::2014-09-09 11:33:32,073::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) (7526) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:33:32,074::__init__::225::IOProcess::(_processLogs) (7526) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:33:32,078::__init__::225::IOProcess::(_processLogs) (7526) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,078::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-3443::DEBUG::2014-09-09 11:33:32,078::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) (7527) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) (7527) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:32,079::__init__::225::IOProcess::(_processLogs) (7527) Building response >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) (7527) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) (7528) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:33:32,080::__init__::225::IOProcess::(_processLogs) (7528) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:33:32,081::__init__::225::IOProcess::(_processLogs) (7528) Queuing response >Thread-3443::DEBUG::2014-09-09 11:33:32,081::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:33:32,081::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::INFO::2014-09-09 11:33:32,081::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 11:33:32,082::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:33:32,082::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:32,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,082::__init__::225::IOProcess::(_processLogs) (7529) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:32,083::__init__::225::IOProcess::(_processLogs) (7529) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:32,083::__init__::225::IOProcess::(_processLogs) (7529) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,083::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:33:32,084::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:33:32,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000936617 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:32,090::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:32,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) (7530) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) (7530) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) (7530) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,091::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) (7531) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:32,445::__init__::225::IOProcess::(_processLogs) (7531) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:32,446::__init__::225::IOProcess::(_processLogs) (7531) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,446::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:33:32,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:33:32,454::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100298 s, 546 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) (7532) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:32,455::__init__::225::IOProcess::(_processLogs) (7532) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:32,456::__init__::225::IOProcess::(_processLogs) (7532) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,456::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) (7533) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:32,457::__init__::225::IOProcess::(_processLogs) (7533) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) (7533) Building response >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) (7533) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) (7534) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:32,458::__init__::225::IOProcess::(_processLogs) (7534) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:32,459::__init__::225::IOProcess::(_processLogs) (7534) Building response >Thread-19::DEBUG::2014-09-09 11:33:32,459::__init__::225::IOProcess::(_processLogs) (7534) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,459::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:32,459::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:33:32,459::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) (7535) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) (7535) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) (7535) Building response >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) (7535) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:32,460::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:33:32,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:32,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895481 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:33:34,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:35,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897843 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:35,042::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:35,042::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3466::DEBUG::2014-09-09 11:33:35,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:37,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:37,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896284 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:37,551::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:37,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:37,552::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:37,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:37,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:37,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:37,552::__init__::225::IOProcess::(_processLogs) (7536) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:37,552::__init__::225::IOProcess::(_processLogs) (7536) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:37,553::__init__::225::IOProcess::(_processLogs) DEBUG|(7536) Building response >Thread-19::DEBUG::2014-09-09 11:33:37,553::__init__::225::IOProcess::(_processLogs) (7536) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:37,553::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:37,554::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:33:37,554::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:33:37,562::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114426 s, 981 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:37,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:37,562::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:37,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:37,562::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) (7537) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) (7537) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) DEBUG|(7537) Building response >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) (7537) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:37,563::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:37,564::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:38,050::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:38,051::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3467::DEBUG::2014-09-09 11:33:38,053::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:39,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:39,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895987 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:41,075::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:41,076::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3468::DEBUG::2014-09-09 11:33:41,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0a3f550-94d5-4060-bd55-dbad9e3e8131`::moving from state init -> state preparing >Thread-3468::INFO::2014-09-09 11:33:41,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3468::INFO::2014-09-09 11:33:41,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114426', 'lastCheck': '3.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100298', 'lastCheck': '8.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000936617', 'lastCheck': '9.0', 'valid': True}} >Thread-3468::DEBUG::2014-09-09 11:33:41,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0a3f550-94d5-4060-bd55-dbad9e3e8131`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114426', 'lastCheck': '3.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100298', 'lastCheck': '8.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000936617', 'lastCheck': '9.0', 'valid': True}} >Thread-3468::DEBUG::2014-09-09 11:33:41,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0a3f550-94d5-4060-bd55-dbad9e3e8131`::moving from state preparing -> state finished >Thread-3468::DEBUG::2014-09-09 11:33:41,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3468::DEBUG::2014-09-09 11:33:41,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3468::DEBUG::2014-09-09 11:33:41,078::task::993::Storage.TaskManager.Task::(_decref) Task=`f0a3f550-94d5-4060-bd55-dbad9e3e8131`::ref 0 aborting False >Thread-3468::DEBUG::2014-09-09 11:33:41,078::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:41,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:41,088::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3469::DEBUG::2014-09-09 11:33:41,089::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:41,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:41,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897495 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:41,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3470::DEBUG::2014-09-09 11:33:41,759::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:33:41,759::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3470::DEBUG::2014-09-09 11:33:41,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`80d4f542-37a5-4209-a9d8-b803a035d33e`::moving from state init -> state preparing >Thread-3470::INFO::2014-09-09 11:33:41,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3470::INFO::2014-09-09 11:33:41,761::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3470::DEBUG::2014-09-09 11:33:41,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`80d4f542-37a5-4209-a9d8-b803a035d33e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3470::DEBUG::2014-09-09 11:33:41,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`80d4f542-37a5-4209-a9d8-b803a035d33e`::moving from state preparing -> state finished >Thread-3470::DEBUG::2014-09-09 11:33:41,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3470::DEBUG::2014-09-09 11:33:41,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3470::DEBUG::2014-09-09 11:33:41,761::task::993::Storage.TaskManager.Task::(_decref) Task=`80d4f542-37a5-4209-a9d8-b803a035d33e`::ref 0 aborting False >Thread-3470::DEBUG::2014-09-09 11:33:41,761::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3470::DEBUG::2014-09-09 11:33:41,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:41,790::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:41,791::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3471::DEBUG::2014-09-09 11:33:41,791::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3471::DEBUG::2014-09-09 11:33:41,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`e44175dd-0aea-45f9-b9e0-abc4df2d920b`::moving from state init -> state preparing >Thread-3471::INFO::2014-09-09 11:33:41,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3471::DEBUG::2014-09-09 11:33:41,792::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6bfee514-7385-4003-9270-547fe5edbd6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3471::DEBUG::2014-09-09 11:33:41,792::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3471::DEBUG::2014-09-09 11:33:41,792::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3471::DEBUG::2014-09-09 11:33:41,792::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6bfee514-7385-4003-9270-547fe5edbd6b`::Granted request >Thread-3471::DEBUG::2014-09-09 11:33:41,792::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e44175dd-0aea-45f9-b9e0-abc4df2d920b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3471::DEBUG::2014-09-09 11:33:41,792::task::993::Storage.TaskManager.Task::(_decref) Task=`e44175dd-0aea-45f9-b9e0-abc4df2d920b`::ref 1 aborting False >Thread-3471::INFO::2014-09-09 11:33:41,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3471::DEBUG::2014-09-09 11:33:41,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`e44175dd-0aea-45f9-b9e0-abc4df2d920b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3471::DEBUG::2014-09-09 11:33:41,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`e44175dd-0aea-45f9-b9e0-abc4df2d920b`::moving from state preparing -> state finished >Thread-3471::DEBUG::2014-09-09 11:33:41,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3471::DEBUG::2014-09-09 11:33:41,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3471::DEBUG::2014-09-09 11:33:41,795::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3471::DEBUG::2014-09-09 11:33:41,795::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3471::DEBUG::2014-09-09 11:33:41,795::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3471::DEBUG::2014-09-09 11:33:41,795::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3471::DEBUG::2014-09-09 11:33:41,795::task::993::Storage.TaskManager.Task::(_decref) Task=`e44175dd-0aea-45f9-b9e0-abc4df2d920b`::ref 0 aborting False >Thread-3471::DEBUG::2014-09-09 11:33:41,795::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3471::DEBUG::2014-09-09 11:33:41,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:42,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,092::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) (7538) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) (7538) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:42,093::__init__::225::IOProcess::(_processLogs) DEBUG|(7538) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,094::__init__::225::IOProcess::(_processLogs) (7538) Queuing response >Thread-3443::DEBUG::2014-09-09 11:33:42,094::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:42,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,099::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:33:42,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000950306 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:42,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,101::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:42,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,101::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,102::__init__::225::IOProcess::(_processLogs) (7539) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:42,102::__init__::225::IOProcess::(_processLogs) (7539) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:42,102::__init__::225::IOProcess::(_processLogs) DEBUG|(7539) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,102::__init__::225::IOProcess::(_processLogs) (7539) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:42,102::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,103::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:42,460::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,460::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:42,460::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,461::__init__::225::IOProcess::(_processLogs) (7540) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:42,461::__init__::225::IOProcess::(_processLogs) (7540) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:42,462::__init__::225::IOProcess::(_processLogs) DEBUG|(7540) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,462::__init__::225::IOProcess::(_processLogs) (7540) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:42,462::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,462::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:33:42,463::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:33:42,469::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000901465 s, 608 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:42,470::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,470::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:42,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,470::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,471::__init__::225::IOProcess::(_processLogs) (7541) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:42,471::__init__::225::IOProcess::(_processLogs) (7541) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:42,471::__init__::225::IOProcess::(_processLogs) DEBUG|(7541) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,471::__init__::225::IOProcess::(_processLogs) (7541) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:42,471::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,472::__init__::225::IOProcess::(_processLogs) (7542) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:42,473::__init__::225::IOProcess::(_processLogs) (7542) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:42,473::__init__::225::IOProcess::(_processLogs) DEBUG|(7542) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,473::__init__::225::IOProcess::(_processLogs) (7542) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:42,473::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,473::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:42,473::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) (7543) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) (7543) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) DEBUG|(7543) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) (7543) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:42,474::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,475::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:42,475::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:42,475::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:33:42,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:42,475::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) (7544) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) (7544) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) (7544) Building response >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) (7544) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:42,476::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:33:43,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:43,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090007 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:44,140::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:44,140::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3472::DEBUG::2014-09-09 11:33:44,141::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:45,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:45,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897371 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:47,149::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:47,150::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3473::DEBUG::2014-09-09 11:33:47,151::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:47,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:47,564::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) (7545) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:47,565::__init__::225::IOProcess::(_processLogs) (7545) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:47,648::__init__::225::IOProcess::(_processLogs) (7545) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:47,649::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:33:47,650::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:47,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0969791 s, 10.6 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:33:47,657::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105724 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:47,659::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:47,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:47,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:47,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:47,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:47,662::__init__::225::IOProcess::(_processLogs) (7546) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:47,663::__init__::225::IOProcess::(_processLogs) (7546) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:47,663::__init__::225::IOProcess::(_processLogs) (7546) Building response >Thread-19::DEBUG::2014-09-09 11:33:47,664::__init__::225::IOProcess::(_processLogs) (7546) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:47,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:47,664::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:33:49,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:49,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0947135 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:50,159::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:50,161::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3474::DEBUG::2014-09-09 11:33:50,163::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:51,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:51,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3475::DEBUG::2014-09-09 11:33:51,835::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3475::DEBUG::2014-09-09 11:33:51,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`49d21f93-f97c-4bf9-8064-4980ffe5a0f1`::moving from state init -> state preparing >Thread-3475::INFO::2014-09-09 11:33:51,836::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3475::INFO::2014-09-09 11:33:51,836::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3475::DEBUG::2014-09-09 11:33:51,836::task::1191::Storage.TaskManager.Task::(prepare) Task=`49d21f93-f97c-4bf9-8064-4980ffe5a0f1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3475::DEBUG::2014-09-09 11:33:51,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`49d21f93-f97c-4bf9-8064-4980ffe5a0f1`::moving from state preparing -> state finished >Thread-3475::DEBUG::2014-09-09 11:33:51,836::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3475::DEBUG::2014-09-09 11:33:51,836::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3475::DEBUG::2014-09-09 11:33:51,836::task::993::Storage.TaskManager.Task::(_decref) Task=`49d21f93-f97c-4bf9-8064-4980ffe5a0f1`::ref 0 aborting False >Thread-3475::DEBUG::2014-09-09 11:33:51,836::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3475::DEBUG::2014-09-09 11:33:51,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:51,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:51,850::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3476::DEBUG::2014-09-09 11:33:51,851::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:33:51,851::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3476::DEBUG::2014-09-09 11:33:51,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f66983-ad14-4f27-8f9a-362c0d74f3e2`::moving from state init -> state preparing >Thread-3476::INFO::2014-09-09 11:33:51,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3476::DEBUG::2014-09-09 11:33:51,853::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ab6ee4ea-f1c5-4a94-ae9e-34bea6c0dd73`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3476::DEBUG::2014-09-09 11:33:51,854::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3476::DEBUG::2014-09-09 11:33:51,854::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3476::DEBUG::2014-09-09 11:33:51,854::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ab6ee4ea-f1c5-4a94-ae9e-34bea6c0dd73`::Granted request >Thread-3476::DEBUG::2014-09-09 11:33:51,854::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`58f66983-ad14-4f27-8f9a-362c0d74f3e2`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3476::DEBUG::2014-09-09 11:33:51,854::task::993::Storage.TaskManager.Task::(_decref) Task=`58f66983-ad14-4f27-8f9a-362c0d74f3e2`::ref 1 aborting False >Thread-3476::INFO::2014-09-09 11:33:51,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3476::DEBUG::2014-09-09 11:33:51,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`58f66983-ad14-4f27-8f9a-362c0d74f3e2`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3476::DEBUG::2014-09-09 11:33:51,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f66983-ad14-4f27-8f9a-362c0d74f3e2`::moving from state preparing -> state finished >Thread-3476::DEBUG::2014-09-09 11:33:51,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3476::DEBUG::2014-09-09 11:33:51,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3476::DEBUG::2014-09-09 11:33:51,856::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3476::DEBUG::2014-09-09 11:33:51,856::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3476::DEBUG::2014-09-09 11:33:51,857::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3476::DEBUG::2014-09-09 11:33:51,857::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3476::DEBUG::2014-09-09 11:33:51,857::task::993::Storage.TaskManager.Task::(_decref) Task=`58f66983-ad14-4f27-8f9a-362c0d74f3e2`::ref 0 aborting False >Thread-3476::DEBUG::2014-09-09 11:33:51,857::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3476::DEBUG::2014-09-09 11:33:51,857::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:51,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894798 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:52,103::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:52,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:52,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:52,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:52,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,104::__init__::225::IOProcess::(_processLogs) (7547) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:52,104::__init__::225::IOProcess::(_processLogs) (7547) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:52,104::__init__::225::IOProcess::(_processLogs) (7547) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:33:52,105::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:33:52,112::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000926294 s, 383 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:52,112::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:33:52,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:52,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:52,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:52,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,113::__init__::225::IOProcess::(_processLogs) (7548) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:52,113::__init__::225::IOProcess::(_processLogs) (7548) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:52,113::__init__::225::IOProcess::(_processLogs) (7548) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,113::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:52,476::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:52,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:52,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:52,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:52,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,476::__init__::225::IOProcess::(_processLogs) (7549) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:52,477::__init__::225::IOProcess::(_processLogs) (7549) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:52,477::__init__::225::IOProcess::(_processLogs) (7549) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:33:52,477::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:33:52,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000966745 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:52,485::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:33:52,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:52,485::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:52,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:52,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,486::__init__::225::IOProcess::(_processLogs) (7550) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:52,486::__init__::225::IOProcess::(_processLogs) (7550) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:52,486::__init__::225::IOProcess::(_processLogs) (7550) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,486::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:33:52,487::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:33:52,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:52,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) (7551) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) (7551) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) (7551) Building response >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) (7551) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:33:52,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) (7552) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) (7552) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) (7552) Building response >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) (7552) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) (7553) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:33:52,490::__init__::225::IOProcess::(_processLogs) (7553) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:33:52,491::__init__::225::IOProcess::(_processLogs) (7553) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:52,491::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:52,491::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:53,173::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:53,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3477::DEBUG::2014-09-09 11:33:53,175::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:33:53,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:54,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897263 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:33:56,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:56,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897618 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:56,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:56,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3478::DEBUG::2014-09-09 11:33:56,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4f3ec41-dc0e-4f41-b143-81b8f52b8601`::moving from state init -> state preparing >Thread-3478::INFO::2014-09-09 11:33:56,187::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3478::INFO::2014-09-09 11:33:56,187::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105724', 'lastCheck': '8.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966745', 'lastCheck': '3.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926294', 'lastCheck': '4.1', 'valid': True}} >Thread-3478::DEBUG::2014-09-09 11:33:56,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4f3ec41-dc0e-4f41-b143-81b8f52b8601`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105724', 'lastCheck': '8.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966745', 'lastCheck': '3.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926294', 'lastCheck': '4.1', 'valid': True}} >Thread-3478::DEBUG::2014-09-09 11:33:56,188::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4f3ec41-dc0e-4f41-b143-81b8f52b8601`::moving from state preparing -> state finished >Thread-3478::DEBUG::2014-09-09 11:33:56,188::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3478::DEBUG::2014-09-09 11:33:56,188::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3478::DEBUG::2014-09-09 11:33:56,188::task::993::Storage.TaskManager.Task::(_decref) Task=`b4f3ec41-dc0e-4f41-b143-81b8f52b8601`::ref 0 aborting False >Thread-3478::DEBUG::2014-09-09 11:33:56,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:56,200::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:56,201::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3479::DEBUG::2014-09-09 11:33:56,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:57,663::__init__::225::IOProcess::(_processLogs) (7554) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:57,664::__init__::225::IOProcess::(_processLogs) (7554) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:57,664::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|(7554) Building response >Thread-23::DEBUG::2014-09-09 11:33:57,664::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:33:57,664::__init__::225::IOProcess::(_processLogs) (7554) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:57,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:33:57,669::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:33:57,672::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105012 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:33:57,672::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:33:57,672::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:33:57,672::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:33:57,672::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) (7555) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) (7555) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|(7555) Building response >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) (7555) Queuing response >Thread-19::DEBUG::2014-09-09 11:33:57,673::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:33:57,674::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:33:58,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:33:58,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897474 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:33:59,284::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:33:59,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3480::DEBUG::2014-09-09 11:33:59,286::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:00,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:00,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896744 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:01,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:01,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3481::DEBUG::2014-09-09 11:34:01,894::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3481::DEBUG::2014-09-09 11:34:01,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a935c70-8daf-439b-8f69-da30a83d3443`::moving from state init -> state preparing >Thread-3481::INFO::2014-09-09 11:34:01,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3481::INFO::2014-09-09 11:34:01,895::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3481::DEBUG::2014-09-09 11:34:01,896::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a935c70-8daf-439b-8f69-da30a83d3443`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3481::DEBUG::2014-09-09 11:34:01,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a935c70-8daf-439b-8f69-da30a83d3443`::moving from state preparing -> state finished >Thread-3481::DEBUG::2014-09-09 11:34:01,896::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3481::DEBUG::2014-09-09 11:34:01,896::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3481::DEBUG::2014-09-09 11:34:01,896::task::993::Storage.TaskManager.Task::(_decref) Task=`3a935c70-8daf-439b-8f69-da30a83d3443`::ref 0 aborting False >Thread-3481::DEBUG::2014-09-09 11:34:01,896::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3481::DEBUG::2014-09-09 11:34:01,896::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:01,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:01,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3482::DEBUG::2014-09-09 11:34:01,926::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3482::DEBUG::2014-09-09 11:34:01,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3288fa9-cd4b-451d-979e-093ce6a0530d`::moving from state init -> state preparing >Thread-3482::INFO::2014-09-09 11:34:01,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3482::DEBUG::2014-09-09 11:34:01,927::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a9a37230-51cb-4848-adea-9b8d93a2f5d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3482::DEBUG::2014-09-09 11:34:01,927::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3482::DEBUG::2014-09-09 11:34:01,927::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3482::DEBUG::2014-09-09 11:34:01,927::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a9a37230-51cb-4848-adea-9b8d93a2f5d4`::Granted request >Thread-3482::DEBUG::2014-09-09 11:34:01,927::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b3288fa9-cd4b-451d-979e-093ce6a0530d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3482::DEBUG::2014-09-09 11:34:01,927::task::993::Storage.TaskManager.Task::(_decref) Task=`b3288fa9-cd4b-451d-979e-093ce6a0530d`::ref 1 aborting False >Thread-3482::INFO::2014-09-09 11:34:01,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3482::DEBUG::2014-09-09 11:34:01,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3288fa9-cd4b-451d-979e-093ce6a0530d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3482::DEBUG::2014-09-09 11:34:01,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3288fa9-cd4b-451d-979e-093ce6a0530d`::moving from state preparing -> state finished >Thread-3482::DEBUG::2014-09-09 11:34:01,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3482::DEBUG::2014-09-09 11:34:01,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3482::DEBUG::2014-09-09 11:34:01,929::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3482::DEBUG::2014-09-09 11:34:01,930::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3482::DEBUG::2014-09-09 11:34:01,930::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3482::DEBUG::2014-09-09 11:34:01,930::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3482::DEBUG::2014-09-09 11:34:01,930::task::993::Storage.TaskManager.Task::(_decref) Task=`b3288fa9-cd4b-451d-979e-093ce6a0530d`::ref 0 aborting False >Thread-3482::DEBUG::2014-09-09 11:34:01,930::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3482::DEBUG::2014-09-09 11:34:01,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:02,114::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) (7556) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) (7556) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|(7556) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) (7556) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,115::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:02,116::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:34:02,116::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:34:02,123::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00091074 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) (7553) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,125::__init__::225::IOProcess::(_processLogs) (7557) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:02,125::__init__::225::IOProcess::(_processLogs) (7557) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:02,125::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7557) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,125::__init__::225::IOProcess::(_processLogs) (7557) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:02,125::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:02,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:02,294::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3483::DEBUG::2014-09-09 11:34:02,295::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:02,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:02,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897347 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:02,491::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) (7558) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) (7558) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7558) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,492::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7558) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:34:02,493::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:02,494::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:34:02,500::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000907176 s, 604 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,501::__init__::225::IOProcess::(_processLogs) (7559) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:02,502::__init__::225::IOProcess::(_processLogs) (7559) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:02,502::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7559) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,502::__init__::225::IOProcess::(_processLogs) (7559) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,502::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:02,503::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:02,503::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,503::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:34:02,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,503::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,504::__init__::225::IOProcess::(_processLogs) (7560) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) (7560) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) (7560) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) (7560) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,505::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) (7561) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) (7561) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) (7561) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) (7561) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:02,506::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:02,507::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:34:02,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:02,507::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:02,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:02,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:02,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:02,508::__init__::225::IOProcess::(_processLogs) (7562) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:02,508::__init__::225::IOProcess::(_processLogs) (7562) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:02,508::__init__::225::IOProcess::(_processLogs) (7562) Building response >Thread-19::DEBUG::2014-09-09 11:34:02,508::__init__::225::IOProcess::(_processLogs) (7562) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:02,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:02,508::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:34:04,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:04,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896612 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:05,303::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:05,304::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3484::DEBUG::2014-09-09 11:34:05,305::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:06,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:06,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897434 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:07,674::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:07,675::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:07,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:07,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:07,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:07,675::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:07,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-23::DEBUG::2014-09-09 11:34:07,676::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:07,677::__init__::225::IOProcess::(_processLogs) (7563) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:07,681::__init__::225::IOProcess::(_processLogs) (7563) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:07,681::__init__::225::IOProcess::(_processLogs) (7563) Building response >Thread-19::DEBUG::2014-09-09 11:34:07,681::__init__::225::IOProcess::(_processLogs) (7563) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:07,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:07,681::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:34:07,684::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113865 s, 986 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:07,684::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:07,684::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:07,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:07,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:07,684::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) (7564) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) (7564) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7564) Building response >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) (7564) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:07,685::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:07,686::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:08,315::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:08,316::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3485::DEBUG::2014-09-09 11:34:08,316::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:08,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:08,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904071 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:34:10,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:10,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898579 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:11,325::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:11,326::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3486::DEBUG::2014-09-09 11:34:11,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`06d6536d-8798-4409-9d8a-7fddcd95364d`::moving from state init -> state preparing >Thread-3486::INFO::2014-09-09 11:34:11,327::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3486::INFO::2014-09-09 11:34:11,327::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113865', 'lastCheck': '3.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000907176', 'lastCheck': '8.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00091074', 'lastCheck': '9.2', 'valid': True}} >Thread-3486::DEBUG::2014-09-09 11:34:11,327::task::1191::Storage.TaskManager.Task::(prepare) Task=`06d6536d-8798-4409-9d8a-7fddcd95364d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113865', 'lastCheck': '3.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000907176', 'lastCheck': '8.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00091074', 'lastCheck': '9.2', 'valid': True}} >Thread-3486::DEBUG::2014-09-09 11:34:11,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`06d6536d-8798-4409-9d8a-7fddcd95364d`::moving from state preparing -> state finished >Thread-3486::DEBUG::2014-09-09 11:34:11,328::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3486::DEBUG::2014-09-09 11:34:11,328::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3486::DEBUG::2014-09-09 11:34:11,328::task::993::Storage.TaskManager.Task::(_decref) Task=`06d6536d-8798-4409-9d8a-7fddcd95364d`::ref 0 aborting False >Thread-3486::DEBUG::2014-09-09 11:34:11,329::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:11,338::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:11,338::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3487::DEBUG::2014-09-09 11:34:11,339::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:11,968::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3488::DEBUG::2014-09-09 11:34:11,969::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:34:11,969::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3488::DEBUG::2014-09-09 11:34:11,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`62e90f93-5471-4a3c-8aae-1c053e395d92`::moving from state init -> state preparing >Thread-3488::INFO::2014-09-09 11:34:11,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3488::INFO::2014-09-09 11:34:11,970::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3488::DEBUG::2014-09-09 11:34:11,970::task::1191::Storage.TaskManager.Task::(prepare) Task=`62e90f93-5471-4a3c-8aae-1c053e395d92`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3488::DEBUG::2014-09-09 11:34:11,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`62e90f93-5471-4a3c-8aae-1c053e395d92`::moving from state preparing -> state finished >Thread-3488::DEBUG::2014-09-09 11:34:11,970::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3488::DEBUG::2014-09-09 11:34:11,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3488::DEBUG::2014-09-09 11:34:11,970::task::993::Storage.TaskManager.Task::(_decref) Task=`62e90f93-5471-4a3c-8aae-1c053e395d92`::ref 0 aborting False >Thread-3488::DEBUG::2014-09-09 11:34:11,970::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3488::DEBUG::2014-09-09 11:34:11,971::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:12,001::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:12,001::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3489::DEBUG::2014-09-09 11:34:12,001::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3489::DEBUG::2014-09-09 11:34:12,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`2208b0a5-8660-4788-86e4-af9d76654c09`::moving from state init -> state preparing >Thread-3489::INFO::2014-09-09 11:34:12,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3489::DEBUG::2014-09-09 11:34:12,002::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`5d5a1871-6f89-432e-8ea9-b1b378b78915`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3489::DEBUG::2014-09-09 11:34:12,003::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3489::DEBUG::2014-09-09 11:34:12,003::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3489::DEBUG::2014-09-09 11:34:12,003::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`5d5a1871-6f89-432e-8ea9-b1b378b78915`::Granted request >Thread-3489::DEBUG::2014-09-09 11:34:12,003::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2208b0a5-8660-4788-86e4-af9d76654c09`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3489::DEBUG::2014-09-09 11:34:12,003::task::993::Storage.TaskManager.Task::(_decref) Task=`2208b0a5-8660-4788-86e4-af9d76654c09`::ref 1 aborting False >Thread-3489::INFO::2014-09-09 11:34:12,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3489::DEBUG::2014-09-09 11:34:12,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`2208b0a5-8660-4788-86e4-af9d76654c09`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3489::DEBUG::2014-09-09 11:34:12,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`2208b0a5-8660-4788-86e4-af9d76654c09`::moving from state preparing -> state finished >Thread-3489::DEBUG::2014-09-09 11:34:12,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3489::DEBUG::2014-09-09 11:34:12,005::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3489::DEBUG::2014-09-09 11:34:12,005::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3489::DEBUG::2014-09-09 11:34:12,005::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3489::DEBUG::2014-09-09 11:34:12,005::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3489::DEBUG::2014-09-09 11:34:12,005::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3489::DEBUG::2014-09-09 11:34:12,006::task::993::Storage.TaskManager.Task::(_decref) Task=`2208b0a5-8660-4788-86e4-af9d76654c09`::ref 0 aborting False >Thread-3489::DEBUG::2014-09-09 11:34:12,006::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3489::DEBUG::2014-09-09 11:34:12,006::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:12,126::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) (7565) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) (7565) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7565) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) (7565) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,128::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:34:12,128::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:34:12,134::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000900894 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,135::__init__::225::IOProcess::(_processLogs) (7566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:12,136::__init__::225::IOProcess::(_processLogs) (7566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:12,136::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7566) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,137::__init__::225::IOProcess::(_processLogs) (7566) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,137::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) (7567) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:12,508::__init__::225::IOProcess::(_processLogs) (7567) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:12,509::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7567) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,509::__init__::225::IOProcess::(_processLogs) (7567) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,509::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,510::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:34:12,510::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:34:12,518::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000980628 s, 559 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:12,518::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,518::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:12,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,519::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,519::__init__::225::IOProcess::(_processLogs) (7568) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:12,519::__init__::225::IOProcess::(_processLogs) (7568) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:12,519::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7568) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) (7568) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,520::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) (7569) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) (7569) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) (7569) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) (7569) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:12,521::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) (7570) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:12,522::__init__::225::IOProcess::(_processLogs) (7570) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) (7570) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) (7570) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:12,523::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) (7571) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) (7571) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) (7571) Building response >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) (7571) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:12,524::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:34:12,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:12,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089565 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:14,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:14,408::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3490::DEBUG::2014-09-09 11:34:14,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:14,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:15,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089588 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:34:17,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:17,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898007 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:17,418::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:17,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3491::DEBUG::2014-09-09 11:34:17,420::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:17,686::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:17,686::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:17,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) (7572) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) (7572) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7572) Building response >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) (7572) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:17,687::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:17,688::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:34:17,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:34:17,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114964 s, 977 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:17,695::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:17,695::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:17,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:17,695::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) (7573) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) (7573) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) DEBUG|(7573) Building response >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) (7573) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:17,696::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:17,697::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:34:19,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:19,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897975 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:20,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:20,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3492::DEBUG::2014-09-09 11:34:20,429::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:21,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:21,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896649 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:22,046::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:22,046::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3493::DEBUG::2014-09-09 11:34:22,046::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3493::DEBUG::2014-09-09 11:34:22,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1bc4c76-836e-464d-936b-06344476d5a0`::moving from state init -> state preparing >Thread-3493::INFO::2014-09-09 11:34:22,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3493::INFO::2014-09-09 11:34:22,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3493::DEBUG::2014-09-09 11:34:22,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1bc4c76-836e-464d-936b-06344476d5a0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3493::DEBUG::2014-09-09 11:34:22,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1bc4c76-836e-464d-936b-06344476d5a0`::moving from state preparing -> state finished >Thread-3493::DEBUG::2014-09-09 11:34:22,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3493::DEBUG::2014-09-09 11:34:22,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3493::DEBUG::2014-09-09 11:34:22,048::task::993::Storage.TaskManager.Task::(_decref) Task=`a1bc4c76-836e-464d-936b-06344476d5a0`::ref 0 aborting False >Thread-3493::DEBUG::2014-09-09 11:34:22,048::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3493::DEBUG::2014-09-09 11:34:22,048::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:22,076::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:22,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3494::DEBUG::2014-09-09 11:34:22,077::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3494::DEBUG::2014-09-09 11:34:22,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf4f648d-1282-4174-81f9-433e2e257d92`::moving from state init -> state preparing >Thread-3494::INFO::2014-09-09 11:34:22,078::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3494::DEBUG::2014-09-09 11:34:22,078::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`752e779a-6827-4c70-b038-a96943cff19d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3494::DEBUG::2014-09-09 11:34:22,078::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3494::DEBUG::2014-09-09 11:34:22,078::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3494::DEBUG::2014-09-09 11:34:22,079::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`752e779a-6827-4c70-b038-a96943cff19d`::Granted request >Thread-3494::DEBUG::2014-09-09 11:34:22,079::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cf4f648d-1282-4174-81f9-433e2e257d92`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3494::DEBUG::2014-09-09 11:34:22,079::task::993::Storage.TaskManager.Task::(_decref) Task=`cf4f648d-1282-4174-81f9-433e2e257d92`::ref 1 aborting False >Thread-3494::INFO::2014-09-09 11:34:22,080::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3494::DEBUG::2014-09-09 11:34:22,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf4f648d-1282-4174-81f9-433e2e257d92`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3494::DEBUG::2014-09-09 11:34:22,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf4f648d-1282-4174-81f9-433e2e257d92`::moving from state preparing -> state finished >Thread-3494::DEBUG::2014-09-09 11:34:22,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3494::DEBUG::2014-09-09 11:34:22,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3494::DEBUG::2014-09-09 11:34:22,081::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3494::DEBUG::2014-09-09 11:34:22,081::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3494::DEBUG::2014-09-09 11:34:22,081::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3494::DEBUG::2014-09-09 11:34:22,081::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3494::DEBUG::2014-09-09 11:34:22,081::task::993::Storage.TaskManager.Task::(_decref) Task=`cf4f648d-1282-4174-81f9-433e2e257d92`::ref 0 aborting False >Thread-3494::DEBUG::2014-09-09 11:34:22,082::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3494::DEBUG::2014-09-09 11:34:22,082::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,138::__init__::225::IOProcess::(_processLogs) (7574) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:22,138::__init__::225::IOProcess::(_processLogs) (7574) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:22,138::__init__::225::IOProcess::(_processLogs) DEBUG|(7574) Building response >Thread-3443::DEBUG::2014-09-09 11:34:22,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:22,139::__init__::225::IOProcess::(_processLogs) (7574) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,143::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:34:22,146::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000898297 s, 395 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:22,146::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,146::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:22,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,146::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,147::__init__::225::IOProcess::(_processLogs) (7575) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:22,147::__init__::225::IOProcess::(_processLogs) (7575) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:22,147::__init__::225::IOProcess::(_processLogs) DEBUG|(7575) Building response >Thread-19::DEBUG::2014-09-09 11:34:22,148::__init__::225::IOProcess::(_processLogs) (7575) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,148::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,525::__init__::225::IOProcess::(_processLogs) (7576) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:22,525::__init__::225::IOProcess::(_processLogs) (7576) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:22,525::__init__::225::IOProcess::(_processLogs) DEBUG|(7576) Building response >Thread-19::DEBUG::2014-09-09 11:34:22,525::__init__::225::IOProcess::(_processLogs) (7576) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,525::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,526::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:34:22,526::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:34:22,533::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100328 s, 546 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,535::__init__::225::IOProcess::(_processLogs) (7577) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:22,535::__init__::225::IOProcess::(_processLogs) (7577) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:22,535::__init__::225::IOProcess::(_processLogs) DEBUG|(7577) Building response >Thread-19::DEBUG::2014-09-09 11:34:22,535::__init__::225::IOProcess::(_processLogs) (7577) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) (7578) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) (7578) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) (7578) Building response >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) (7578) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:34:22,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) (7579) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) (7579) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) (7579) Building response >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) (7579) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,538::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:22,539::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:22,539::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:34:22,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:22,539::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:22,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:22,539::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) (7580) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) (7580) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) (7580) Building response >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) (7580) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:22,540::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:34:23,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:23,447::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:23,448::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3495::DEBUG::2014-09-09 11:34:23,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:23,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08971 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:34:25,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:25,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089741 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:26,456::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:26,457::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3496::DEBUG::2014-09-09 11:34:26,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcc4fa6e-3731-49dc-aed2-6d3fce61314d`::moving from state init -> state preparing >Thread-3496::INFO::2014-09-09 11:34:26,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3496::INFO::2014-09-09 11:34:26,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114964', 'lastCheck': '8.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100328', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000898297', 'lastCheck': '4.3', 'valid': True}} >Thread-3496::DEBUG::2014-09-09 11:34:26,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcc4fa6e-3731-49dc-aed2-6d3fce61314d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114964', 'lastCheck': '8.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100328', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000898297', 'lastCheck': '4.3', 'valid': True}} >Thread-3496::DEBUG::2014-09-09 11:34:26,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcc4fa6e-3731-49dc-aed2-6d3fce61314d`::moving from state preparing -> state finished >Thread-3496::DEBUG::2014-09-09 11:34:26,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3496::DEBUG::2014-09-09 11:34:26,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3496::DEBUG::2014-09-09 11:34:26,459::task::993::Storage.TaskManager.Task::(_decref) Task=`bcc4fa6e-3731-49dc-aed2-6d3fce61314d`::ref 0 aborting False >Thread-3496::DEBUG::2014-09-09 11:34:26,459::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:26,471::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:26,471::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3497::DEBUG::2014-09-09 11:34:26,472::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:27,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:27,697::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) (7581) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:27,698::__init__::225::IOProcess::(_processLogs) (7581) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:27,706::__init__::225::IOProcess::(_processLogs) DEBUG|(7581) Building response >Thread-19::DEBUG::2014-09-09 11:34:27,706::__init__::225::IOProcess::(_processLogs) (7581) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:27,707::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:34:27,708::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:27,708::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:34:27,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097391 s, 10.5 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:34:27,716::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110282 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:27,717::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:27,717::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:27,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:27,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:27,719::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:27,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:27,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:27,721::__init__::225::IOProcess::(_processLogs) (7582) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:27,721::__init__::225::IOProcess::(_processLogs) (7582) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:27,722::__init__::225::IOProcess::(_processLogs) (7582) Building response >Thread-19::DEBUG::2014-09-09 11:34:27,722::__init__::225::IOProcess::(_processLogs) (7582) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:27,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:27,723::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:29,552::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:29,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3498::DEBUG::2014-09-09 11:34:29,553::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:29,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:29,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896863 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:34:31,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:31,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898052 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:32,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3499::DEBUG::2014-09-09 11:34:32,120::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:34:32,120::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3499::DEBUG::2014-09-09 11:34:32,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`16fb9ed8-d7f7-4086-b84e-c1a0c562cd0c`::moving from state init -> state preparing >Thread-3499::INFO::2014-09-09 11:34:32,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3499::INFO::2014-09-09 11:34:32,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3499::DEBUG::2014-09-09 11:34:32,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`16fb9ed8-d7f7-4086-b84e-c1a0c562cd0c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3499::DEBUG::2014-09-09 11:34:32,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`16fb9ed8-d7f7-4086-b84e-c1a0c562cd0c`::moving from state preparing -> state finished >Thread-3499::DEBUG::2014-09-09 11:34:32,122::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3499::DEBUG::2014-09-09 11:34:32,122::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3499::DEBUG::2014-09-09 11:34:32,122::task::993::Storage.TaskManager.Task::(_decref) Task=`16fb9ed8-d7f7-4086-b84e-c1a0c562cd0c`::ref 0 aborting False >Thread-3499::DEBUG::2014-09-09 11:34:32,123::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3499::DEBUG::2014-09-09 11:34:32,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:32,136::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:32,136::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3500::DEBUG::2014-09-09 11:34:32,136::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3500::DEBUG::2014-09-09 11:34:32,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`98c70c03-1276-44bc-9ffc-097d3e483ec5`::moving from state init -> state preparing >Thread-3500::INFO::2014-09-09 11:34:32,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3500::DEBUG::2014-09-09 11:34:32,137::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2e5db7e6-c17c-4a4d-802e-b9315eec9a4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3500::DEBUG::2014-09-09 11:34:32,138::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3500::DEBUG::2014-09-09 11:34:32,138::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3500::DEBUG::2014-09-09 11:34:32,138::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2e5db7e6-c17c-4a4d-802e-b9315eec9a4a`::Granted request >Thread-3500::DEBUG::2014-09-09 11:34:32,138::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`98c70c03-1276-44bc-9ffc-097d3e483ec5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3500::DEBUG::2014-09-09 11:34:32,138::task::993::Storage.TaskManager.Task::(_decref) Task=`98c70c03-1276-44bc-9ffc-097d3e483ec5`::ref 1 aborting False >Thread-3500::INFO::2014-09-09 11:34:32,140::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3500::DEBUG::2014-09-09 11:34:32,140::task::1191::Storage.TaskManager.Task::(prepare) Task=`98c70c03-1276-44bc-9ffc-097d3e483ec5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3500::DEBUG::2014-09-09 11:34:32,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`98c70c03-1276-44bc-9ffc-097d3e483ec5`::moving from state preparing -> state finished >Thread-3500::DEBUG::2014-09-09 11:34:32,140::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3500::DEBUG::2014-09-09 11:34:32,140::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3500::DEBUG::2014-09-09 11:34:32,140::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3500::DEBUG::2014-09-09 11:34:32,140::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3500::DEBUG::2014-09-09 11:34:32,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3500::DEBUG::2014-09-09 11:34:32,140::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3500::DEBUG::2014-09-09 11:34:32,141::task::993::Storage.TaskManager.Task::(_decref) Task=`98c70c03-1276-44bc-9ffc-097d3e483ec5`::ref 0 aborting False >Thread-3500::DEBUG::2014-09-09 11:34:32,141::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3500::DEBUG::2014-09-09 11:34:32,141::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:32,148::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:32,148::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:32,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:32,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:32,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:32,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,149::__init__::225::IOProcess::(_processLogs) (7583) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:32,149::__init__::225::IOProcess::(_processLogs) (7583) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:32,150::__init__::225::IOProcess::(_processLogs) (7583) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,150::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:34:32,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:34:32,157::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000882442 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) (7584) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) (7584) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:32,158::__init__::225::IOProcess::(_processLogs) (7584) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,159::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) (7585) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) (7585) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:32,540::__init__::225::IOProcess::(_processLogs) (7585) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,541::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:34:32,541::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:34:32,548::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000986885 s, 555 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:32,548::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:32,548::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) (7586) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) (7586) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) (7586) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,549::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:32,550::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:34:32,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:32,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) (7587) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) (7587) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) (7587) Building response >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) (7587) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:34:32,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) (7588) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) (7588) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) (7588) Building response >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) (7588) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:32,552::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:32,553::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:34:32,553::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:32,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:32,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:32,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:32,553::__init__::225::IOProcess::(_processLogs) (7589) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:32,554::__init__::225::IOProcess::(_processLogs) (7589) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:32,554::__init__::225::IOProcess::(_processLogs) (7589) Building response >Thread-19::DEBUG::2014-09-09 11:34:32,554::__init__::225::IOProcess::(_processLogs) (7589) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:32,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:32,554::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:32,561::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:32,561::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3501::DEBUG::2014-09-09 11:34:32,562::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:33,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:34,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898622 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:35,570::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:35,571::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3502::DEBUG::2014-09-09 11:34:35,572::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:36,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:36,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897465 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:37,721::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:37,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:37,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:37,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:37,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:37,721::__init__::225::IOProcess::(_processLogs) (7590) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:37,722::__init__::225::IOProcess::(_processLogs) (7590) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:37,722::__init__::225::IOProcess::(_processLogs) (7590) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:37,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:37,723::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:34:37,723::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:34:37,730::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104863 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) (7591) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:37,731::__init__::225::IOProcess::(_processLogs) (7591) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:37,732::__init__::225::IOProcess::(_processLogs) (7591) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:37,732::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:34:38,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:38,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897087 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:38,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:38,581::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3503::DEBUG::2014-09-09 11:34:38,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:40,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:40,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896817 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:41,660::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:41,660::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3504::DEBUG::2014-09-09 11:34:41,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cc7e49b-c68c-4fd7-90a3-1d6c9cdbb2f6`::moving from state init -> state preparing >Thread-3504::INFO::2014-09-09 11:34:41,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3504::INFO::2014-09-09 11:34:41,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104863', 'lastCheck': '3.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986885', 'lastCheck': '9.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882442', 'lastCheck': '9.5', 'valid': True}} >Thread-3504::DEBUG::2014-09-09 11:34:41,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cc7e49b-c68c-4fd7-90a3-1d6c9cdbb2f6`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104863', 'lastCheck': '3.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986885', 'lastCheck': '9.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882442', 'lastCheck': '9.5', 'valid': True}} >Thread-3504::DEBUG::2014-09-09 11:34:41,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cc7e49b-c68c-4fd7-90a3-1d6c9cdbb2f6`::moving from state preparing -> state finished >Thread-3504::DEBUG::2014-09-09 11:34:41,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3504::DEBUG::2014-09-09 11:34:41,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3504::DEBUG::2014-09-09 11:34:41,662::task::993::Storage.TaskManager.Task::(_decref) Task=`2cc7e49b-c68c-4fd7-90a3-1d6c9cdbb2f6`::ref 0 aborting False >Thread-3504::DEBUG::2014-09-09 11:34:41,663::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:41,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:41,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3505::DEBUG::2014-09-09 11:34:41,675::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) (7592) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:42,160::__init__::225::IOProcess::(_processLogs) (7592) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:42,161::__init__::225::IOProcess::(_processLogs) (7592) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,161::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:34:42,161::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:34:42,167::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000891838 s, 398 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) (7593) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:42,168::__init__::225::IOProcess::(_processLogs) (7593) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:42,169::__init__::225::IOProcess::(_processLogs) (7593) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,169::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:42,181::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:42,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3506::DEBUG::2014-09-09 11:34:42,181::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3506::DEBUG::2014-09-09 11:34:42,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac77e546-cd9f-4893-8a34-b3f690ed9c53`::moving from state init -> state preparing >Thread-3506::INFO::2014-09-09 11:34:42,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3506::INFO::2014-09-09 11:34:42,183::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3506::DEBUG::2014-09-09 11:34:42,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac77e546-cd9f-4893-8a34-b3f690ed9c53`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3506::DEBUG::2014-09-09 11:34:42,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac77e546-cd9f-4893-8a34-b3f690ed9c53`::moving from state preparing -> state finished >Thread-3506::DEBUG::2014-09-09 11:34:42,183::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3506::DEBUG::2014-09-09 11:34:42,183::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3506::DEBUG::2014-09-09 11:34:42,183::task::993::Storage.TaskManager.Task::(_decref) Task=`ac77e546-cd9f-4893-8a34-b3f690ed9c53`::ref 0 aborting False >Thread-3506::DEBUG::2014-09-09 11:34:42,183::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3506::DEBUG::2014-09-09 11:34:42,183::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:42,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:42,212::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3507::DEBUG::2014-09-09 11:34:42,212::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3507::DEBUG::2014-09-09 11:34:42,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`82a3bc3d-43ec-40db-b63d-f36804d9e60f`::moving from state init -> state preparing >Thread-3507::INFO::2014-09-09 11:34:42,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3507::DEBUG::2014-09-09 11:34:42,213::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d2d44f3d-de5a-4c04-b813-66f340e11821`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3507::DEBUG::2014-09-09 11:34:42,214::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3507::DEBUG::2014-09-09 11:34:42,214::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3507::DEBUG::2014-09-09 11:34:42,214::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d2d44f3d-de5a-4c04-b813-66f340e11821`::Granted request >Thread-3507::DEBUG::2014-09-09 11:34:42,214::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82a3bc3d-43ec-40db-b63d-f36804d9e60f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3507::DEBUG::2014-09-09 11:34:42,214::task::993::Storage.TaskManager.Task::(_decref) Task=`82a3bc3d-43ec-40db-b63d-f36804d9e60f`::ref 1 aborting False >Thread-3507::INFO::2014-09-09 11:34:42,216::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3507::DEBUG::2014-09-09 11:34:42,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`82a3bc3d-43ec-40db-b63d-f36804d9e60f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3507::DEBUG::2014-09-09 11:34:42,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`82a3bc3d-43ec-40db-b63d-f36804d9e60f`::moving from state preparing -> state finished >Thread-3507::DEBUG::2014-09-09 11:34:42,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3507::DEBUG::2014-09-09 11:34:42,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3507::DEBUG::2014-09-09 11:34:42,216::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3507::DEBUG::2014-09-09 11:34:42,216::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3507::DEBUG::2014-09-09 11:34:42,216::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3507::DEBUG::2014-09-09 11:34:42,216::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3507::DEBUG::2014-09-09 11:34:42,217::task::993::Storage.TaskManager.Task::(_decref) Task=`82a3bc3d-43ec-40db-b63d-f36804d9e60f`::ref 0 aborting False >Thread-3507::DEBUG::2014-09-09 11:34:42,217::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3507::DEBUG::2014-09-09 11:34:42,217::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:42,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:42,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896249 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) (7594) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:42,554::__init__::225::IOProcess::(_processLogs) (7594) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:42,556::__init__::225::IOProcess::(_processLogs) (7594) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:34:42,556::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:34:42,563::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000950683 s, 576 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:42,563::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:42,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) (7595) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) (7595) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) (7595) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:42,564::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) (7596) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:42,565::__init__::225::IOProcess::(_processLogs) (7596) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:42,566::__init__::225::IOProcess::(_processLogs) (7596) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:42,566::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:42,566::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:42,566::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) (7597) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) (7597) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7597) Building response >Thread-19::DEBUG::2014-09-09 11:34:42,567::__init__::225::IOProcess::(_processLogs) (7597) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,568::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:42,568::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:42,568::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:42,568::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:34:42,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:42,568::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) (7598) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) (7598) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) (7598) Building response >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) (7598) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:42,569::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:34:44,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:44,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895794 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:44,739::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:44,739::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3508::DEBUG::2014-09-09 11:34:44,740::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:46,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:46,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897287 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) (7599) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:47,733::__init__::225::IOProcess::(_processLogs) (7599) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:47,734::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7599) Building response >Thread-19::DEBUG::2014-09-09 11:34:47,734::__init__::225::IOProcess::(_processLogs) (7599) Queuing response >Thread-23::DEBUG::2014-09-09 11:34:47,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:47,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:47,740::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:34:47,741::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113125 s, 993 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) (7600) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) (7600) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:47,742::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7600) Building response >Thread-19::DEBUG::2014-09-09 11:34:47,743::__init__::225::IOProcess::(_processLogs) (7600) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:47,743::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:47,743::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:47,749::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:47,750::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3509::DEBUG::2014-09-09 11:34:47,751::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:48,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:48,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897459 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:50,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:50,760::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3510::DEBUG::2014-09-09 11:34:50,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:50,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:50,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896128 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,171::__init__::225::IOProcess::(_processLogs) (7601) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:52,171::__init__::225::IOProcess::(_processLogs) (7601) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:52,171::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7601) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,171::__init__::225::IOProcess::(_processLogs) (7601) Queuing response >Thread-3443::DEBUG::2014-09-09 11:34:52,171::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:52,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,176::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:34:52,178::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000883615 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:52,178::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) (7602) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) (7602) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7602) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,179::__init__::225::IOProcess::(_processLogs) (7602) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:52,180::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,180::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:52,257::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3511::DEBUG::2014-09-09 11:34:52,258::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:34:52,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3511::DEBUG::2014-09-09 11:34:52,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`82ccf927-7c4c-43ae-b5e5-4488f2204911`::moving from state init -> state preparing >Thread-3511::INFO::2014-09-09 11:34:52,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3511::INFO::2014-09-09 11:34:52,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3511::DEBUG::2014-09-09 11:34:52,260::task::1191::Storage.TaskManager.Task::(prepare) Task=`82ccf927-7c4c-43ae-b5e5-4488f2204911`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3511::DEBUG::2014-09-09 11:34:52,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`82ccf927-7c4c-43ae-b5e5-4488f2204911`::moving from state preparing -> state finished >Thread-3511::DEBUG::2014-09-09 11:34:52,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3511::DEBUG::2014-09-09 11:34:52,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3511::DEBUG::2014-09-09 11:34:52,260::task::993::Storage.TaskManager.Task::(_decref) Task=`82ccf927-7c4c-43ae-b5e5-4488f2204911`::ref 0 aborting False >Thread-3511::DEBUG::2014-09-09 11:34:52,260::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3511::DEBUG::2014-09-09 11:34:52,261::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:52,288::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:52,288::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3512::DEBUG::2014-09-09 11:34:52,288::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3512::DEBUG::2014-09-09 11:34:52,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`941fff5c-1606-4ead-a0e6-a55e50378cf8`::moving from state init -> state preparing >Thread-3512::INFO::2014-09-09 11:34:52,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3512::DEBUG::2014-09-09 11:34:52,290::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`756f9923-56e4-4246-9270-1bd3c57fc866`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3512::DEBUG::2014-09-09 11:34:52,290::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3512::DEBUG::2014-09-09 11:34:52,290::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3512::DEBUG::2014-09-09 11:34:52,290::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`756f9923-56e4-4246-9270-1bd3c57fc866`::Granted request >Thread-3512::DEBUG::2014-09-09 11:34:52,290::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`941fff5c-1606-4ead-a0e6-a55e50378cf8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3512::DEBUG::2014-09-09 11:34:52,290::task::993::Storage.TaskManager.Task::(_decref) Task=`941fff5c-1606-4ead-a0e6-a55e50378cf8`::ref 1 aborting False >Thread-3512::INFO::2014-09-09 11:34:52,292::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3512::DEBUG::2014-09-09 11:34:52,292::task::1191::Storage.TaskManager.Task::(prepare) Task=`941fff5c-1606-4ead-a0e6-a55e50378cf8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3512::DEBUG::2014-09-09 11:34:52,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`941fff5c-1606-4ead-a0e6-a55e50378cf8`::moving from state preparing -> state finished >Thread-3512::DEBUG::2014-09-09 11:34:52,292::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3512::DEBUG::2014-09-09 11:34:52,292::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3512::DEBUG::2014-09-09 11:34:52,292::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3512::DEBUG::2014-09-09 11:34:52,292::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3512::DEBUG::2014-09-09 11:34:52,292::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3512::DEBUG::2014-09-09 11:34:52,292::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3512::DEBUG::2014-09-09 11:34:52,293::task::993::Storage.TaskManager.Task::(_decref) Task=`941fff5c-1606-4ead-a0e6-a55e50378cf8`::ref 0 aborting False >Thread-3512::DEBUG::2014-09-09 11:34:52,293::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3512::DEBUG::2014-09-09 11:34:52,293::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:34:52,569::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,569::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:52,569::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,569::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,570::__init__::225::IOProcess::(_processLogs) (7603) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:52,570::__init__::225::IOProcess::(_processLogs) (7603) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:52,570::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7603) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,570::__init__::225::IOProcess::(_processLogs) (7603) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:52,570::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,571::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:34:52,571::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:34:52,578::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000986058 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:52,578::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) (7604) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) (7604) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7604) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,579::__init__::225::IOProcess::(_processLogs) (7604) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:52,580::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,580::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:34:52,580::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,580::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:34:52,580::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) (7605) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) (7605) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) (7605) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) (7605) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:52,581::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,582::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) (7606) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) (7606) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) (7606) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) (7606) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:52,583::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) (7607) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) (7607) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7607) Building response >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) (7607) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:52,584::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:34:52,585::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:34:52,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:52,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089653 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:53,769::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:53,770::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3513::DEBUG::2014-09-09 11:34:53,771::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:54,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:55,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897678 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:56,776::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:56,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3514::DEBUG::2014-09-09 11:34:56,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5588112-3da0-4823-ad59-7af2f3b43c5d`::moving from state init -> state preparing >Thread-3514::INFO::2014-09-09 11:34:56,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3514::INFO::2014-09-09 11:34:56,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113125', 'lastCheck': '9.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986058', 'lastCheck': '4.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000883615', 'lastCheck': '4.6', 'valid': True}} >Thread-3514::DEBUG::2014-09-09 11:34:56,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5588112-3da0-4823-ad59-7af2f3b43c5d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113125', 'lastCheck': '9.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986058', 'lastCheck': '4.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000883615', 'lastCheck': '4.6', 'valid': True}} >Thread-3514::DEBUG::2014-09-09 11:34:56,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5588112-3da0-4823-ad59-7af2f3b43c5d`::moving from state preparing -> state finished >Thread-3514::DEBUG::2014-09-09 11:34:56,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3514::DEBUG::2014-09-09 11:34:56,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3514::DEBUG::2014-09-09 11:34:56,779::task::993::Storage.TaskManager.Task::(_decref) Task=`a5588112-3da0-4823-ad59-7af2f3b43c5d`::ref 0 aborting False >Thread-3514::DEBUG::2014-09-09 11:34:56,780::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:56,790::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:56,791::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3515::DEBUG::2014-09-09 11:34:56,791::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:34:57,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:57,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897998 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:57,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:57,745::__init__::225::IOProcess::(_processLogs) (7608) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:57,745::__init__::225::IOProcess::(_processLogs) (7608) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:57,745::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7608) Building response >Thread-19::DEBUG::2014-09-09 11:34:57,745::__init__::225::IOProcess::(_processLogs) (7608) Queuing response >Thread-23::DEBUG::2014-09-09 11:34:57,746::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:34:57,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:57,751::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:34:57,753::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011185 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) (7609) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:34:57,754::__init__::225::IOProcess::(_processLogs) (7609) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:34:57,755::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7609) Building response >Thread-19::DEBUG::2014-09-09 11:34:57,755::__init__::225::IOProcess::(_processLogs) (7609) Queuing response >Thread-19::DEBUG::2014-09-09 11:34:57,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:34:57,755::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:34:59,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:34:59,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089671 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:34:59,887::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:34:59,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3516::DEBUG::2014-09-09 11:34:59,889::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:01,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:01,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899854 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:02,181::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,181::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:02,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,181::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,182::__init__::225::IOProcess::(_processLogs) (7610) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:02,182::__init__::225::IOProcess::(_processLogs) (7610) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:02,182::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7610) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,182::__init__::225::IOProcess::(_processLogs) (7610) Queuing response >Thread-3443::DEBUG::2014-09-09 11:35:02,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:35:02,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,188::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:35:02,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000871935 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:02,190::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) (7611) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) (7611) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7611) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,191::__init__::225::IOProcess::(_processLogs) (7611) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:02,192::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,192::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:02,331::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:02,332::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3517::DEBUG::2014-09-09 11:35:02,332::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3517::DEBUG::2014-09-09 11:35:02,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf298b7f-3e1f-4174-b95d-eb2670a1b338`::moving from state init -> state preparing >Thread-3517::INFO::2014-09-09 11:35:02,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3517::INFO::2014-09-09 11:35:02,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3517::DEBUG::2014-09-09 11:35:02,334::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf298b7f-3e1f-4174-b95d-eb2670a1b338`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3517::DEBUG::2014-09-09 11:35:02,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf298b7f-3e1f-4174-b95d-eb2670a1b338`::moving from state preparing -> state finished >Thread-3517::DEBUG::2014-09-09 11:35:02,334::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3517::DEBUG::2014-09-09 11:35:02,334::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3517::DEBUG::2014-09-09 11:35:02,334::task::993::Storage.TaskManager.Task::(_decref) Task=`cf298b7f-3e1f-4174-b95d-eb2670a1b338`::ref 0 aborting False >Thread-3517::DEBUG::2014-09-09 11:35:02,334::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3517::DEBUG::2014-09-09 11:35:02,334::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:02,363::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:02,364::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3518::DEBUG::2014-09-09 11:35:02,364::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3518::DEBUG::2014-09-09 11:35:02,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d739350-22f7-46c9-b5e6-35bfb7cb1cc1`::moving from state init -> state preparing >Thread-3518::INFO::2014-09-09 11:35:02,365::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3518::DEBUG::2014-09-09 11:35:02,365::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`becbe113-dbdb-401a-aa0f-0cb6d5f95f9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3518::DEBUG::2014-09-09 11:35:02,365::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3518::DEBUG::2014-09-09 11:35:02,365::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3518::DEBUG::2014-09-09 11:35:02,365::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`becbe113-dbdb-401a-aa0f-0cb6d5f95f9b`::Granted request >Thread-3518::DEBUG::2014-09-09 11:35:02,366::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2d739350-22f7-46c9-b5e6-35bfb7cb1cc1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3518::DEBUG::2014-09-09 11:35:02,366::task::993::Storage.TaskManager.Task::(_decref) Task=`2d739350-22f7-46c9-b5e6-35bfb7cb1cc1`::ref 1 aborting False >Thread-3518::INFO::2014-09-09 11:35:02,367::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3518::DEBUG::2014-09-09 11:35:02,367::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d739350-22f7-46c9-b5e6-35bfb7cb1cc1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3518::DEBUG::2014-09-09 11:35:02,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d739350-22f7-46c9-b5e6-35bfb7cb1cc1`::moving from state preparing -> state finished >Thread-3518::DEBUG::2014-09-09 11:35:02,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3518::DEBUG::2014-09-09 11:35:02,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3518::DEBUG::2014-09-09 11:35:02,368::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3518::DEBUG::2014-09-09 11:35:02,368::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3518::DEBUG::2014-09-09 11:35:02,368::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3518::DEBUG::2014-09-09 11:35:02,368::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3518::DEBUG::2014-09-09 11:35:02,368::task::993::Storage.TaskManager.Task::(_decref) Task=`2d739350-22f7-46c9-b5e6-35bfb7cb1cc1`::ref 0 aborting False >Thread-3518::DEBUG::2014-09-09 11:35:02,368::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3518::DEBUG::2014-09-09 11:35:02,369::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:02,585::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,585::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:02,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,585::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) (7612) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) (7612) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7612) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) (7612) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,586::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:35:02,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:35:02,594::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000967144 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:02,594::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) (7613) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:02,595::__init__::225::IOProcess::(_processLogs) (7613) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:02,596::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7613) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,596::__init__::225::IOProcess::(_processLogs) (7613) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:02,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,596::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:35:02,597::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,597::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:35:02,597::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) (7614) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) (7614) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) (7614) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) (7614) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,598::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) (7615) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) (7615) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) (7615) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) (7615) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:02,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,600::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:02,600::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:02,600::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:35:02,600::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:02,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) (7616) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) (7616) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) (7616) Building response >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) (7616) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:02,601::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:02,893::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:02,893::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3519::DEBUG::2014-09-09 11:35:02,894::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:03,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:03,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896904 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:35:05,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:05,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896115 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:05,899::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:05,900::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3520::DEBUG::2014-09-09 11:35:05,901::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:07,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:07,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896085 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) (7617) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:07,756::__init__::225::IOProcess::(_processLogs) (7617) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:07,757::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|(7617) Building response >Thread-19::DEBUG::2014-09-09 11:35:07,757::__init__::225::IOProcess::(_processLogs) (7617) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:07,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:07,758::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:35:07,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:35:07,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110463 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Sending response sized 56DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:07,766::__init__::225::IOProcess::(_processLogs) (7618) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:07,767::__init__::225::IOProcess::(_processLogs) (7618) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:07,767::__init__::225::IOProcess::(_processLogs) (7618) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:07,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:07,768::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:08,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:08,907::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3521::DEBUG::2014-09-09 11:35:08,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:09,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:09,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089574 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:35:11,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:11,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895563 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:11,914::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:11,916::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3522::DEBUG::2014-09-09 11:35:11,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`39d3cce6-eaf5-443b-84f4-a1db57539832`::moving from state init -> state preparing >Thread-3522::INFO::2014-09-09 11:35:11,920::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3522::INFO::2014-09-09 11:35:11,920::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110463', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000967144', 'lastCheck': '9.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000871935', 'lastCheck': '9.7', 'valid': True}} >Thread-3522::DEBUG::2014-09-09 11:35:11,921::task::1191::Storage.TaskManager.Task::(prepare) Task=`39d3cce6-eaf5-443b-84f4-a1db57539832`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110463', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000967144', 'lastCheck': '9.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000871935', 'lastCheck': '9.7', 'valid': True}} >Thread-3522::DEBUG::2014-09-09 11:35:11,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`39d3cce6-eaf5-443b-84f4-a1db57539832`::moving from state preparing -> state finished >Thread-3522::DEBUG::2014-09-09 11:35:11,922::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3522::DEBUG::2014-09-09 11:35:11,922::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3522::DEBUG::2014-09-09 11:35:11,922::task::993::Storage.TaskManager.Task::(_decref) Task=`39d3cce6-eaf5-443b-84f4-a1db57539832`::ref 0 aborting False >Thread-3522::DEBUG::2014-09-09 11:35:11,925::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:11,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:11,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3523::DEBUG::2014-09-09 11:35:11,934::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) (7619) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) (7619) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:12,193::__init__::225::IOProcess::(_processLogs) (7619) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,194::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:35:12,194::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:35:12,201::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000935307 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) (7620) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) (7620) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:12,202::__init__::225::IOProcess::(_processLogs) (7620) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,203::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:12,407::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:12,408::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3524::DEBUG::2014-09-09 11:35:12,408::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3524::DEBUG::2014-09-09 11:35:12,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fa379ac-1ca4-46ba-b290-ff2e473e0e78`::moving from state init -> state preparing >Thread-3524::INFO::2014-09-09 11:35:12,409::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3524::INFO::2014-09-09 11:35:12,409::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3524::DEBUG::2014-09-09 11:35:12,410::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fa379ac-1ca4-46ba-b290-ff2e473e0e78`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3524::DEBUG::2014-09-09 11:35:12,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fa379ac-1ca4-46ba-b290-ff2e473e0e78`::moving from state preparing -> state finished >Thread-3524::DEBUG::2014-09-09 11:35:12,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3524::DEBUG::2014-09-09 11:35:12,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3524::DEBUG::2014-09-09 11:35:12,410::task::993::Storage.TaskManager.Task::(_decref) Task=`1fa379ac-1ca4-46ba-b290-ff2e473e0e78`::ref 0 aborting False >Thread-3524::DEBUG::2014-09-09 11:35:12,410::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3524::DEBUG::2014-09-09 11:35:12,410::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:12,462::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:12,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3525::DEBUG::2014-09-09 11:35:12,462::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3525::DEBUG::2014-09-09 11:35:12,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`19828af1-c7fa-44b9-957a-3a69d808a409`::moving from state init -> state preparing >Thread-3525::INFO::2014-09-09 11:35:12,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3525::DEBUG::2014-09-09 11:35:12,463::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8ebec890-9a15-478a-a4d9-78b7c83730e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3525::DEBUG::2014-09-09 11:35:12,463::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3525::DEBUG::2014-09-09 11:35:12,464::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3525::DEBUG::2014-09-09 11:35:12,464::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8ebec890-9a15-478a-a4d9-78b7c83730e4`::Granted request >Thread-3525::DEBUG::2014-09-09 11:35:12,465::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`19828af1-c7fa-44b9-957a-3a69d808a409`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3525::DEBUG::2014-09-09 11:35:12,465::task::993::Storage.TaskManager.Task::(_decref) Task=`19828af1-c7fa-44b9-957a-3a69d808a409`::ref 1 aborting False >Thread-3525::INFO::2014-09-09 11:35:12,466::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3525::DEBUG::2014-09-09 11:35:12,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`19828af1-c7fa-44b9-957a-3a69d808a409`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3525::DEBUG::2014-09-09 11:35:12,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`19828af1-c7fa-44b9-957a-3a69d808a409`::moving from state preparing -> state finished >Thread-3525::DEBUG::2014-09-09 11:35:12,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3525::DEBUG::2014-09-09 11:35:12,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3525::DEBUG::2014-09-09 11:35:12,467::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3525::DEBUG::2014-09-09 11:35:12,467::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3525::DEBUG::2014-09-09 11:35:12,467::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3525::DEBUG::2014-09-09 11:35:12,467::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3525::DEBUG::2014-09-09 11:35:12,467::task::993::Storage.TaskManager.Task::(_decref) Task=`19828af1-c7fa-44b9-957a-3a69d808a409`::ref 0 aborting False >Thread-3525::DEBUG::2014-09-09 11:35:12,467::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3525::DEBUG::2014-09-09 11:35:12,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) (7621) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:12,601::__init__::225::IOProcess::(_processLogs) (7621) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:12,602::__init__::225::IOProcess::(_processLogs) (7621) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,602::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:35:12,603::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:35:12,611::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000967363 s, 566 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,612::__init__::225::IOProcess::(_processLogs) (7622) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:12,613::__init__::225::IOProcess::(_processLogs) (7622) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:12,613::__init__::225::IOProcess::(_processLogs) (7622) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:12,613::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,614::__init__::225::IOProcess::(_processLogs) (7623) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) (7623) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) (7623) Building response >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) (7623) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,615::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) (7624) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) (7624) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) (7624) Building response >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) (7624) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:12,616::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:12,617::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:12,617::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:35:12,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:12,617::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:12,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:12,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) (7625) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) (7625) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) (7625) Building response >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) (7625) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:12,618::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:35:13,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:14,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896608 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:15,264::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:15,265::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3526::DEBUG::2014-09-09 11:35:15,266::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:16,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:16,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897392 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:17,768::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:17,768::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:17,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:17,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:17,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:17,769::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:17,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:17,769::__init__::225::IOProcess::(_processLogs) (7626) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:17,769::__init__::225::IOProcess::(_processLogs) (7626) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:17,769::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7626) Building response >Thread-23::DEBUG::2014-09-09 11:35:17,770::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:35:17,770::__init__::225::IOProcess::(_processLogs) (7626) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:17,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:17,775::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:35:17,776::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103941 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:17,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:17,778::__init__::225::IOProcess::(_processLogs) (7627) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:17,778::__init__::225::IOProcess::(_processLogs) (7627) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:17,778::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7627) Building response >Thread-19::DEBUG::2014-09-09 11:35:17,778::__init__::225::IOProcess::(_processLogs) (7627) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:17,778::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:17,778::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:35:18,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:18,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896712 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:18,271::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:18,271::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3527::DEBUG::2014-09-09 11:35:18,272::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:20,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:20,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897544 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:21,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:21,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3528::DEBUG::2014-09-09 11:35:21,279::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) (7628) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:22,204::__init__::225::IOProcess::(_processLogs) (7628) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:22,205::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7628) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,205::__init__::225::IOProcess::(_processLogs) (7628) Queuing response >Thread-3443::DEBUG::2014-09-09 11:35:22,205::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:35:22,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,210::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:35:22,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00088094 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:22,212::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,212::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) (7629) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) (7629) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7629) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,213::__init__::225::IOProcess::(_processLogs) (7629) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:22,214::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,214::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:35:22,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:22,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896104 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:22,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:22,518::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3529::DEBUG::2014-09-09 11:35:22,518::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3529::DEBUG::2014-09-09 11:35:22,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`6626fc45-de5c-423e-9005-5c7e3f721af2`::moving from state init -> state preparing >Thread-3529::INFO::2014-09-09 11:35:22,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3529::INFO::2014-09-09 11:35:22,519::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3529::DEBUG::2014-09-09 11:35:22,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`6626fc45-de5c-423e-9005-5c7e3f721af2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3529::DEBUG::2014-09-09 11:35:22,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`6626fc45-de5c-423e-9005-5c7e3f721af2`::moving from state preparing -> state finished >Thread-3529::DEBUG::2014-09-09 11:35:22,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3529::DEBUG::2014-09-09 11:35:22,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3529::DEBUG::2014-09-09 11:35:22,520::task::993::Storage.TaskManager.Task::(_decref) Task=`6626fc45-de5c-423e-9005-5c7e3f721af2`::ref 0 aborting False >Thread-3529::DEBUG::2014-09-09 11:35:22,520::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3529::DEBUG::2014-09-09 11:35:22,520::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:22,601::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:22,601::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3530::DEBUG::2014-09-09 11:35:22,601::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3530::DEBUG::2014-09-09 11:35:22,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`d50d8b04-a82b-407b-87f1-9b9c2d7c09fc`::moving from state init -> state preparing >Thread-3530::INFO::2014-09-09 11:35:22,602::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3530::DEBUG::2014-09-09 11:35:22,603::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bda4b1bf-e557-43dc-9c68-b35c1abd105b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3530::DEBUG::2014-09-09 11:35:22,603::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3530::DEBUG::2014-09-09 11:35:22,603::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3530::DEBUG::2014-09-09 11:35:22,603::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bda4b1bf-e557-43dc-9c68-b35c1abd105b`::Granted request >Thread-3530::DEBUG::2014-09-09 11:35:22,603::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d50d8b04-a82b-407b-87f1-9b9c2d7c09fc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3530::DEBUG::2014-09-09 11:35:22,603::task::993::Storage.TaskManager.Task::(_decref) Task=`d50d8b04-a82b-407b-87f1-9b9c2d7c09fc`::ref 1 aborting False >Thread-3530::INFO::2014-09-09 11:35:22,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3530::DEBUG::2014-09-09 11:35:22,605::task::1191::Storage.TaskManager.Task::(prepare) Task=`d50d8b04-a82b-407b-87f1-9b9c2d7c09fc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3530::DEBUG::2014-09-09 11:35:22,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`d50d8b04-a82b-407b-87f1-9b9c2d7c09fc`::moving from state preparing -> state finished >Thread-3530::DEBUG::2014-09-09 11:35:22,605::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3530::DEBUG::2014-09-09 11:35:22,605::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3530::DEBUG::2014-09-09 11:35:22,605::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3530::DEBUG::2014-09-09 11:35:22,605::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3530::DEBUG::2014-09-09 11:35:22,606::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3530::DEBUG::2014-09-09 11:35:22,606::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3530::DEBUG::2014-09-09 11:35:22,606::task::993::Storage.TaskManager.Task::(_decref) Task=`d50d8b04-a82b-407b-87f1-9b9c2d7c09fc`::ref 0 aborting False >Thread-3530::DEBUG::2014-09-09 11:35:22,606::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3530::DEBUG::2014-09-09 11:35:22,606::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) (7630) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:22,618::__init__::225::IOProcess::(_processLogs) (7630) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:22,619::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7630) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,619::__init__::225::IOProcess::(_processLogs) (7630) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:22,619::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,619::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:35:22,619::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:35:22,627::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000993748 s, 551 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:22,627::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,627::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) (7631) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) (7631) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) DEBUG|(7631) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) (7631) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,628::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:35:22,629::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,629::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) (7632) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) (7632) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) (7632) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) (7632) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:22,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) (7633) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) (7633) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) (7633) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) (7633) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:35:22,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) (7634) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) (7634) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) (7634) Building response >Thread-19::DEBUG::2014-09-09 11:35:22,633::__init__::225::IOProcess::(_processLogs) (7634) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:22,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:22,634::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:24,284::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:24,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3531::DEBUG::2014-09-09 11:35:24,287::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:24,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:24,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895974 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:35:26,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:26,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895539 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:27,293::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:27,293::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3532::DEBUG::2014-09-09 11:35:27,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`a555a245-f7b4-4fd5-a192-59d3787cb552`::moving from state init -> state preparing >Thread-3532::INFO::2014-09-09 11:35:27,295::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3532::INFO::2014-09-09 11:35:27,295::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103941', 'lastCheck': '9.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000993748', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00088094', 'lastCheck': '5.1', 'valid': True}} >Thread-3532::DEBUG::2014-09-09 11:35:27,295::task::1191::Storage.TaskManager.Task::(prepare) Task=`a555a245-f7b4-4fd5-a192-59d3787cb552`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103941', 'lastCheck': '9.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000993748', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00088094', 'lastCheck': '5.1', 'valid': True}} >Thread-3532::DEBUG::2014-09-09 11:35:27,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`a555a245-f7b4-4fd5-a192-59d3787cb552`::moving from state preparing -> state finished >Thread-3532::DEBUG::2014-09-09 11:35:27,295::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3532::DEBUG::2014-09-09 11:35:27,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3532::DEBUG::2014-09-09 11:35:27,295::task::993::Storage.TaskManager.Task::(_decref) Task=`a555a245-f7b4-4fd5-a192-59d3787cb552`::ref 0 aborting False >Thread-3532::DEBUG::2014-09-09 11:35:27,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:27,303::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:27,303::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3533::DEBUG::2014-09-09 11:35:27,304::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:27,779::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:27,779::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:27,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) (7635) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) (7635) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:27,780::__init__::225::IOProcess::(_processLogs) DEBUG|(7635) Building response >Thread-23::DEBUG::2014-09-09 11:35:27,781::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:35:27,781::__init__::225::IOProcess::(_processLogs) (7635) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:27,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:27,786::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:35:27,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108193 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:27,788::__init__::225::IOProcess::(_processLogs) (7636) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:27,789::__init__::225::IOProcess::(_processLogs) (7636) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:27,789::__init__::225::IOProcess::(_processLogs) DEBUG|(7636) Building response >Thread-19::DEBUG::2014-09-09 11:35:27,789::__init__::225::IOProcess::(_processLogs) (7636) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:27,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:27,789::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:35:28,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:28,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896742 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:30,365::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:30,366::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3534::DEBUG::2014-09-09 11:35:30,367::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:30,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:30,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897801 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) (7637) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:32,215::__init__::225::IOProcess::(_processLogs) (7637) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:32,217::__init__::225::IOProcess::(_processLogs) DEBUG|(7637) Building response >Thread-19::DEBUG::2014-09-09 11:35:32,217::__init__::225::IOProcess::(_processLogs) (7637) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,217::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,218::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:35:32,218::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:35:32,225::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000877985 s, 404 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:32,225::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) (7638) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:32,226::__init__::225::IOProcess::(_processLogs) (7638) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:32,227::__init__::225::IOProcess::(_processLogs) DEBUG|(7638) Building response >Thread-19::DEBUG::2014-09-09 11:35:32,227::__init__::225::IOProcess::(_processLogs) (7638) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,227::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:35:32,633::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) (7639) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) (7639) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:32,634::__init__::225::IOProcess::(_processLogs) DEBUG|(7639) Building response >Thread-24::DEBUG::2014-09-09 11:35:32,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:35:32,635::__init__::225::IOProcess::(_processLogs) (7639) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,640::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:35:32,642::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000906431 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) (7640) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) (7640) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:32,643::__init__::225::IOProcess::(_processLogs) DEBUG|(7640) Building response >Thread-19::DEBUG::2014-09-09 11:35:32,644::__init__::225::IOProcess::(_processLogs) (7640) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,644::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:35:32,644::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,644::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) (7641) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) (7641) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) (7641) Building response >Thread-19::DEBUG::2014-09-09 11:35:32,645::__init__::225::IOProcess::(_processLogs) (7641) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,646::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) (7642) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) (7642) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) (7642) Building response >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) (7642) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:35:32,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) (7643) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) (7643) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) (7643) Building response >Thread-19::DEBUG::2014-09-09 11:35:32,648::__init__::225::IOProcess::(_processLogs) (7643) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:32,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:32,649::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:32,658::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:32,659::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3535::DEBUG::2014-09-09 11:35:32,659::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3535::DEBUG::2014-09-09 11:35:32,660::task::595::Storage.TaskManager.Task::(_updateState) Task=`cef26002-17de-4b84-9a62-22523443a4ac`::moving from state init -> state preparing >Thread-3535::INFO::2014-09-09 11:35:32,660::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3535::INFO::2014-09-09 11:35:32,660::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3535::DEBUG::2014-09-09 11:35:32,660::task::1191::Storage.TaskManager.Task::(prepare) Task=`cef26002-17de-4b84-9a62-22523443a4ac`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3535::DEBUG::2014-09-09 11:35:32,660::task::595::Storage.TaskManager.Task::(_updateState) Task=`cef26002-17de-4b84-9a62-22523443a4ac`::moving from state preparing -> state finished >Thread-3535::DEBUG::2014-09-09 11:35:32,660::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3535::DEBUG::2014-09-09 11:35:32,660::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3535::DEBUG::2014-09-09 11:35:32,660::task::993::Storage.TaskManager.Task::(_decref) Task=`cef26002-17de-4b84-9a62-22523443a4ac`::ref 0 aborting False >Thread-3535::DEBUG::2014-09-09 11:35:32,660::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3535::DEBUG::2014-09-09 11:35:32,661::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:32,691::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:32,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3536::DEBUG::2014-09-09 11:35:32,692::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3536::DEBUG::2014-09-09 11:35:32,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`64562445-5f97-4375-aa1a-7831b87f9d20`::moving from state init -> state preparing >Thread-3536::INFO::2014-09-09 11:35:32,693::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3536::DEBUG::2014-09-09 11:35:32,693::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8b15edce-9390-4b9b-874b-70946ded2835`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3536::DEBUG::2014-09-09 11:35:32,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3536::DEBUG::2014-09-09 11:35:32,693::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3536::DEBUG::2014-09-09 11:35:32,693::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8b15edce-9390-4b9b-874b-70946ded2835`::Granted request >Thread-3536::DEBUG::2014-09-09 11:35:32,694::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`64562445-5f97-4375-aa1a-7831b87f9d20`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3536::DEBUG::2014-09-09 11:35:32,694::task::993::Storage.TaskManager.Task::(_decref) Task=`64562445-5f97-4375-aa1a-7831b87f9d20`::ref 1 aborting False >Thread-3536::INFO::2014-09-09 11:35:32,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3536::DEBUG::2014-09-09 11:35:32,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`64562445-5f97-4375-aa1a-7831b87f9d20`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3536::DEBUG::2014-09-09 11:35:32,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`64562445-5f97-4375-aa1a-7831b87f9d20`::moving from state preparing -> state finished >Thread-3536::DEBUG::2014-09-09 11:35:32,695::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3536::DEBUG::2014-09-09 11:35:32,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3536::DEBUG::2014-09-09 11:35:32,696::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3536::DEBUG::2014-09-09 11:35:32,696::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3536::DEBUG::2014-09-09 11:35:32,696::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3536::DEBUG::2014-09-09 11:35:32,696::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3536::DEBUG::2014-09-09 11:35:32,696::task::993::Storage.TaskManager.Task::(_decref) Task=`64562445-5f97-4375-aa1a-7831b87f9d20`::ref 0 aborting False >Thread-3536::DEBUG::2014-09-09 11:35:32,696::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3536::DEBUG::2014-09-09 11:35:32,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:32,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:32,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897442 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:33,376::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:33,377::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3537::DEBUG::2014-09-09 11:35:33,378::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:34,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:35,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897546 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:36,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:36,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3538::DEBUG::2014-09-09 11:35:36,390::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:37,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:37,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896761 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) (7644) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:37,790::__init__::225::IOProcess::(_processLogs) (7644) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:37,791::__init__::225::IOProcess::(_processLogs) DEBUG|(7644) Building response >Thread-19::DEBUG::2014-09-09 11:35:37,791::__init__::225::IOProcess::(_processLogs) (7644) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:37,792::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:37,792::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:35:37,792::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:35:37,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011045 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:37,800::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:37,800::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) (7645) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) (7645) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) DEBUG|(7645) Building response >Thread-19::DEBUG::2014-09-09 11:35:37,801::__init__::225::IOProcess::(_processLogs) (7645) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:37,802::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:37,802::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:35:39,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:39,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896577 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:39,401::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:39,402::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3539::DEBUG::2014-09-09 11:35:39,403::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:41,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:41,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896825 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) (7646) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:42,228::__init__::225::IOProcess::(_processLogs) (7646) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:42,229::__init__::225::IOProcess::(_processLogs) DEBUG|(7646) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,229::__init__::225::IOProcess::(_processLogs) (7646) Queuing response >Thread-3443::DEBUG::2014-09-09 11:35:42,229::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:35:42,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,234::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:35:42,236::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000871743 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:42,236::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,236::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:42,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,236::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) (7647) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) (7647) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) DEBUG|(7647) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,237::__init__::225::IOProcess::(_processLogs) (7647) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:42,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,238::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:42,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:42,408::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3540::DEBUG::2014-09-09 11:35:42,409::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4ae4a72-e4b5-42d4-83f8-0161d3684210`::moving from state init -> state preparing >Thread-3540::INFO::2014-09-09 11:35:42,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3540::INFO::2014-09-09 11:35:42,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011045', 'lastCheck': '4.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000906431', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000871743', 'lastCheck': '0.2', 'valid': True}} >Thread-3540::DEBUG::2014-09-09 11:35:42,410::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4ae4a72-e4b5-42d4-83f8-0161d3684210`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011045', 'lastCheck': '4.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000906431', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000871743', 'lastCheck': '0.2', 'valid': True}} >Thread-3540::DEBUG::2014-09-09 11:35:42,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4ae4a72-e4b5-42d4-83f8-0161d3684210`::moving from state preparing -> state finished >Thread-3540::DEBUG::2014-09-09 11:35:42,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3540::DEBUG::2014-09-09 11:35:42,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3540::DEBUG::2014-09-09 11:35:42,410::task::993::Storage.TaskManager.Task::(_decref) Task=`e4ae4a72-e4b5-42d4-83f8-0161d3684210`::ref 0 aborting False >Thread-3540::DEBUG::2014-09-09 11:35:42,411::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:42,420::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:42,421::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3541::DEBUG::2014-09-09 11:35:42,422::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:42,648::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,648::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:42,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,649::__init__::225::IOProcess::(_processLogs) (7648) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:42,649::__init__::225::IOProcess::(_processLogs) (7648) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:42,650::__init__::225::IOProcess::(_processLogs) DEBUG|(7648) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,650::__init__::225::IOProcess::(_processLogs) (7648) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:42,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,650::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:35:42,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:35:42,657::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000984292 s, 557 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:42,658::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,658::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:42,658::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,658::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,659::__init__::225::IOProcess::(_processLogs) (7649) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:42,659::__init__::225::IOProcess::(_processLogs) (7649) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:42,659::__init__::225::IOProcess::(_processLogs) DEBUG|(7649) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) (7649) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,660::__init__::225::IOProcess::(_processLogs) (7650) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) (7650) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) DEBUG|(7650) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) (7650) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,661::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) (7651) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) (7651) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:42,662::__init__::225::IOProcess::(_processLogs) DEBUG|(7651) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) (7651) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:42,663::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) (7652) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) (7652) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) (7652) Building response >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) (7652) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:42,664::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:42,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:42,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3542::DEBUG::2014-09-09 11:35:42,737::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3542::DEBUG::2014-09-09 11:35:42,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c59bcbb-9a0d-4000-a33f-303be187464b`::moving from state init -> state preparing >Thread-3542::INFO::2014-09-09 11:35:42,738::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3542::INFO::2014-09-09 11:35:42,738::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3542::DEBUG::2014-09-09 11:35:42,738::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c59bcbb-9a0d-4000-a33f-303be187464b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3542::DEBUG::2014-09-09 11:35:42,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c59bcbb-9a0d-4000-a33f-303be187464b`::moving from state preparing -> state finished >Thread-3542::DEBUG::2014-09-09 11:35:42,738::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3542::DEBUG::2014-09-09 11:35:42,738::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3542::DEBUG::2014-09-09 11:35:42,738::task::993::Storage.TaskManager.Task::(_decref) Task=`9c59bcbb-9a0d-4000-a33f-303be187464b`::ref 0 aborting False >Thread-3542::DEBUG::2014-09-09 11:35:42,738::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3542::DEBUG::2014-09-09 11:35:42,739::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:42,767::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:42,768::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3543::DEBUG::2014-09-09 11:35:42,768::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3543::DEBUG::2014-09-09 11:35:42,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e1c6f10-6f54-4838-8042-2183154da4ad`::moving from state init -> state preparing >Thread-3543::INFO::2014-09-09 11:35:42,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3543::DEBUG::2014-09-09 11:35:42,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d8eaae4c-8dbd-4b26-b2f6-9a61aaf0a52c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3543::DEBUG::2014-09-09 11:35:42,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3543::DEBUG::2014-09-09 11:35:42,769::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3543::DEBUG::2014-09-09 11:35:42,769::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d8eaae4c-8dbd-4b26-b2f6-9a61aaf0a52c`::Granted request >Thread-3543::DEBUG::2014-09-09 11:35:42,769::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e1c6f10-6f54-4838-8042-2183154da4ad`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3543::DEBUG::2014-09-09 11:35:42,769::task::993::Storage.TaskManager.Task::(_decref) Task=`6e1c6f10-6f54-4838-8042-2183154da4ad`::ref 1 aborting False >Thread-3543::INFO::2014-09-09 11:35:42,771::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3543::DEBUG::2014-09-09 11:35:42,771::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e1c6f10-6f54-4838-8042-2183154da4ad`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3543::DEBUG::2014-09-09 11:35:42,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e1c6f10-6f54-4838-8042-2183154da4ad`::moving from state preparing -> state finished >Thread-3543::DEBUG::2014-09-09 11:35:42,771::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3543::DEBUG::2014-09-09 11:35:42,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3543::DEBUG::2014-09-09 11:35:42,772::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3543::DEBUG::2014-09-09 11:35:42,772::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3543::DEBUG::2014-09-09 11:35:42,772::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3543::DEBUG::2014-09-09 11:35:42,772::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3543::DEBUG::2014-09-09 11:35:42,772::task::993::Storage.TaskManager.Task::(_decref) Task=`6e1c6f10-6f54-4838-8042-2183154da4ad`::ref 0 aborting False >Thread-3543::DEBUG::2014-09-09 11:35:42,772::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3543::DEBUG::2014-09-09 11:35:42,772::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:43,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:43,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895998 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:35:45,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:45,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:45,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3544::DEBUG::2014-09-09 11:35:45,503::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:45,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896586 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:35:47,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:47,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896875 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) (7653) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) (7653) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:47,803::__init__::225::IOProcess::(_processLogs) DEBUG|(7653) Building response >Thread-19::DEBUG::2014-09-09 11:35:47,804::__init__::225::IOProcess::(_processLogs) (7653) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:47,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:47,804::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:35:47,804::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:35:47,811::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0012417 s, 904 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:47,811::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) (7654) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) (7654) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) DEBUG|(7654) Building response >Thread-19::DEBUG::2014-09-09 11:35:47,812::__init__::225::IOProcess::(_processLogs) (7654) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:47,813::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:47,813::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:48,511::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:48,511::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3545::DEBUG::2014-09-09 11:35:48,512::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:49,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:49,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0950875 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:51,519::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:51,520::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3546::DEBUG::2014-09-09 11:35:51,521::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:51,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:51,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896538 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:52,238::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) (7655) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) (7655) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:52,239::__init__::225::IOProcess::(_processLogs) DEBUG|(7655) Building response >Thread-19::DEBUG::2014-09-09 11:35:52,240::__init__::225::IOProcess::(_processLogs) (7655) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:52,240::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:35:52,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:35:52,246::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000896414 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,248::__init__::225::IOProcess::(_processLogs) (7656) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:52,248::__init__::225::IOProcess::(_processLogs) (7656) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:52,248::__init__::225::IOProcess::(_processLogs) (7656) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:52,664::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:52,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:52,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,664::__init__::225::IOProcess::(_processLogs) (7657) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:52,665::__init__::225::IOProcess::(_processLogs) (7657) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:52,665::__init__::225::IOProcess::(_processLogs) (7657) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:35:52,665::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:35:52,672::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100188 s, 547 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) (7658) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) (7658) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:52,673::__init__::225::IOProcess::(_processLogs) (7658) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,674::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:52,674::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:35:52,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:52,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) (7659) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) (7659) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) (7659) Building response >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) (7659) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:52,675::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) (7660) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) (7660) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) (7660) Building response >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) (7660) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) (7661) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:35:52,677::__init__::225::IOProcess::(_processLogs) (7661) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:35:52,678::__init__::225::IOProcess::(_processLogs) (7661) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:52,678::__init__::225::IOProcess::(_processLogs) (7661) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:52,678::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:52,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:52,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3547::DEBUG::2014-09-09 11:35:52,986::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3547::DEBUG::2014-09-09 11:35:52,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa5a2b23-c2e4-4cd8-a212-a450ad79994a`::moving from state init -> state preparing >Thread-3547::INFO::2014-09-09 11:35:52,987::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3547::INFO::2014-09-09 11:35:52,987::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3547::DEBUG::2014-09-09 11:35:52,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa5a2b23-c2e4-4cd8-a212-a450ad79994a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3547::DEBUG::2014-09-09 11:35:52,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa5a2b23-c2e4-4cd8-a212-a450ad79994a`::moving from state preparing -> state finished >Thread-3547::DEBUG::2014-09-09 11:35:52,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3547::DEBUG::2014-09-09 11:35:52,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3547::DEBUG::2014-09-09 11:35:52,988::task::993::Storage.TaskManager.Task::(_decref) Task=`fa5a2b23-c2e4-4cd8-a212-a450ad79994a`::ref 0 aborting False >Thread-3547::DEBUG::2014-09-09 11:35:52,988::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3547::DEBUG::2014-09-09 11:35:52,988::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:53,064::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:53,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3548::DEBUG::2014-09-09 11:35:53,064::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3548::DEBUG::2014-09-09 11:35:53,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`797c8550-325a-4c4b-af70-883c966c4e9e`::moving from state init -> state preparing >Thread-3548::INFO::2014-09-09 11:35:53,065::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3548::DEBUG::2014-09-09 11:35:53,065::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b53bf3c9-ba60-44ef-b0ac-c51cfeaf76c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3548::DEBUG::2014-09-09 11:35:53,066::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3548::DEBUG::2014-09-09 11:35:53,066::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3548::DEBUG::2014-09-09 11:35:53,066::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b53bf3c9-ba60-44ef-b0ac-c51cfeaf76c3`::Granted request >Thread-3548::DEBUG::2014-09-09 11:35:53,066::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`797c8550-325a-4c4b-af70-883c966c4e9e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3548::DEBUG::2014-09-09 11:35:53,066::task::993::Storage.TaskManager.Task::(_decref) Task=`797c8550-325a-4c4b-af70-883c966c4e9e`::ref 1 aborting False >Thread-3548::INFO::2014-09-09 11:35:53,068::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3548::DEBUG::2014-09-09 11:35:53,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`797c8550-325a-4c4b-af70-883c966c4e9e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3548::DEBUG::2014-09-09 11:35:53,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`797c8550-325a-4c4b-af70-883c966c4e9e`::moving from state preparing -> state finished >Thread-3548::DEBUG::2014-09-09 11:35:53,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3548::DEBUG::2014-09-09 11:35:53,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3548::DEBUG::2014-09-09 11:35:53,068::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3548::DEBUG::2014-09-09 11:35:53,068::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3548::DEBUG::2014-09-09 11:35:53,068::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3548::DEBUG::2014-09-09 11:35:53,068::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3548::DEBUG::2014-09-09 11:35:53,069::task::993::Storage.TaskManager.Task::(_decref) Task=`797c8550-325a-4c4b-af70-883c966c4e9e`::ref 0 aborting False >Thread-3548::DEBUG::2014-09-09 11:35:53,069::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3548::DEBUG::2014-09-09 11:35:53,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:53,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:54,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895499 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:54,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:54,530::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3549::DEBUG::2014-09-09 11:35:54,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:35:56,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:56,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896922 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:57,538::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:57,539::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3550::DEBUG::2014-09-09 11:35:57,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f1dcbd8-8ebd-4150-988e-8aaafa3009c2`::moving from state init -> state preparing >Thread-3550::INFO::2014-09-09 11:35:57,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3550::INFO::2014-09-09 11:35:57,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0012417', 'lastCheck': '9.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100188', 'lastCheck': '4.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000896414', 'lastCheck': '5.3', 'valid': True}} >Thread-3550::DEBUG::2014-09-09 11:35:57,540::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f1dcbd8-8ebd-4150-988e-8aaafa3009c2`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0012417', 'lastCheck': '9.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100188', 'lastCheck': '4.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000896414', 'lastCheck': '5.3', 'valid': True}} >Thread-3550::DEBUG::2014-09-09 11:35:57,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f1dcbd8-8ebd-4150-988e-8aaafa3009c2`::moving from state preparing -> state finished >Thread-3550::DEBUG::2014-09-09 11:35:57,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3550::DEBUG::2014-09-09 11:35:57,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3550::DEBUG::2014-09-09 11:35:57,541::task::993::Storage.TaskManager.Task::(_decref) Task=`3f1dcbd8-8ebd-4150-988e-8aaafa3009c2`::ref 0 aborting False >Thread-3550::DEBUG::2014-09-09 11:35:57,542::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:35:57,552::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:35:57,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3551::DEBUG::2014-09-09 11:35:57,553::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) (7661) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) (7662) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) (7662) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:57,814::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7662) Building response >Thread-19::DEBUG::2014-09-09 11:35:57,815::__init__::225::IOProcess::(_processLogs) (7662) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:57,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:35:57,815::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:35:57,815::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:35:57,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113502 s, 989 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:35:57,825::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:35:57,825::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:35:57,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:35:57,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:35:57,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:35:57,828::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:35:57,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:35:57,829::__init__::225::IOProcess::(_processLogs) (7663) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:35:57,829::__init__::225::IOProcess::(_processLogs) (7663) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:35:57,829::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7663) Building response >Thread-19::DEBUG::2014-09-09 11:35:57,830::__init__::225::IOProcess::(_processLogs) (7663) Queuing response >Thread-19::DEBUG::2014-09-09 11:35:57,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:35:57,830::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:35:58,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:35:58,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896532 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:36:00,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:00,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895835 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:00,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:00,620::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3552::DEBUG::2014-09-09 11:36:00,621::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,249::__init__::225::IOProcess::(_processLogs) (7664) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:02,250::__init__::225::IOProcess::(_processLogs) (7664) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:02,250::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7664) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,250::__init__::225::IOProcess::(_processLogs) (7664) Queuing response >Thread-3443::DEBUG::2014-09-09 11:36:02,250::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:36:02,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,256::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:36:02,258::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000852647 s, 416 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:02,258::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,258::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:02,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) (7665) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) (7665) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:02,259::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7665) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,260::__init__::225::IOProcess::(_processLogs) (7665) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:02,260::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,260::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:36:02,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:02,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896392 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,679::__init__::225::IOProcess::(_processLogs) (7666) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:02,680::__init__::225::IOProcess::(_processLogs) (7666) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:02,680::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7666) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,680::__init__::225::IOProcess::(_processLogs) (7666) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:02,680::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,681::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:36:02,681::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:36:02,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00098828 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:02,688::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) (7667) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) (7667) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:02,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7667) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,690::__init__::225::IOProcess::(_processLogs) (7667) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:02,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,690::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:02,690::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,690::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:36:02,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) (7668) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) (7668) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) (7668) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) (7668) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:02,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) (7669) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) (7669) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) (7669) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) (7669) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:36:02,693::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) (7670) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) (7670) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) (7670) Building response >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) (7670) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:02,694::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:03,187::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3553::DEBUG::2014-09-09 11:36:03,188::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:36:03,188::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3553::DEBUG::2014-09-09 11:36:03,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`c37a2ebe-88ae-48d2-a423-b7114dc08322`::moving from state init -> state preparing >Thread-3553::INFO::2014-09-09 11:36:03,189::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3553::INFO::2014-09-09 11:36:03,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3553::DEBUG::2014-09-09 11:36:03,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`c37a2ebe-88ae-48d2-a423-b7114dc08322`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3553::DEBUG::2014-09-09 11:36:03,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`c37a2ebe-88ae-48d2-a423-b7114dc08322`::moving from state preparing -> state finished >Thread-3553::DEBUG::2014-09-09 11:36:03,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3553::DEBUG::2014-09-09 11:36:03,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3553::DEBUG::2014-09-09 11:36:03,190::task::993::Storage.TaskManager.Task::(_decref) Task=`c37a2ebe-88ae-48d2-a423-b7114dc08322`::ref 0 aborting False >Thread-3553::DEBUG::2014-09-09 11:36:03,190::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3553::DEBUG::2014-09-09 11:36:03,190::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:03,235::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:03,236::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3554::DEBUG::2014-09-09 11:36:03,236::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3554::DEBUG::2014-09-09 11:36:03,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`023977b5-2b9b-4bf0-b329-8f4648234a2c`::moving from state init -> state preparing >Thread-3554::INFO::2014-09-09 11:36:03,237::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3554::DEBUG::2014-09-09 11:36:03,237::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b9517e46-ff55-456b-bc6d-e006b4570a3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3554::DEBUG::2014-09-09 11:36:03,237::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3554::DEBUG::2014-09-09 11:36:03,237::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3554::DEBUG::2014-09-09 11:36:03,237::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b9517e46-ff55-456b-bc6d-e006b4570a3b`::Granted request >Thread-3554::DEBUG::2014-09-09 11:36:03,238::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`023977b5-2b9b-4bf0-b329-8f4648234a2c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3554::DEBUG::2014-09-09 11:36:03,238::task::993::Storage.TaskManager.Task::(_decref) Task=`023977b5-2b9b-4bf0-b329-8f4648234a2c`::ref 1 aborting False >Thread-3554::INFO::2014-09-09 11:36:03,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3554::DEBUG::2014-09-09 11:36:03,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`023977b5-2b9b-4bf0-b329-8f4648234a2c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3554::DEBUG::2014-09-09 11:36:03,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`023977b5-2b9b-4bf0-b329-8f4648234a2c`::moving from state preparing -> state finished >Thread-3554::DEBUG::2014-09-09 11:36:03,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3554::DEBUG::2014-09-09 11:36:03,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3554::DEBUG::2014-09-09 11:36:03,240::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3554::DEBUG::2014-09-09 11:36:03,240::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3554::DEBUG::2014-09-09 11:36:03,240::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3554::DEBUG::2014-09-09 11:36:03,240::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3554::DEBUG::2014-09-09 11:36:03,240::task::993::Storage.TaskManager.Task::(_decref) Task=`023977b5-2b9b-4bf0-b329-8f4648234a2c`::ref 0 aborting False >Thread-3554::DEBUG::2014-09-09 11:36:03,240::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3554::DEBUG::2014-09-09 11:36:03,240::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:03,630::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:03,631::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3555::DEBUG::2014-09-09 11:36:03,632::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:04,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:04,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897308 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:36:06,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:06,647::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:06,648::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3556::DEBUG::2014-09-09 11:36:06,649::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:06,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896735 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:07,830::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:07,830::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:07,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:07,831::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:07,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:07,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:07,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:07,831::__init__::225::IOProcess::(_processLogs) (7671) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:07,831::__init__::225::IOProcess::(_processLogs) (7671) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:07,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7671) Building response >Thread-19::DEBUG::2014-09-09 11:36:07,832::__init__::225::IOProcess::(_processLogs) (7671) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:07,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:07,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:36:07,833::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:36:07,840::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00122035 s, 920 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) (7672) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:07,841::__init__::225::IOProcess::(_processLogs) (7672) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:07,842::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7672) Building response >Thread-19::DEBUG::2014-09-09 11:36:07,842::__init__::225::IOProcess::(_processLogs) (7672) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:07,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:07,843::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:36:08,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:08,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089737 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:09,655::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:09,656::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3557::DEBUG::2014-09-09 11:36:09,656::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:10,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:10,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895734 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) (7673) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) (7673) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:12,261::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7673) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,262::__init__::225::IOProcess::(_processLogs) (7673) Queuing response >Thread-3443::DEBUG::2014-09-09 11:36:12,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:36:12,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:12,267::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:36:12,269::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000933289 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,270::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,271::__init__::225::IOProcess::(_processLogs) (7674) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:12,271::__init__::225::IOProcess::(_processLogs) (7674) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:12,271::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7674) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,271::__init__::225::IOProcess::(_processLogs) (7674) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:12,271::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:12,272::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:12,662::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:12,663::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3558::DEBUG::2014-09-09 11:36:12,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`662587d1-9d7a-4b15-9b74-6e7f4d2c2d11`::moving from state init -> state preparing >Thread-3558::INFO::2014-09-09 11:36:12,664::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3558::INFO::2014-09-09 11:36:12,664::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00122035', 'lastCheck': '4.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00098828', 'lastCheck': '10.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933289', 'lastCheck': '0.4', 'valid': True}} >Thread-3558::DEBUG::2014-09-09 11:36:12,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`662587d1-9d7a-4b15-9b74-6e7f4d2c2d11`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00122035', 'lastCheck': '4.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00098828', 'lastCheck': '10.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933289', 'lastCheck': '0.4', 'valid': True}} >Thread-3558::DEBUG::2014-09-09 11:36:12,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`662587d1-9d7a-4b15-9b74-6e7f4d2c2d11`::moving from state preparing -> state finished >Thread-3558::DEBUG::2014-09-09 11:36:12,664::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3558::DEBUG::2014-09-09 11:36:12,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3558::DEBUG::2014-09-09 11:36:12,665::task::993::Storage.TaskManager.Task::(_decref) Task=`662587d1-9d7a-4b15-9b74-6e7f4d2c2d11`::ref 0 aborting False >Thread-3558::DEBUG::2014-09-09 11:36:12,665::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:12,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:12,674::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3559::DEBUG::2014-09-09 11:36:12,675::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,694::__init__::225::IOProcess::(_processLogs) (7675) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:12,695::__init__::225::IOProcess::(_processLogs) (7675) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:12,695::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7675) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,696::__init__::225::IOProcess::(_processLogs) (7675) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:12,696::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:36:12,696::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:36:12,696::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:36:12,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000973009 s, 563 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:12,705::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) (7676) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) (7676) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7676) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,706::__init__::225::IOProcess::(_processLogs) (7676) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:12,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:12,707::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:12,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,707::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) (7677) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) (7677) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:12,708::__init__::225::IOProcess::(_processLogs) (7677) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) (7677) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) (7678) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) (7678) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) (7678) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) (7678) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:36:12,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) (7679) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) (7679) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) (7679) Building response >Thread-19::DEBUG::2014-09-09 11:36:12,711::__init__::225::IOProcess::(_processLogs) (7679) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:12,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:12,712::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:36:12,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:13,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896799 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:13,280::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3560::DEBUG::2014-09-09 11:36:13,280::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:36:13,280::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3560::DEBUG::2014-09-09 11:36:13,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`66738222-95ae-4d26-9be3-a20330294fcb`::moving from state init -> state preparing >Thread-3560::INFO::2014-09-09 11:36:13,281::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3560::INFO::2014-09-09 11:36:13,282::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3560::DEBUG::2014-09-09 11:36:13,282::task::1191::Storage.TaskManager.Task::(prepare) Task=`66738222-95ae-4d26-9be3-a20330294fcb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3560::DEBUG::2014-09-09 11:36:13,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`66738222-95ae-4d26-9be3-a20330294fcb`::moving from state preparing -> state finished >Thread-3560::DEBUG::2014-09-09 11:36:13,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3560::DEBUG::2014-09-09 11:36:13,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3560::DEBUG::2014-09-09 11:36:13,282::task::993::Storage.TaskManager.Task::(_decref) Task=`66738222-95ae-4d26-9be3-a20330294fcb`::ref 0 aborting False >Thread-3560::DEBUG::2014-09-09 11:36:13,282::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3560::DEBUG::2014-09-09 11:36:13,282::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:13,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:13,312::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3561::DEBUG::2014-09-09 11:36:13,312::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3561::DEBUG::2014-09-09 11:36:13,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`122bd9fd-78ff-47d0-a2f8-c2e9a02f2d61`::moving from state init -> state preparing >Thread-3561::INFO::2014-09-09 11:36:13,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3561::DEBUG::2014-09-09 11:36:13,313::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1889018a-af3c-4830-b3a1-77e22380b4dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3561::DEBUG::2014-09-09 11:36:13,313::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3561::DEBUG::2014-09-09 11:36:13,313::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3561::DEBUG::2014-09-09 11:36:13,313::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1889018a-af3c-4830-b3a1-77e22380b4dc`::Granted request >Thread-3561::DEBUG::2014-09-09 11:36:13,313::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`122bd9fd-78ff-47d0-a2f8-c2e9a02f2d61`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3561::DEBUG::2014-09-09 11:36:13,313::task::993::Storage.TaskManager.Task::(_decref) Task=`122bd9fd-78ff-47d0-a2f8-c2e9a02f2d61`::ref 1 aborting False >Thread-3561::INFO::2014-09-09 11:36:13,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3561::DEBUG::2014-09-09 11:36:13,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`122bd9fd-78ff-47d0-a2f8-c2e9a02f2d61`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3561::DEBUG::2014-09-09 11:36:13,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`122bd9fd-78ff-47d0-a2f8-c2e9a02f2d61`::moving from state preparing -> state finished >Thread-3561::DEBUG::2014-09-09 11:36:13,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3561::DEBUG::2014-09-09 11:36:13,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3561::DEBUG::2014-09-09 11:36:13,315::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3561::DEBUG::2014-09-09 11:36:13,316::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3561::DEBUG::2014-09-09 11:36:13,316::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3561::DEBUG::2014-09-09 11:36:13,316::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3561::DEBUG::2014-09-09 11:36:13,316::task::993::Storage.TaskManager.Task::(_decref) Task=`122bd9fd-78ff-47d0-a2f8-c2e9a02f2d61`::ref 0 aborting False >Thread-3561::DEBUG::2014-09-09 11:36:13,316::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3561::DEBUG::2014-09-09 11:36:13,316::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:15,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:15,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899701 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:15,774::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:15,775::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3562::DEBUG::2014-09-09 11:36:15,776::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:17,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:17,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897981 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) (7680) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) (7680) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:17,845::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7680) Building response >Thread-19::DEBUG::2014-09-09 11:36:17,846::__init__::225::IOProcess::(_processLogs) (7680) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:17,846::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:17,846::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:36:17,846::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:36:17,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115685 s, 971 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) (7681) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:17,854::__init__::225::IOProcess::(_processLogs) (7681) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:17,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7681) Building response >Thread-19::DEBUG::2014-09-09 11:36:17,855::__init__::225::IOProcess::(_processLogs) (7681) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:17,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:17,855::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:18,786::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:18,787::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3563::DEBUG::2014-09-09 11:36:18,788::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:19,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:19,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0946416 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:36:21,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:21,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896906 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:21,797::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:21,798::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3564::DEBUG::2014-09-09 11:36:21,799::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:36:22,272::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,272::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) (7682) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) (7682) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:22,273::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7682) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,274::__init__::225::IOProcess::(_processLogs) (7682) Queuing response >Thread-3443::DEBUG::2014-09-09 11:36:22,274::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:36:22,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,279::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:36:22,281::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000958064 s, 371 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:22,281::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,281::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:22,281::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) (7683) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) (7683) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7683) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) (7683) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:22,282::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,283::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:22,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,711::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:22,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) (7684) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) (7684) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7684) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) (7684) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:22,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,713::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:36:22,713::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:36:22,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000974717 s, 562 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:22,720::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,720::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:22,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) (7685) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) (7685) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7685) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,721::__init__::225::IOProcess::(_processLogs) (7685) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:22,722::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,722::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:22,722::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,722::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:36:22,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) (7686) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) (7686) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) (7686) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) (7686) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,723::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:22,724::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,724::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:36:22,724::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,725::__init__::225::IOProcess::(_processLogs) (7687) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:22,725::__init__::225::IOProcess::(_processLogs) (7687) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) (7687) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) (7687) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:36:22,726::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) (7688) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) (7688) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) (7688) Building response >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) (7688) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:22,727::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:23,356::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:23,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3565::DEBUG::2014-09-09 11:36:23,357::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3565::DEBUG::2014-09-09 11:36:23,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a568603-f924-40a3-9345-49108325b492`::moving from state init -> state preparing >Thread-3565::INFO::2014-09-09 11:36:23,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3565::INFO::2014-09-09 11:36:23,358::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3565::DEBUG::2014-09-09 11:36:23,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a568603-f924-40a3-9345-49108325b492`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3565::DEBUG::2014-09-09 11:36:23,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a568603-f924-40a3-9345-49108325b492`::moving from state preparing -> state finished >Thread-3565::DEBUG::2014-09-09 11:36:23,358::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3565::DEBUG::2014-09-09 11:36:23,358::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3565::DEBUG::2014-09-09 11:36:23,358::task::993::Storage.TaskManager.Task::(_decref) Task=`1a568603-f924-40a3-9345-49108325b492`::ref 0 aborting False >Thread-3565::DEBUG::2014-09-09 11:36:23,358::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3565::DEBUG::2014-09-09 11:36:23,359::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:23,387::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:23,387::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3566::DEBUG::2014-09-09 11:36:23,387::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3566::DEBUG::2014-09-09 11:36:23,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`b704c360-a111-4ec0-88d7-b9eeea37d5c8`::moving from state init -> state preparing >Thread-3566::INFO::2014-09-09 11:36:23,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3566::DEBUG::2014-09-09 11:36:23,388::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7e6dcf86-e120-4fc3-8bc8-283b2cd7d276`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3566::DEBUG::2014-09-09 11:36:23,389::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3566::DEBUG::2014-09-09 11:36:23,389::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3566::DEBUG::2014-09-09 11:36:23,389::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7e6dcf86-e120-4fc3-8bc8-283b2cd7d276`::Granted request >Thread-3566::DEBUG::2014-09-09 11:36:23,389::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b704c360-a111-4ec0-88d7-b9eeea37d5c8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3566::DEBUG::2014-09-09 11:36:23,389::task::993::Storage.TaskManager.Task::(_decref) Task=`b704c360-a111-4ec0-88d7-b9eeea37d5c8`::ref 1 aborting False >Thread-3566::INFO::2014-09-09 11:36:23,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3566::DEBUG::2014-09-09 11:36:23,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`b704c360-a111-4ec0-88d7-b9eeea37d5c8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3566::DEBUG::2014-09-09 11:36:23,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`b704c360-a111-4ec0-88d7-b9eeea37d5c8`::moving from state preparing -> state finished >Thread-3566::DEBUG::2014-09-09 11:36:23,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3566::DEBUG::2014-09-09 11:36:23,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3566::DEBUG::2014-09-09 11:36:23,391::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3566::DEBUG::2014-09-09 11:36:23,391::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3566::DEBUG::2014-09-09 11:36:23,391::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3566::DEBUG::2014-09-09 11:36:23,391::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3566::DEBUG::2014-09-09 11:36:23,391::task::993::Storage.TaskManager.Task::(_decref) Task=`b704c360-a111-4ec0-88d7-b9eeea37d5c8`::ref 0 aborting False >Thread-3566::DEBUG::2014-09-09 11:36:23,392::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3566::DEBUG::2014-09-09 11:36:23,392::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:23,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:23,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089611 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:24,807::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:24,807::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3567::DEBUG::2014-09-09 11:36:24,808::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:25,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:25,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895306 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:36:27,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:27,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896786 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:27,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:27,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3568::DEBUG::2014-09-09 11:36:27,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`45f954ca-fe3a-48f9-a219-3ecb27192311`::moving from state init -> state preparing >Thread-3568::INFO::2014-09-09 11:36:27,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3568::INFO::2014-09-09 11:36:27,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115685', 'lastCheck': '10.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000974717', 'lastCheck': '5.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000958064', 'lastCheck': '5.5', 'valid': True}} >Thread-3568::DEBUG::2014-09-09 11:36:27,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`45f954ca-fe3a-48f9-a219-3ecb27192311`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115685', 'lastCheck': '10.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000974717', 'lastCheck': '5.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000958064', 'lastCheck': '5.5', 'valid': True}} >Thread-3568::DEBUG::2014-09-09 11:36:27,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`45f954ca-fe3a-48f9-a219-3ecb27192311`::moving from state preparing -> state finished >Thread-3568::DEBUG::2014-09-09 11:36:27,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3568::DEBUG::2014-09-09 11:36:27,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3568::DEBUG::2014-09-09 11:36:27,818::task::993::Storage.TaskManager.Task::(_decref) Task=`45f954ca-fe3a-48f9-a219-3ecb27192311`::ref 0 aborting False >Thread-3568::DEBUG::2014-09-09 11:36:27,819::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:27,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:27,831::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3569::DEBUG::2014-09-09 11:36:27,832::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:27,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:27,857::__init__::225::IOProcess::(_processLogs) (7689) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:27,857::__init__::225::IOProcess::(_processLogs) (7689) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:27,857::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7689) Building response >Thread-19::DEBUG::2014-09-09 11:36:27,857::__init__::225::IOProcess::(_processLogs) (7689) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:27,857::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:36:27,858::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:36:27,858::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:36:27,864::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107956 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:27,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:27,866::__init__::225::IOProcess::(_processLogs) (7690) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:27,866::__init__::225::IOProcess::(_processLogs) (7690) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:27,866::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7690) Building response >Thread-19::DEBUG::2014-09-09 11:36:27,866::__init__::225::IOProcess::(_processLogs) (7690) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:27,866::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:36:27,867::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:36:29,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:29,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896029 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:30,911::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:30,912::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3570::DEBUG::2014-09-09 11:36:30,913::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:31,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:32,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089661 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:32,283::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) (7691) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:32,284::__init__::225::IOProcess::(_processLogs) (7691) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:32,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7691) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,286::__init__::225::IOProcess::(_processLogs) (7691) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:36:32,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:36:32,294::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00090278 s, 393 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:32,294::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:32,294::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:32,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:32,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,294::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) (7692) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) (7692) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7692) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) (7692) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,295::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,728::__init__::225::IOProcess::(_processLogs) (7693) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:32,728::__init__::225::IOProcess::(_processLogs) (7693) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:32,728::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7693) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,728::__init__::225::IOProcess::(_processLogs) (7693) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,728::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:36:32,729::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:36:32,735::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000890434 s, 615 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) (7694) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:32,736::__init__::225::IOProcess::(_processLogs) (7694) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:32,737::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7694) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,737::__init__::225::IOProcess::(_processLogs) (7694) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,737::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) (7695) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) (7695) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) (7695) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) (7695) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) (7696) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) (7696) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) (7696) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) (7696) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:32,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) (7697) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) (7697) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) (7697) Building response >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) (7697) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:32,741::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:33,431::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:33,431::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3571::DEBUG::2014-09-09 11:36:33,431::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3571::DEBUG::2014-09-09 11:36:33,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ee25e7d-bdac-4fc8-abcc-6086b8a05396`::moving from state init -> state preparing >Thread-3571::INFO::2014-09-09 11:36:33,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3571::INFO::2014-09-09 11:36:33,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3571::DEBUG::2014-09-09 11:36:33,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ee25e7d-bdac-4fc8-abcc-6086b8a05396`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3571::DEBUG::2014-09-09 11:36:33,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ee25e7d-bdac-4fc8-abcc-6086b8a05396`::moving from state preparing -> state finished >Thread-3571::DEBUG::2014-09-09 11:36:33,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3571::DEBUG::2014-09-09 11:36:33,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3571::DEBUG::2014-09-09 11:36:33,433::task::993::Storage.TaskManager.Task::(_decref) Task=`5ee25e7d-bdac-4fc8-abcc-6086b8a05396`::ref 0 aborting False >Thread-3571::DEBUG::2014-09-09 11:36:33,433::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3571::DEBUG::2014-09-09 11:36:33,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:33,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3572::DEBUG::2014-09-09 11:36:33,464::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:36:33,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3572::DEBUG::2014-09-09 11:36:33,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`645425e6-5e25-4535-acb0-d3f255484c75`::moving from state init -> state preparing >Thread-3572::INFO::2014-09-09 11:36:33,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3572::DEBUG::2014-09-09 11:36:33,465::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`565a6d48-246c-480d-a58b-263082f4f999`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3572::DEBUG::2014-09-09 11:36:33,465::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3572::DEBUG::2014-09-09 11:36:33,465::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3572::DEBUG::2014-09-09 11:36:33,465::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`565a6d48-246c-480d-a58b-263082f4f999`::Granted request >Thread-3572::DEBUG::2014-09-09 11:36:33,466::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`645425e6-5e25-4535-acb0-d3f255484c75`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3572::DEBUG::2014-09-09 11:36:33,466::task::993::Storage.TaskManager.Task::(_decref) Task=`645425e6-5e25-4535-acb0-d3f255484c75`::ref 1 aborting False >Thread-3572::INFO::2014-09-09 11:36:33,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3572::DEBUG::2014-09-09 11:36:33,468::task::1191::Storage.TaskManager.Task::(prepare) Task=`645425e6-5e25-4535-acb0-d3f255484c75`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3572::DEBUG::2014-09-09 11:36:33,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`645425e6-5e25-4535-acb0-d3f255484c75`::moving from state preparing -> state finished >Thread-3572::DEBUG::2014-09-09 11:36:33,468::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3572::DEBUG::2014-09-09 11:36:33,468::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3572::DEBUG::2014-09-09 11:36:33,468::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3572::DEBUG::2014-09-09 11:36:33,469::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3572::DEBUG::2014-09-09 11:36:33,469::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3572::DEBUG::2014-09-09 11:36:33,469::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3572::DEBUG::2014-09-09 11:36:33,469::task::993::Storage.TaskManager.Task::(_decref) Task=`645425e6-5e25-4535-acb0-d3f255484c75`::ref 0 aborting False >Thread-3572::DEBUG::2014-09-09 11:36:33,469::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283927117824', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3572::DEBUG::2014-09-09 11:36:33,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:33,919::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:33,920::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3573::DEBUG::2014-09-09 11:36:33,920::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:34,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:34,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896741 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:36:36,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:36,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090018 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:36,928::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:36,929::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3574::DEBUG::2014-09-09 11:36:36,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:36:37,867::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:37,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:37,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:37,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:37,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:37,868::__init__::225::IOProcess::(_processLogs) (7698) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:37,868::__init__::225::IOProcess::(_processLogs) (7698) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:37,869::__init__::225::IOProcess::(_processLogs) (7698) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:37,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:36:37,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:36:37,877::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110429 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:37,877::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:37,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:37,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:37,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:37,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:37,878::__init__::225::IOProcess::(_processLogs) (7699) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:37,878::__init__::225::IOProcess::(_processLogs) (7699) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:37,878::__init__::225::IOProcess::(_processLogs) (7699) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:37,878::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:36:38,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:38,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898002 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:39,939::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:39,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3575::DEBUG::2014-09-09 11:36:39,940::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:40,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:40,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896706 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) (7700) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) (7700) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:42,297::__init__::225::IOProcess::(_processLogs) (7700) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:36:42,298::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:36:42,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000956715 s, 371 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) (7701) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) (7701) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:42,305::__init__::225::IOProcess::(_processLogs) (7701) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,306::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:36:42,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:42,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895397 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) (7702) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:42,742::__init__::225::IOProcess::(_processLogs) (7702) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:42,743::__init__::225::IOProcess::(_processLogs) (7702) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:36:42,744::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:36:42,751::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104343 s, 525 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:42,751::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) (7703) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) (7703) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:42,752::__init__::225::IOProcess::(_processLogs) (7703) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,753::__init__::225::IOProcess::(_processLogs) (7704) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:42,754::__init__::225::IOProcess::(_processLogs) (7704) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:42,754::__init__::225::IOProcess::(_processLogs) (7704) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:42,754::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:36:42,754::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) (7705) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) (7705) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) (7705) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:42,756::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:36:42,756::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:42,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:42,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) (7706) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) (7706) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) (7706) Building response >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) (7706) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:42,757::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:42,981::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:42,982::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3576::DEBUG::2014-09-09 11:36:42,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`098eab05-134e-47aa-8b5a-7a8a481f460c`::moving from state init -> state preparing >Thread-3576::INFO::2014-09-09 11:36:42,983::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3576::INFO::2014-09-09 11:36:42,983::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110429', 'lastCheck': '5.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104343', 'lastCheck': '0.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000956715', 'lastCheck': '0.7', 'valid': True}} >Thread-3576::DEBUG::2014-09-09 11:36:42,984::task::1191::Storage.TaskManager.Task::(prepare) Task=`098eab05-134e-47aa-8b5a-7a8a481f460c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110429', 'lastCheck': '5.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104343', 'lastCheck': '0.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000956715', 'lastCheck': '0.7', 'valid': True}} >Thread-3576::DEBUG::2014-09-09 11:36:42,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`098eab05-134e-47aa-8b5a-7a8a481f460c`::moving from state preparing -> state finished >Thread-3576::DEBUG::2014-09-09 11:36:42,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3576::DEBUG::2014-09-09 11:36:42,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3576::DEBUG::2014-09-09 11:36:42,984::task::993::Storage.TaskManager.Task::(_decref) Task=`098eab05-134e-47aa-8b5a-7a8a481f460c`::ref 0 aborting False >Thread-3576::DEBUG::2014-09-09 11:36:42,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:42,991::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:42,992::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3577::DEBUG::2014-09-09 11:36:42,992::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:43,508::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:43,508::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3578::DEBUG::2014-09-09 11:36:43,508::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3578::DEBUG::2014-09-09 11:36:43,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac752d4-f298-4279-9445-e0bf5417d1b2`::moving from state init -> state preparing >Thread-3578::INFO::2014-09-09 11:36:43,509::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3578::INFO::2014-09-09 11:36:43,509::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3578::DEBUG::2014-09-09 11:36:43,509::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ac752d4-f298-4279-9445-e0bf5417d1b2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3578::DEBUG::2014-09-09 11:36:43,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac752d4-f298-4279-9445-e0bf5417d1b2`::moving from state preparing -> state finished >Thread-3578::DEBUG::2014-09-09 11:36:43,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3578::DEBUG::2014-09-09 11:36:43,510::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3578::DEBUG::2014-09-09 11:36:43,510::task::993::Storage.TaskManager.Task::(_decref) Task=`4ac752d4-f298-4279-9445-e0bf5417d1b2`::ref 0 aborting False >Thread-3578::DEBUG::2014-09-09 11:36:43,510::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3578::DEBUG::2014-09-09 11:36:43,510::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:43,539::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:43,539::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3579::DEBUG::2014-09-09 11:36:43,539::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3579::DEBUG::2014-09-09 11:36:43,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`505c85be-35ef-4997-b214-1d331b139947`::moving from state init -> state preparing >Thread-3579::INFO::2014-09-09 11:36:43,540::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3579::DEBUG::2014-09-09 11:36:43,541::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b5036eea-100a-4828-99ba-73474fb7e087`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3579::DEBUG::2014-09-09 11:36:43,541::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3579::DEBUG::2014-09-09 11:36:43,541::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3579::DEBUG::2014-09-09 11:36:43,541::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b5036eea-100a-4828-99ba-73474fb7e087`::Granted request >Thread-3579::DEBUG::2014-09-09 11:36:43,542::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`505c85be-35ef-4997-b214-1d331b139947`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3579::DEBUG::2014-09-09 11:36:43,542::task::993::Storage.TaskManager.Task::(_decref) Task=`505c85be-35ef-4997-b214-1d331b139947`::ref 1 aborting False >Thread-3579::INFO::2014-09-09 11:36:43,544::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3579::DEBUG::2014-09-09 11:36:43,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`505c85be-35ef-4997-b214-1d331b139947`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3579::DEBUG::2014-09-09 11:36:43,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`505c85be-35ef-4997-b214-1d331b139947`::moving from state preparing -> state finished >Thread-3579::DEBUG::2014-09-09 11:36:43,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3579::DEBUG::2014-09-09 11:36:43,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3579::DEBUG::2014-09-09 11:36:43,544::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3579::DEBUG::2014-09-09 11:36:43,544::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3579::DEBUG::2014-09-09 11:36:43,544::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3579::DEBUG::2014-09-09 11:36:43,544::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3579::DEBUG::2014-09-09 11:36:43,544::task::993::Storage.TaskManager.Task::(_decref) Task=`505c85be-35ef-4997-b214-1d331b139947`::ref 0 aborting False >Thread-3579::DEBUG::2014-09-09 11:36:43,545::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3579::DEBUG::2014-09-09 11:36:43,545::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:44,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:44,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896044 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:46,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:46,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3580::DEBUG::2014-09-09 11:36:46,039::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:46,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:46,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895115 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:47,879::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:47,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:47,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:47,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:47,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:47,880::__init__::225::IOProcess::(_processLogs) (7707) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:47,880::__init__::225::IOProcess::(_processLogs) (7707) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:47,880::__init__::225::IOProcess::(_processLogs) (7707) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:47,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:36:47,881::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:36:47,887::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119669 s, 938 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) (7708) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) (7708) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:47,888::__init__::225::IOProcess::(_processLogs) (7708) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:47,889::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:36:48,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:48,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897413 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:49,047::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:49,048::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3581::DEBUG::2014-09-09 11:36:49,049::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:50,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:50,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895681 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:52,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:52,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3582::DEBUG::2014-09-09 11:36:52,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:36:52,306::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) (7709) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) (7709) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) (7709) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:36:52,308::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:36:52,314::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000851488 s, 417 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:52,314::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:36:52,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,315::__init__::225::IOProcess::(_processLogs) (7710) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:52,315::__init__::225::IOProcess::(_processLogs) (7710) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:52,315::__init__::225::IOProcess::(_processLogs) (7710) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) (7711) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:52,757::__init__::225::IOProcess::(_processLogs) (7711) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:52,758::__init__::225::IOProcess::(_processLogs) (7711) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:36:52,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:36:52,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101763 s, 539 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:52,766::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:36:52,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,767::__init__::225::IOProcess::(_processLogs) (7712) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:52,767::__init__::225::IOProcess::(_processLogs) (7712) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:52,767::__init__::225::IOProcess::(_processLogs) (7712) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,767::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:36:52,768::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:36:52,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,768::__init__::225::IOProcess::(_processLogs) (7713) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) (7713) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) (7713) Building response >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) (7713) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) (7714) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) (7714) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) (7714) Building response >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) (7714) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:52,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:52,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:52,771::__init__::225::IOProcess::(_processLogs) (7715) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:36:52,771::__init__::225::IOProcess::(_processLogs) (7715) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:36:52,771::__init__::225::IOProcess::(_processLogs) (7715) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:52,771::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:36:52,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:53,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896049 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:53,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:53,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3583::DEBUG::2014-09-09 11:36:53,583::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3583::DEBUG::2014-09-09 11:36:53,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`1940e890-f25e-4c2e-a4c8-94c92bdacb7e`::moving from state init -> state preparing >Thread-3583::INFO::2014-09-09 11:36:53,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3583::INFO::2014-09-09 11:36:53,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3583::DEBUG::2014-09-09 11:36:53,585::task::1191::Storage.TaskManager.Task::(prepare) Task=`1940e890-f25e-4c2e-a4c8-94c92bdacb7e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3583::DEBUG::2014-09-09 11:36:53,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`1940e890-f25e-4c2e-a4c8-94c92bdacb7e`::moving from state preparing -> state finished >Thread-3583::DEBUG::2014-09-09 11:36:53,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3583::DEBUG::2014-09-09 11:36:53,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3583::DEBUG::2014-09-09 11:36:53,585::task::993::Storage.TaskManager.Task::(_decref) Task=`1940e890-f25e-4c2e-a4c8-94c92bdacb7e`::ref 0 aborting False >Thread-3583::DEBUG::2014-09-09 11:36:53,585::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3583::DEBUG::2014-09-09 11:36:53,585::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:53,615::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3584::DEBUG::2014-09-09 11:36:53,615::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:36:53,615::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3584::DEBUG::2014-09-09 11:36:53,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`1beb12c6-2ebc-4586-9e33-e6fc6db1b3cc`::moving from state init -> state preparing >Thread-3584::INFO::2014-09-09 11:36:53,616::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3584::DEBUG::2014-09-09 11:36:53,616::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cc1aa5f2-7e86-44b0-ae80-d6aabdd8331c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3584::DEBUG::2014-09-09 11:36:53,617::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3584::DEBUG::2014-09-09 11:36:53,617::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3584::DEBUG::2014-09-09 11:36:53,617::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cc1aa5f2-7e86-44b0-ae80-d6aabdd8331c`::Granted request >Thread-3584::DEBUG::2014-09-09 11:36:53,617::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1beb12c6-2ebc-4586-9e33-e6fc6db1b3cc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3584::DEBUG::2014-09-09 11:36:53,617::task::993::Storage.TaskManager.Task::(_decref) Task=`1beb12c6-2ebc-4586-9e33-e6fc6db1b3cc`::ref 1 aborting False >Thread-3584::INFO::2014-09-09 11:36:53,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3584::DEBUG::2014-09-09 11:36:53,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`1beb12c6-2ebc-4586-9e33-e6fc6db1b3cc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3584::DEBUG::2014-09-09 11:36:53,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`1beb12c6-2ebc-4586-9e33-e6fc6db1b3cc`::moving from state preparing -> state finished >Thread-3584::DEBUG::2014-09-09 11:36:53,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3584::DEBUG::2014-09-09 11:36:53,619::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3584::DEBUG::2014-09-09 11:36:53,619::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3584::DEBUG::2014-09-09 11:36:53,619::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3584::DEBUG::2014-09-09 11:36:53,619::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3584::DEBUG::2014-09-09 11:36:53,619::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3584::DEBUG::2014-09-09 11:36:53,620::task::993::Storage.TaskManager.Task::(_decref) Task=`1beb12c6-2ebc-4586-9e33-e6fc6db1b3cc`::ref 0 aborting False >Thread-3584::DEBUG::2014-09-09 11:36:53,620::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3584::DEBUG::2014-09-09 11:36:53,620::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:55,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:55,064::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:55,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3585::DEBUG::2014-09-09 11:36:55,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:55,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898652 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:36:57,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:57,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896156 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:57,889::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) (7716) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) (7716) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) (7716) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:57,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:36:57,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:36:57,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00126682 s, 886 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) (7717) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:36:57,899::__init__::225::IOProcess::(_processLogs) (7717) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:36:57,900::__init__::225::IOProcess::(_processLogs) (7717) Queuing response >Thread-19::DEBUG::2014-09-09 11:36:57,900::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:58,072::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:58,073::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3586::DEBUG::2014-09-09 11:36:58,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`c757549a-13f3-4845-9214-829bc466c58b`::moving from state init -> state preparing >Thread-3586::INFO::2014-09-09 11:36:58,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3586::INFO::2014-09-09 11:36:58,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00126682', 'lastCheck': '0.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101763', 'lastCheck': '5.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000851488', 'lastCheck': '5.8', 'valid': True}} >Thread-3586::DEBUG::2014-09-09 11:36:58,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`c757549a-13f3-4845-9214-829bc466c58b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00126682', 'lastCheck': '0.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101763', 'lastCheck': '5.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000851488', 'lastCheck': '5.8', 'valid': True}} >Thread-3586::DEBUG::2014-09-09 11:36:58,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`c757549a-13f3-4845-9214-829bc466c58b`::moving from state preparing -> state finished >Thread-3586::DEBUG::2014-09-09 11:36:58,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3586::DEBUG::2014-09-09 11:36:58,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3586::DEBUG::2014-09-09 11:36:58,074::task::993::Storage.TaskManager.Task::(_decref) Task=`c757549a-13f3-4845-9214-829bc466c58b`::ref 0 aborting False >Thread-3586::DEBUG::2014-09-09 11:36:58,075::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:36:58,082::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:36:58,083::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3587::DEBUG::2014-09-09 11:36:58,084::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:36:59,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:36:59,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089608 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:01,165::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:01,166::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3588::DEBUG::2014-09-09 11:37:01,167::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:01,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:01,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906853 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:02,316::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:02,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:02,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:02,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,317::__init__::225::IOProcess::(_processLogs) (7718) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:02,317::__init__::225::IOProcess::(_processLogs) (7718) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:02,317::__init__::225::IOProcess::(_processLogs) (7718) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:37:02,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:37:02,324::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000947793 s, 375 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) (7719) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:02,325::__init__::225::IOProcess::(_processLogs) (7719) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:02,326::__init__::225::IOProcess::(_processLogs) (7719) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,326::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:02,772::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:02,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:02,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:02,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,772::__init__::225::IOProcess::(_processLogs) (7720) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:02,773::__init__::225::IOProcess::(_processLogs) (7720) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:02,773::__init__::225::IOProcess::(_processLogs) (7720) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:37:02,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:37:02,780::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000991095 s, 553 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) (7721) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:02,781::__init__::225::IOProcess::(_processLogs) (7721) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:02,782::__init__::225::IOProcess::(_processLogs) (7721) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) (7722) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:02,783::__init__::225::IOProcess::(_processLogs) (7722) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) (7722) Building response >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) (7722) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) (7723) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) (7723) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) (7723) Building response >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) (7723) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:37:02,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) (7724) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) (7724) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) (7724) Building response >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) (7724) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:02,786::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:37:03,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:03,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898871 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:03,660::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:03,661::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3589::DEBUG::2014-09-09 11:37:03,661::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3589::DEBUG::2014-09-09 11:37:03,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`473acff0-7563-41b9-8717-9f9aa653502c`::moving from state init -> state preparing >Thread-3589::INFO::2014-09-09 11:37:03,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3589::INFO::2014-09-09 11:37:03,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3589::DEBUG::2014-09-09 11:37:03,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`473acff0-7563-41b9-8717-9f9aa653502c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3589::DEBUG::2014-09-09 11:37:03,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`473acff0-7563-41b9-8717-9f9aa653502c`::moving from state preparing -> state finished >Thread-3589::DEBUG::2014-09-09 11:37:03,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3589::DEBUG::2014-09-09 11:37:03,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3589::DEBUG::2014-09-09 11:37:03,662::task::993::Storage.TaskManager.Task::(_decref) Task=`473acff0-7563-41b9-8717-9f9aa653502c`::ref 0 aborting False >Thread-3589::DEBUG::2014-09-09 11:37:03,662::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3589::DEBUG::2014-09-09 11:37:03,663::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:03,733::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:03,733::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3590::DEBUG::2014-09-09 11:37:03,733::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3590::DEBUG::2014-09-09 11:37:03,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`074454e7-b80d-4dcc-95e4-d9c3c0d3114d`::moving from state init -> state preparing >Thread-3590::INFO::2014-09-09 11:37:03,734::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3590::DEBUG::2014-09-09 11:37:03,734::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b834d4b2-f7ac-4e46-b83c-ec0d24a096ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3590::DEBUG::2014-09-09 11:37:03,734::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3590::DEBUG::2014-09-09 11:37:03,735::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3590::DEBUG::2014-09-09 11:37:03,735::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b834d4b2-f7ac-4e46-b83c-ec0d24a096ad`::Granted request >Thread-3590::DEBUG::2014-09-09 11:37:03,735::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`074454e7-b80d-4dcc-95e4-d9c3c0d3114d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3590::DEBUG::2014-09-09 11:37:03,735::task::993::Storage.TaskManager.Task::(_decref) Task=`074454e7-b80d-4dcc-95e4-d9c3c0d3114d`::ref 1 aborting False >Thread-3590::INFO::2014-09-09 11:37:03,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3590::DEBUG::2014-09-09 11:37:03,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`074454e7-b80d-4dcc-95e4-d9c3c0d3114d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3590::DEBUG::2014-09-09 11:37:03,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`074454e7-b80d-4dcc-95e4-d9c3c0d3114d`::moving from state preparing -> state finished >Thread-3590::DEBUG::2014-09-09 11:37:03,737::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3590::DEBUG::2014-09-09 11:37:03,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3590::DEBUG::2014-09-09 11:37:03,737::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3590::DEBUG::2014-09-09 11:37:03,737::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3590::DEBUG::2014-09-09 11:37:03,737::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3590::DEBUG::2014-09-09 11:37:03,737::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3590::DEBUG::2014-09-09 11:37:03,738::task::993::Storage.TaskManager.Task::(_decref) Task=`074454e7-b80d-4dcc-95e4-d9c3c0d3114d`::ref 0 aborting False >Thread-3590::DEBUG::2014-09-09 11:37:03,738::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3590::DEBUG::2014-09-09 11:37:03,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:04,175::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:04,176::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3591::DEBUG::2014-09-09 11:37:04,176::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:05,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:05,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897267 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:07,184::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:07,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3592::DEBUG::2014-09-09 11:37:07,185::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:07,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:07,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896889 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) (7725) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:07,901::__init__::225::IOProcess::(_processLogs) (7725) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:07,902::__init__::225::IOProcess::(_processLogs) (7725) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:07,903::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:37:07,903::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:37:07,910::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116313 s, 965 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) (7726) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:07,911::__init__::225::IOProcess::(_processLogs) (7726) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:07,912::__init__::225::IOProcess::(_processLogs) (7726) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:07,912::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:37:09,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:09,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897533 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:10,194::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:10,195::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3593::DEBUG::2014-09-09 11:37:10,196::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:11,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:11,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896951 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) (7727) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:12,327::__init__::225::IOProcess::(_processLogs) (7727) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:12,328::__init__::225::IOProcess::(_processLogs) (7727) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:37:12,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:37:12,335::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00104728 s, 339 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) (7728) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:12,336::__init__::225::IOProcess::(_processLogs) (7728) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:12,337::__init__::225::IOProcess::(_processLogs) (7728) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:12,786::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:12,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:12,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,787::__init__::225::IOProcess::(_processLogs) (7729) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:12,787::__init__::225::IOProcess::(_processLogs) (7729) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:12,788::__init__::225::IOProcess::(_processLogs) (7729) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:37:12,788::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:37:12,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100486 s, 545 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) (7730) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:12,798::__init__::225::IOProcess::(_processLogs) (7730) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:12,799::__init__::225::IOProcess::(_processLogs) (7730) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,799::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:12,799::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:12,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) (7731) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) (7731) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) (7731) Building response >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) (7731) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:37:12,801::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) (7732) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) (7732) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) (7732) Building response >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) (7732) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:12,802::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:12,803::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:12,803::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:37:12,803::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:12,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:12,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:12,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) (7733) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) (7733) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) (7733) Building response >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) (7733) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:12,804::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:13,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:13,206::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3594::DEBUG::2014-09-09 11:37:13,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`34b6c1e5-97e7-4f51-836d-9e5bd50e7021`::moving from state init -> state preparing >Thread-3594::INFO::2014-09-09 11:37:13,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3594::INFO::2014-09-09 11:37:13,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116313', 'lastCheck': '5.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100486', 'lastCheck': '0.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104728', 'lastCheck': '0.9', 'valid': True}} >Thread-3594::DEBUG::2014-09-09 11:37:13,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`34b6c1e5-97e7-4f51-836d-9e5bd50e7021`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116313', 'lastCheck': '5.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100486', 'lastCheck': '0.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104728', 'lastCheck': '0.9', 'valid': True}} >Thread-3594::DEBUG::2014-09-09 11:37:13,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`34b6c1e5-97e7-4f51-836d-9e5bd50e7021`::moving from state preparing -> state finished >Thread-3594::DEBUG::2014-09-09 11:37:13,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3594::DEBUG::2014-09-09 11:37:13,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3594::DEBUG::2014-09-09 11:37:13,208::task::993::Storage.TaskManager.Task::(_decref) Task=`34b6c1e5-97e7-4f51-836d-9e5bd50e7021`::ref 0 aborting False >Thread-3594::DEBUG::2014-09-09 11:37:13,209::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:13,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:13,220::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3595::DEBUG::2014-09-09 11:37:13,221::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:13,778::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:13,778::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3596::DEBUG::2014-09-09 11:37:13,778::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3596::DEBUG::2014-09-09 11:37:13,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d433a3-e3d0-4838-ad90-20c82606b5a5`::moving from state init -> state preparing >Thread-3596::INFO::2014-09-09 11:37:13,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3596::INFO::2014-09-09 11:37:13,780::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3596::DEBUG::2014-09-09 11:37:13,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8d433a3-e3d0-4838-ad90-20c82606b5a5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3596::DEBUG::2014-09-09 11:37:13,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8d433a3-e3d0-4838-ad90-20c82606b5a5`::moving from state preparing -> state finished >Thread-3596::DEBUG::2014-09-09 11:37:13,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3596::DEBUG::2014-09-09 11:37:13,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3596::DEBUG::2014-09-09 11:37:13,780::task::993::Storage.TaskManager.Task::(_decref) Task=`c8d433a3-e3d0-4838-ad90-20c82606b5a5`::ref 0 aborting False >Thread-3596::DEBUG::2014-09-09 11:37:13,780::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3596::DEBUG::2014-09-09 11:37:13,780::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:13,808::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3597::DEBUG::2014-09-09 11:37:13,809::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:37:13,809::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3597::DEBUG::2014-09-09 11:37:13,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a63a059-1093-411e-bb0c-0592a81e551a`::moving from state init -> state preparing >Thread-3597::INFO::2014-09-09 11:37:13,810::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3597::DEBUG::2014-09-09 11:37:13,810::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2fdcb4a8-9cf5-4982-923d-3b666b86a9ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3597::DEBUG::2014-09-09 11:37:13,810::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3597::DEBUG::2014-09-09 11:37:13,810::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3597::DEBUG::2014-09-09 11:37:13,810::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2fdcb4a8-9cf5-4982-923d-3b666b86a9ec`::Granted request >Thread-3597::DEBUG::2014-09-09 11:37:13,810::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2a63a059-1093-411e-bb0c-0592a81e551a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3597::DEBUG::2014-09-09 11:37:13,811::task::993::Storage.TaskManager.Task::(_decref) Task=`2a63a059-1093-411e-bb0c-0592a81e551a`::ref 1 aborting False >Thread-3597::INFO::2014-09-09 11:37:13,812::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3597::DEBUG::2014-09-09 11:37:13,812::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a63a059-1093-411e-bb0c-0592a81e551a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3597::DEBUG::2014-09-09 11:37:13,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a63a059-1093-411e-bb0c-0592a81e551a`::moving from state preparing -> state finished >Thread-3597::DEBUG::2014-09-09 11:37:13,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3597::DEBUG::2014-09-09 11:37:13,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3597::DEBUG::2014-09-09 11:37:13,813::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3597::DEBUG::2014-09-09 11:37:13,813::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3597::DEBUG::2014-09-09 11:37:13,813::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3597::DEBUG::2014-09-09 11:37:13,813::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3597::DEBUG::2014-09-09 11:37:13,813::task::993::Storage.TaskManager.Task::(_decref) Task=`2a63a059-1093-411e-bb0c-0592a81e551a`::ref 0 aborting False >Thread-3597::DEBUG::2014-09-09 11:37:13,813::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3597::DEBUG::2014-09-09 11:37:13,813::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:13,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:14,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897941 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:37:16,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:16,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897087 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:16,298::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:16,299::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3598::DEBUG::2014-09-09 11:37:16,300::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:37:17,913::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:17,913::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:17,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:17,913::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:17,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:17,913::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:17,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:17,914::__init__::225::IOProcess::(_processLogs) (7734) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:17,914::__init__::225::IOProcess::(_processLogs) (7734) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:17,914::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7734) Building response >Thread-23::DEBUG::2014-09-09 11:37:17,914::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:37:17,915::__init__::225::IOProcess::(_processLogs) (7734) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:17,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:17,920::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:37:17,921::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110306 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:17,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:17,923::__init__::225::IOProcess::(_processLogs) (7735) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:17,923::__init__::225::IOProcess::(_processLogs) (7735) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:17,923::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(7735) Building response >Thread-19::DEBUG::2014-09-09 11:37:17,923::__init__::225::IOProcess::(_processLogs) (7735) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:17,923::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:17,924::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:37:18,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:18,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897181 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:19,310::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:19,311::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3599::DEBUG::2014-09-09 11:37:19,314::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:20,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:20,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896158 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:22,326::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:22,326::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3600::DEBUG::2014-09-09 11:37:22,327::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) (7736) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:22,338::__init__::225::IOProcess::(_processLogs) (7736) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:22,339::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(7736) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,339::__init__::225::IOProcess::(_processLogs) (7736) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,339::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:37:22,339::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:37:22,339::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:37:22,346::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0009027 s, 393 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:22,346::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,346::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) (7737) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) (7737) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) DEBUG|(7737) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,347::__init__::225::IOProcess::(_processLogs) (7737) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,348::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:22,348::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:37:22,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:22,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896236 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,804::__init__::225::IOProcess::(_processLogs) (7738) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:22,805::__init__::225::IOProcess::(_processLogs) (7738) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:22,805::__init__::225::IOProcess::(_processLogs) DEBUG|(7738) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,805::__init__::225::IOProcess::(_processLogs) (7738) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:22,805::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:37:22,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:37:22,812::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000978171 s, 560 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:22,813::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,813::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:22,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,813::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) (7739) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) (7739) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) DEBUG|(7739) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) (7739) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:22,814::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:22,815::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,815::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:37:22,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,815::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) (7740) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) (7740) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) (7740) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) (7740) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:22,816::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,817::__init__::225::IOProcess::(_processLogs) (7741) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) (7741) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) (7741) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) (7741) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:37:22,818::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) (7742) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) (7742) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) (7742) Building response >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) (7742) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:22,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:22,820::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:23,853::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:23,854::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3601::DEBUG::2014-09-09 11:37:23,854::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3601::DEBUG::2014-09-09 11:37:23,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f2137e1-f164-40bc-8281-83e057555040`::moving from state init -> state preparing >Thread-3601::INFO::2014-09-09 11:37:23,855::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3601::INFO::2014-09-09 11:37:23,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3601::DEBUG::2014-09-09 11:37:23,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f2137e1-f164-40bc-8281-83e057555040`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3601::DEBUG::2014-09-09 11:37:23,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f2137e1-f164-40bc-8281-83e057555040`::moving from state preparing -> state finished >Thread-3601::DEBUG::2014-09-09 11:37:23,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3601::DEBUG::2014-09-09 11:37:23,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3601::DEBUG::2014-09-09 11:37:23,855::task::993::Storage.TaskManager.Task::(_decref) Task=`5f2137e1-f164-40bc-8281-83e057555040`::ref 0 aborting False >Thread-3601::DEBUG::2014-09-09 11:37:23,856::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3601::DEBUG::2014-09-09 11:37:23,856::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:23,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3602::DEBUG::2014-09-09 11:37:23,884::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:37:23,884::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3602::DEBUG::2014-09-09 11:37:23,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`d295b319-ab58-4cea-8c30-f4f5c7ad918c`::moving from state init -> state preparing >Thread-3602::INFO::2014-09-09 11:37:23,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3602::DEBUG::2014-09-09 11:37:23,886::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f13575d8-2588-402c-8c51-97b36b504e1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3602::DEBUG::2014-09-09 11:37:23,886::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3602::DEBUG::2014-09-09 11:37:23,886::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3602::DEBUG::2014-09-09 11:37:23,886::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f13575d8-2588-402c-8c51-97b36b504e1a`::Granted request >Thread-3602::DEBUG::2014-09-09 11:37:23,886::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d295b319-ab58-4cea-8c30-f4f5c7ad918c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3602::DEBUG::2014-09-09 11:37:23,886::task::993::Storage.TaskManager.Task::(_decref) Task=`d295b319-ab58-4cea-8c30-f4f5c7ad918c`::ref 1 aborting False >Thread-3602::INFO::2014-09-09 11:37:23,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3602::DEBUG::2014-09-09 11:37:23,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`d295b319-ab58-4cea-8c30-f4f5c7ad918c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3602::DEBUG::2014-09-09 11:37:23,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`d295b319-ab58-4cea-8c30-f4f5c7ad918c`::moving from state preparing -> state finished >Thread-3602::DEBUG::2014-09-09 11:37:23,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3602::DEBUG::2014-09-09 11:37:23,888::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3602::DEBUG::2014-09-09 11:37:23,888::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3602::DEBUG::2014-09-09 11:37:23,888::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3602::DEBUG::2014-09-09 11:37:23,888::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3602::DEBUG::2014-09-09 11:37:23,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3602::DEBUG::2014-09-09 11:37:23,889::task::993::Storage.TaskManager.Task::(_decref) Task=`d295b319-ab58-4cea-8c30-f4f5c7ad918c`::ref 0 aborting False >Thread-3602::DEBUG::2014-09-09 11:37:23,889::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3602::DEBUG::2014-09-09 11:37:23,889::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:24,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:24,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895392 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:25,335::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:25,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3603::DEBUG::2014-09-09 11:37:25,337::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:26,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:26,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08974 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:27,924::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) (7743) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) (7743) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) DEBUG|(7743) Building response >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) (7743) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:27,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:27,926::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:37:27,926::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:37:27,933::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119165 s, 942 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:27,933::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:27,933::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:27,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:27,933::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) (7744) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) (7744) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) DEBUG|(7744) Building response >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) (7744) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:27,934::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:27,935::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:28,343::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:28,343::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3604::DEBUG::2014-09-09 11:37:28,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`331c1320-354e-44c4-b875-5df402e64d84`::moving from state init -> state preparing >Thread-3604::INFO::2014-09-09 11:37:28,344::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3604::INFO::2014-09-09 11:37:28,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119165', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000978171', 'lastCheck': '5.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009027', 'lastCheck': '6.0', 'valid': True}} >Thread-3604::DEBUG::2014-09-09 11:37:28,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`331c1320-354e-44c4-b875-5df402e64d84`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119165', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000978171', 'lastCheck': '5.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009027', 'lastCheck': '6.0', 'valid': True}} >Thread-3604::DEBUG::2014-09-09 11:37:28,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`331c1320-354e-44c4-b875-5df402e64d84`::moving from state preparing -> state finished >Thread-3604::DEBUG::2014-09-09 11:37:28,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3604::DEBUG::2014-09-09 11:37:28,345::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3604::DEBUG::2014-09-09 11:37:28,345::task::993::Storage.TaskManager.Task::(_decref) Task=`331c1320-354e-44c4-b875-5df402e64d84`::ref 0 aborting False >Thread-3604::DEBUG::2014-09-09 11:37:28,346::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:28,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:28,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3605::DEBUG::2014-09-09 11:37:28,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:28,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:28,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089651 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:37:30,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:30,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894876 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:31,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:31,417::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3606::DEBUG::2014-09-09 11:37:31,418::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) (7745) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:32,349::__init__::225::IOProcess::(_processLogs) (7745) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:32,351::__init__::225::IOProcess::(_processLogs) DEBUG|(7745) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,351::__init__::225::IOProcess::(_processLogs) (7745) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,351::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:32,351::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:37:32,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:37:32,359::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000865366 s, 410 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:32,359::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,359::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:32,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) (7746) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) (7746) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) DEBUG|(7746) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,360::__init__::225::IOProcess::(_processLogs) (7746) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,361::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:32,361::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:32,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,819::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:32,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) (7747) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) (7747) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) DEBUG|(7747) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,820::__init__::225::IOProcess::(_processLogs) (7747) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:37:32,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:37:32,821::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:37:32,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000923778 s, 593 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) (7747) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,830::__init__::225::IOProcess::(_processLogs) (7748) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:32,830::__init__::225::IOProcess::(_processLogs) (7748) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:32,830::__init__::225::IOProcess::(_processLogs) DEBUG|(7748) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,830::__init__::225::IOProcess::(_processLogs) (7748) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) (7749) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) (7749) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) (7749) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) (7749) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:37:32,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) (7750) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) (7750) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) (7750) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) (7750) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:32,834::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:32,834::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:32,834::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:37:32,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:32,834::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) (7751) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) (7751) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) (7751) Building response >Thread-19::DEBUG::2014-09-09 11:37:32,835::__init__::225::IOProcess::(_processLogs) (7751) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:32,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:32,836::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:37:32,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:33,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895968 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:33,927::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:33,928::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3607::DEBUG::2014-09-09 11:37:33,928::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3607::DEBUG::2014-09-09 11:37:33,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`557bf90b-2ccc-49f0-a347-6f36942f755e`::moving from state init -> state preparing >Thread-3607::INFO::2014-09-09 11:37:33,929::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3607::INFO::2014-09-09 11:37:33,929::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3607::DEBUG::2014-09-09 11:37:33,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`557bf90b-2ccc-49f0-a347-6f36942f755e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3607::DEBUG::2014-09-09 11:37:33,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`557bf90b-2ccc-49f0-a347-6f36942f755e`::moving from state preparing -> state finished >Thread-3607::DEBUG::2014-09-09 11:37:33,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3607::DEBUG::2014-09-09 11:37:33,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3607::DEBUG::2014-09-09 11:37:33,930::task::993::Storage.TaskManager.Task::(_decref) Task=`557bf90b-2ccc-49f0-a347-6f36942f755e`::ref 0 aborting False >Thread-3607::DEBUG::2014-09-09 11:37:33,930::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3607::DEBUG::2014-09-09 11:37:33,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:33,961::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3608::DEBUG::2014-09-09 11:37:33,962::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:37:33,962::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3608::DEBUG::2014-09-09 11:37:33,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`7df8841e-72ed-40b9-8248-9d5520f67893`::moving from state init -> state preparing >Thread-3608::INFO::2014-09-09 11:37:33,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3608::DEBUG::2014-09-09 11:37:33,963::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`11defb0a-b0ae-458f-9dc6-6af30a716fe2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3608::DEBUG::2014-09-09 11:37:33,963::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3608::DEBUG::2014-09-09 11:37:33,963::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3608::DEBUG::2014-09-09 11:37:33,964::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`11defb0a-b0ae-458f-9dc6-6af30a716fe2`::Granted request >Thread-3608::DEBUG::2014-09-09 11:37:33,964::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7df8841e-72ed-40b9-8248-9d5520f67893`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3608::DEBUG::2014-09-09 11:37:33,964::task::993::Storage.TaskManager.Task::(_decref) Task=`7df8841e-72ed-40b9-8248-9d5520f67893`::ref 1 aborting False >Thread-3608::INFO::2014-09-09 11:37:33,965::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3608::DEBUG::2014-09-09 11:37:33,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`7df8841e-72ed-40b9-8248-9d5520f67893`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3608::DEBUG::2014-09-09 11:37:33,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`7df8841e-72ed-40b9-8248-9d5520f67893`::moving from state preparing -> state finished >Thread-3608::DEBUG::2014-09-09 11:37:33,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3608::DEBUG::2014-09-09 11:37:33,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3608::DEBUG::2014-09-09 11:37:33,966::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3608::DEBUG::2014-09-09 11:37:33,966::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3608::DEBUG::2014-09-09 11:37:33,966::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3608::DEBUG::2014-09-09 11:37:33,966::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3608::DEBUG::2014-09-09 11:37:33,966::task::993::Storage.TaskManager.Task::(_decref) Task=`7df8841e-72ed-40b9-8248-9d5520f67893`::ref 0 aborting False >Thread-3608::DEBUG::2014-09-09 11:37:33,967::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3608::DEBUG::2014-09-09 11:37:33,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:34,423::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:34,423::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3609::DEBUG::2014-09-09 11:37:34,424::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:35,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:35,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895913 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:37:37,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:37,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08956 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:37,429::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:37,430::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3610::DEBUG::2014-09-09 11:37:37,431::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:37:37,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) (7752) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:37,936::__init__::225::IOProcess::(_processLogs) (7752) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:37,937::__init__::225::IOProcess::(_processLogs) (7752) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:37,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:37:37,937::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:37:37,945::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117201 s, 958 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:37,945::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:37,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:37,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:37,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:37,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:37,946::__init__::225::IOProcess::(_processLogs) (7753) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:37,946::__init__::225::IOProcess::(_processLogs) (7753) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:37,946::__init__::225::IOProcess::(_processLogs) (7753) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:37,946::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:37:39,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:39,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895715 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:40,438::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:40,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3611::DEBUG::2014-09-09 11:37:40,439::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:41,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:41,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897447 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) (7754) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:42,362::__init__::225::IOProcess::(_processLogs) (7754) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:42,363::__init__::225::IOProcess::(_processLogs) (7754) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:37:42,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:37:42,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000923144 s, 385 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) (7755) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:42,370::__init__::225::IOProcess::(_processLogs) (7755) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:42,371::__init__::225::IOProcess::(_processLogs) (7755) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,371::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) (7756) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:42,835::__init__::225::IOProcess::(_processLogs) (7756) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:42,836::__init__::225::IOProcess::(_processLogs) (7756) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,836::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:37:42,838::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:37:42,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000898772 s, 610 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:42,845::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:42,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:42,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:42,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,845::__init__::225::IOProcess::(_processLogs) (7757) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:42,846::__init__::225::IOProcess::(_processLogs) (7757) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:42,846::__init__::225::IOProcess::(_processLogs) (7757) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,846::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) (7758) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) (7758) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:42,847::__init__::225::IOProcess::(_processLogs) (7758) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) (7759) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:42,848::__init__::225::IOProcess::(_processLogs) (7759) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:42,849::__init__::225::IOProcess::(_processLogs) (7759) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,849::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:42,849::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:37:42,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) (7760) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) (7760) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) (7760) Building response >Thread-19::DEBUG::2014-09-09 11:37:42,850::__init__::225::IOProcess::(_processLogs) (7760) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:42,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:42,851::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:37:43,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:43,488::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:43,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3612::DEBUG::2014-09-09 11:37:43,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b56ae09-0d9b-4f06-99fc-687a04a58259`::moving from state init -> state preparing >Thread-3612::INFO::2014-09-09 11:37:43,490::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3612::INFO::2014-09-09 11:37:43,490::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117201', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000898772', 'lastCheck': '0.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000923144', 'lastCheck': '1.1', 'valid': True}} >Thread-3612::DEBUG::2014-09-09 11:37:43,490::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b56ae09-0d9b-4f06-99fc-687a04a58259`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117201', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000898772', 'lastCheck': '0.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000923144', 'lastCheck': '1.1', 'valid': True}} >Thread-3612::DEBUG::2014-09-09 11:37:43,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b56ae09-0d9b-4f06-99fc-687a04a58259`::moving from state preparing -> state finished >Thread-3612::DEBUG::2014-09-09 11:37:43,490::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3612::DEBUG::2014-09-09 11:37:43,490::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3612::DEBUG::2014-09-09 11:37:43,491::task::993::Storage.TaskManager.Task::(_decref) Task=`3b56ae09-0d9b-4f06-99fc-687a04a58259`::ref 0 aborting False >Thread-3612::DEBUG::2014-09-09 11:37:43,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:43,506::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:43,506::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3613::DEBUG::2014-09-09 11:37:43,507::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:43,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896646 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:44,005::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3614::DEBUG::2014-09-09 11:37:44,005::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:37:44,005::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3614::DEBUG::2014-09-09 11:37:44,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`09f41bb5-e539-4b24-947a-1deb6ca01d04`::moving from state init -> state preparing >Thread-3614::INFO::2014-09-09 11:37:44,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3614::INFO::2014-09-09 11:37:44,006::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3614::DEBUG::2014-09-09 11:37:44,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`09f41bb5-e539-4b24-947a-1deb6ca01d04`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3614::DEBUG::2014-09-09 11:37:44,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`09f41bb5-e539-4b24-947a-1deb6ca01d04`::moving from state preparing -> state finished >Thread-3614::DEBUG::2014-09-09 11:37:44,007::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3614::DEBUG::2014-09-09 11:37:44,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3614::DEBUG::2014-09-09 11:37:44,007::task::993::Storage.TaskManager.Task::(_decref) Task=`09f41bb5-e539-4b24-947a-1deb6ca01d04`::ref 0 aborting False >Thread-3614::DEBUG::2014-09-09 11:37:44,007::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3614::DEBUG::2014-09-09 11:37:44,007::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:44,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:44,037::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3615::DEBUG::2014-09-09 11:37:44,038::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3615::DEBUG::2014-09-09 11:37:44,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`f35c5b80-166c-4418-83ec-a4ed27c10c0d`::moving from state init -> state preparing >Thread-3615::INFO::2014-09-09 11:37:44,038::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3615::DEBUG::2014-09-09 11:37:44,039::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0826e235-5024-43b1-832d-5e9feaa44162`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3615::DEBUG::2014-09-09 11:37:44,039::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3615::DEBUG::2014-09-09 11:37:44,039::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3615::DEBUG::2014-09-09 11:37:44,039::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0826e235-5024-43b1-832d-5e9feaa44162`::Granted request >Thread-3615::DEBUG::2014-09-09 11:37:44,039::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f35c5b80-166c-4418-83ec-a4ed27c10c0d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3615::DEBUG::2014-09-09 11:37:44,039::task::993::Storage.TaskManager.Task::(_decref) Task=`f35c5b80-166c-4418-83ec-a4ed27c10c0d`::ref 1 aborting False >Thread-3615::INFO::2014-09-09 11:37:44,041::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3615::DEBUG::2014-09-09 11:37:44,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`f35c5b80-166c-4418-83ec-a4ed27c10c0d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3615::DEBUG::2014-09-09 11:37:44,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`f35c5b80-166c-4418-83ec-a4ed27c10c0d`::moving from state preparing -> state finished >Thread-3615::DEBUG::2014-09-09 11:37:44,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3615::DEBUG::2014-09-09 11:37:44,041::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3615::DEBUG::2014-09-09 11:37:44,041::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3615::DEBUG::2014-09-09 11:37:44,041::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3615::DEBUG::2014-09-09 11:37:44,042::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3615::DEBUG::2014-09-09 11:37:44,042::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3615::DEBUG::2014-09-09 11:37:44,042::task::993::Storage.TaskManager.Task::(_decref) Task=`f35c5b80-166c-4418-83ec-a4ed27c10c0d`::ref 0 aborting False >Thread-3615::DEBUG::2014-09-09 11:37:44,042::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3615::DEBUG::2014-09-09 11:37:44,042::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:45,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:45,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896076 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:46,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:46,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3616::DEBUG::2014-09-09 11:37:46,552::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:47,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:47,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896779 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:47,947::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:47,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) (7761) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) (7761) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) (7761) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:47,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:37:47,949::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:37:47,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119545 s, 939 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) (7762) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) (7762) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:47,956::__init__::225::IOProcess::(_processLogs) (7762) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:47,957::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:49,562::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:49,563::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3617::DEBUG::2014-09-09 11:37:49,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:49,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:49,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0946751 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:37:51,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:52,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896663 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:52,372::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:52,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,373::__init__::225::IOProcess::(_processLogs) (7763) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:52,373::__init__::225::IOProcess::(_processLogs) (7763) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:52,373::__init__::225::IOProcess::(_processLogs) (7763) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:37:52,374::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:37:52,380::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000982925 s, 361 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:52,380::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:37:52,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) (7764) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) (7764) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7764) Building response >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) (7764) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:52,382::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:52,572::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:52,573::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3618::DEBUG::2014-09-09 11:37:52,574::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:37:52,850::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:52,850::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:52,850::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) (7765) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) (7765) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7765) Building response >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) (7765) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,851::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:52,852::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:37:52,852::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:37:52,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000954496 s, 574 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:52,860::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:52,860::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:37:52,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:52,860::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) (7766) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) (7766) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7766) Building response >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) (7766) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,861::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:52,862::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:37:52,862::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:52,862::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:37:52,862::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) (7767) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) (7767) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) (7767) Building response >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) (7767) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:52,863::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) (7768) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:52,864::__init__::225::IOProcess::(_processLogs) (7768) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) (7768) Building response >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) (7768) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:52,865::__init__::225::IOProcess::(_processLogs) (7769) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:37:52,866::__init__::225::IOProcess::(_processLogs) (7769) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:37:52,866::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7769) Building response >Thread-19::DEBUG::2014-09-09 11:37:52,866::__init__::225::IOProcess::(_processLogs) (7769) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:52,866::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:52,866::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:37:54,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:54,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:54,089::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3619::DEBUG::2014-09-09 11:37:54,089::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3619::DEBUG::2014-09-09 11:37:54,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6bb078b-e0e1-4045-8cff-544513b9508d`::moving from state init -> state preparing >Thread-3619::INFO::2014-09-09 11:37:54,091::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3619::INFO::2014-09-09 11:37:54,091::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3619::DEBUG::2014-09-09 11:37:54,091::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6bb078b-e0e1-4045-8cff-544513b9508d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3619::DEBUG::2014-09-09 11:37:54,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6bb078b-e0e1-4045-8cff-544513b9508d`::moving from state preparing -> state finished >Thread-3619::DEBUG::2014-09-09 11:37:54,091::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3619::DEBUG::2014-09-09 11:37:54,092::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3619::DEBUG::2014-09-09 11:37:54,092::task::993::Storage.TaskManager.Task::(_decref) Task=`f6bb078b-e0e1-4045-8cff-544513b9508d`::ref 0 aborting False >Thread-3619::DEBUG::2014-09-09 11:37:54,092::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3619::DEBUG::2014-09-09 11:37:54,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:54,121::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3620::DEBUG::2014-09-09 11:37:54,121::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:37:54,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3620::DEBUG::2014-09-09 11:37:54,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`831754d6-95f2-44b7-9632-f31873c223b8`::moving from state init -> state preparing >Thread-3620::INFO::2014-09-09 11:37:54,122::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3620::DEBUG::2014-09-09 11:37:54,123::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a1336430-dd67-4f0a-8fa2-cd307d0bf944`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3620::DEBUG::2014-09-09 11:37:54,123::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3620::DEBUG::2014-09-09 11:37:54,123::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3620::DEBUG::2014-09-09 11:37:54,123::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a1336430-dd67-4f0a-8fa2-cd307d0bf944`::Granted request >Thread-3620::DEBUG::2014-09-09 11:37:54,123::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`831754d6-95f2-44b7-9632-f31873c223b8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3620::DEBUG::2014-09-09 11:37:54,123::task::993::Storage.TaskManager.Task::(_decref) Task=`831754d6-95f2-44b7-9632-f31873c223b8`::ref 1 aborting False >Thread-3620::INFO::2014-09-09 11:37:54,130::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3620::DEBUG::2014-09-09 11:37:54,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`831754d6-95f2-44b7-9632-f31873c223b8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3620::DEBUG::2014-09-09 11:37:54,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`831754d6-95f2-44b7-9632-f31873c223b8`::moving from state preparing -> state finished >Thread-3620::DEBUG::2014-09-09 11:37:54,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3620::DEBUG::2014-09-09 11:37:54,132::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3620::DEBUG::2014-09-09 11:37:54,133::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3620::DEBUG::2014-09-09 11:37:54,133::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Dummy-97::DEBUG::2014-09-09 11:37:54,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0973738 s, 10.5 MB/s\n'; <rc> = 0 >Thread-3620::DEBUG::2014-09-09 11:37:54,134::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3620::DEBUG::2014-09-09 11:37:54,134::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3620::DEBUG::2014-09-09 11:37:54,135::task::993::Storage.TaskManager.Task::(_decref) Task=`831754d6-95f2-44b7-9632-f31873c223b8`::ref 0 aborting False >Thread-3620::DEBUG::2014-09-09 11:37:54,136::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3620::DEBUG::2014-09-09 11:37:54,136::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:55,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:55,581::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3621::DEBUG::2014-09-09 11:37:55,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:37:56,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:56,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895614 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) (7770) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:57,958::__init__::225::IOProcess::(_processLogs) (7770) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:57,959::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7770) Building response >Thread-23::DEBUG::2014-09-09 11:37:57,959::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:37:57,959::__init__::225::IOProcess::(_processLogs) (7770) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:57,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:37:57,964::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:37:57,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111441 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:37:57,967::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:37:57,967::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:37:57,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:37:57,967::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:37:57,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) (7771) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) (7771) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7771) Building response >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) (7771) Queuing response >Thread-19::DEBUG::2014-09-09 11:37:57,968::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:37:57,969::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:37:58,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:37:58,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895411 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:58,587::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:58,588::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3622::DEBUG::2014-09-09 11:37:58,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`038f1792-22e1-4251-a0ca-766d432e8c39`::moving from state init -> state preparing >Thread-3622::INFO::2014-09-09 11:37:58,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3622::INFO::2014-09-09 11:37:58,590::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111441', 'lastCheck': '0.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954496', 'lastCheck': '5.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000982925', 'lastCheck': '6.2', 'valid': True}} >Thread-3622::DEBUG::2014-09-09 11:37:58,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`038f1792-22e1-4251-a0ca-766d432e8c39`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111441', 'lastCheck': '0.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954496', 'lastCheck': '5.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000982925', 'lastCheck': '6.2', 'valid': True}} >Thread-3622::DEBUG::2014-09-09 11:37:58,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`038f1792-22e1-4251-a0ca-766d432e8c39`::moving from state preparing -> state finished >Thread-3622::DEBUG::2014-09-09 11:37:58,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3622::DEBUG::2014-09-09 11:37:58,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3622::DEBUG::2014-09-09 11:37:58,590::task::993::Storage.TaskManager.Task::(_decref) Task=`038f1792-22e1-4251-a0ca-766d432e8c39`::ref 0 aborting False >Thread-3622::DEBUG::2014-09-09 11:37:58,591::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:37:58,597::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:37:58,597::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3623::DEBUG::2014-09-09 11:37:58,598::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:00,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:00,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896039 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:01,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:01,677::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3624::DEBUG::2014-09-09 11:38:01,678::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,383::__init__::225::IOProcess::(_processLogs) (7772) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:02,384::__init__::225::IOProcess::(_processLogs) (7772) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:02,384::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7772) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,384::__init__::225::IOProcess::(_processLogs) (7772) Queuing response >Thread-3443::DEBUG::2014-09-09 11:38:02,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:38:02,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,389::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:38:02,392::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000851846 s, 417 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:02,392::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,392::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:02,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,392::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) (7773) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) (7773) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7773) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) (7773) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:02,393::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,394::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:38:02,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:02,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895826 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) (7774) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:02,867::__init__::225::IOProcess::(_processLogs) (7774) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:02,868::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7774) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,868::__init__::225::IOProcess::(_processLogs) (7774) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:02,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,868::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:38:02,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:38:02,875::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000945644 s, 579 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:02,876::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,876::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:02,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,876::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,877::__init__::225::IOProcess::(_processLogs) (7775) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:02,877::__init__::225::IOProcess::(_processLogs) (7775) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:02,877::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7775) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,877::__init__::225::IOProcess::(_processLogs) (7775) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) (7776) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) (7776) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) (7776) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) (7776) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:02,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) (7777) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) (7777) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) (7777) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) (7777) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:02,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,881::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:02,881::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:02,881::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:38:02,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:02,881::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:02,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) (7778) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) (7778) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) (7778) Building response >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) (7778) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:02,882::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:04,173::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:04,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3625::DEBUG::2014-09-09 11:38:04,174::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3625::DEBUG::2014-09-09 11:38:04,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`2573403e-199d-4f74-9405-635be6d1e377`::moving from state init -> state preparing >Thread-3625::INFO::2014-09-09 11:38:04,175::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3625::INFO::2014-09-09 11:38:04,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3625::DEBUG::2014-09-09 11:38:04,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`2573403e-199d-4f74-9405-635be6d1e377`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3625::DEBUG::2014-09-09 11:38:04,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`2573403e-199d-4f74-9405-635be6d1e377`::moving from state preparing -> state finished >Thread-3625::DEBUG::2014-09-09 11:38:04,175::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3625::DEBUG::2014-09-09 11:38:04,175::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3625::DEBUG::2014-09-09 11:38:04,175::task::993::Storage.TaskManager.Task::(_decref) Task=`2573403e-199d-4f74-9405-635be6d1e377`::ref 0 aborting False >Thread-3625::DEBUG::2014-09-09 11:38:04,176::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3625::DEBUG::2014-09-09 11:38:04,176::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:04,205::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:04,206::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3626::DEBUG::2014-09-09 11:38:04,206::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3626::DEBUG::2014-09-09 11:38:04,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dc78f97-68a6-4103-a0e2-62eced4d2499`::moving from state init -> state preparing >Thread-3626::INFO::2014-09-09 11:38:04,207::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3626::DEBUG::2014-09-09 11:38:04,207::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a3b64115-3d96-41a1-84cd-3402c96a34bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3626::DEBUG::2014-09-09 11:38:04,207::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3626::DEBUG::2014-09-09 11:38:04,207::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3626::DEBUG::2014-09-09 11:38:04,207::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a3b64115-3d96-41a1-84cd-3402c96a34bf`::Granted request >Thread-3626::DEBUG::2014-09-09 11:38:04,208::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5dc78f97-68a6-4103-a0e2-62eced4d2499`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3626::DEBUG::2014-09-09 11:38:04,208::task::993::Storage.TaskManager.Task::(_decref) Task=`5dc78f97-68a6-4103-a0e2-62eced4d2499`::ref 1 aborting False >Thread-3626::INFO::2014-09-09 11:38:04,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3626::DEBUG::2014-09-09 11:38:04,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`5dc78f97-68a6-4103-a0e2-62eced4d2499`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3626::DEBUG::2014-09-09 11:38:04,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dc78f97-68a6-4103-a0e2-62eced4d2499`::moving from state preparing -> state finished >Thread-3626::DEBUG::2014-09-09 11:38:04,210::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3626::DEBUG::2014-09-09 11:38:04,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3626::DEBUG::2014-09-09 11:38:04,210::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3626::DEBUG::2014-09-09 11:38:04,210::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3626::DEBUG::2014-09-09 11:38:04,210::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3626::DEBUG::2014-09-09 11:38:04,211::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3626::DEBUG::2014-09-09 11:38:04,211::task::993::Storage.TaskManager.Task::(_decref) Task=`5dc78f97-68a6-4103-a0e2-62eced4d2499`::ref 0 aborting False >Thread-3626::DEBUG::2014-09-09 11:38:04,211::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3626::DEBUG::2014-09-09 11:38:04,211::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:04,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:04,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897162 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:04,685::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:04,686::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3627::DEBUG::2014-09-09 11:38:04,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:06,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:06,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896543 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:07,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:07,698::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3628::DEBUG::2014-09-09 11:38:07,699::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-23::DEBUG::2014-09-09 11:38:07,969::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:07,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:07,972::__init__::225::IOProcess::(_processLogs) (7779) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:07,972::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|(7779) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:07,972::__init__::225::IOProcess::(_processLogs) (7779) Building response >Thread-19::DEBUG::2014-09-09 11:38:07,972::__init__::225::IOProcess::(_processLogs) (7779) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:07,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Message size is 149DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) (7780) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:07,973::__init__::225::IOProcess::(_processLogs) (7780) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) (7781) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:07,974::__init__::225::IOProcess::(_processLogs) (7781) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(7780) Building response >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) (7780) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) (7781) Building response >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) (7781) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:07,975::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 11:38:07,977::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:38:07,977::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:07,977::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:38:07,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:07,977::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:07,978::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:07,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:07,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:07,978::__init__::225::IOProcess::(_processLogs) (7782) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:38:07,978::__init__::225::IOProcess::(_processLogs) (7782) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:38:08,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7782) Building response >Thread-19::DEBUG::2014-09-09 11:38:08,005::__init__::225::IOProcess::(_processLogs) (7782) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:08,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:38:08,006::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:38:08,006::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) (7783) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:38:08,007::__init__::225::IOProcess::(_processLogs) (7783) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:38:08,009::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7783) Building response >Thread-19::DEBUG::2014-09-09 11:38:08,009::__init__::225::IOProcess::(_processLogs) (7783) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:08,010::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:38:08,010::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:38:08,010::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 11:38:08,011::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:08,011::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:38:08,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:08,011::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) (7784) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) (7784) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) (7784) Building response >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) (7784) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:08,012::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) (7785) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:08,013::__init__::225::IOProcess::(_processLogs) (7785) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:08,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7785) Building response >Thread-19::DEBUG::2014-09-09 11:38:08,014::__init__::225::IOProcess::(_processLogs) (7785) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:08,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:38:08,014::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:38:08,015::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:38:08,015::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 11:38:08,015::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) (7786) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) (7786) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:08,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7786) Building response >Thread-19::DEBUG::2014-09-09 11:38:08,017::__init__::225::IOProcess::(_processLogs) (7786) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:08,017::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:38:08,017::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:38:08,017::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:38:08,024::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103703 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) (7787) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) (7787) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7787) Building response >Thread-19::DEBUG::2014-09-09 11:38:08,025::__init__::225::IOProcess::(_processLogs) (7787) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:08,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:38:08,026::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:38:08,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:08,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896597 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:10,709::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:10,710::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3632::DEBUG::2014-09-09 11:38:10,711::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:10,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:10,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089745 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:12,394::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) (7788) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) (7788) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:12,395::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7788) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,396::__init__::225::IOProcess::(_processLogs) (7788) Queuing response >Thread-3443::DEBUG::2014-09-09 11:38:12,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:38:12,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,401::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:38:12,404::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000994079 s, 357 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:12,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,404::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:12,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) (7789) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) (7789) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7789) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) (7789) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,406::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:38:12,882::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:38:12,883::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) (7790) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:12,884::__init__::225::IOProcess::(_processLogs) (7790) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7790) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) (7790) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:38:12,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) (7791) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) (7791) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) (7792) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) (7792) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) DEBUG|(7792) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) (7792) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,888::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:38:12,888::__init__::225::IOProcess::(_processLogs) DEBUG|(7791) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,889::__init__::225::IOProcess::(_processLogs) (7791) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,890::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-24::DEBUG::2014-09-09 11:38:12,891::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) (7793) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:38:12,892::__init__::225::IOProcess::(_processLogs) (7793) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:38:12,940::__init__::225::IOProcess::(_processLogs) DEBUG|(7793) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,940::__init__::225::IOProcess::(_processLogs) (7793) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,941::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:38:12,941::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:38:12,941::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) (7794) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:38:12,942::__init__::225::IOProcess::(_processLogs) (7794) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:38:12,946::__init__::225::IOProcess::(_processLogs) DEBUG|(7794) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,946::__init__::225::IOProcess::(_processLogs) (7794) Queuing response >Thread-24::DEBUG::2014-09-09 11:38:12,946::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:38:12,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,947::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) (7795) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) (7795) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:12,948::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|(7795) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) (7795) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,949::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,950::__init__::225::IOProcess::(_processLogs) (7796) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:12,950::__init__::225::IOProcess::(_processLogs) (7796) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:12,951::__init__::225::IOProcess::(_processLogs) (7794) Queuing responseDEBUG|(7796) Building response >Thread-24::DEBUG::2014-09-09 11:38:12,951::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:38:12,951::__init__::225::IOProcess::(_processLogs) (7796) Queuing response >Thread-24::INFO::2014-09-09 11:38:12,951::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:38:12,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::INFO::2014-09-09 11:38:12,952::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:38:12,952::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) (7797) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:12,953::__init__::225::IOProcess::(_processLogs) (7797) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:12,954::__init__::225::IOProcess::(_processLogs) (7797) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,954::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:38:12,954::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:38:12,961::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000976647 s, 561 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:12,961::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:12,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) (7798) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) (7798) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) (7798) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,962::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:38:12,963::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:38:12,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) (7799) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) (7799) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) (7799) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) (7799) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:12,964::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:12,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) (7800) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) (7800) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) (7800) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) (7800) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:12,966::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:12,967::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:38:12,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:12,967::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:12,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:12,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:12,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:12,968::__init__::225::IOProcess::(_processLogs) (7801) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:12,968::__init__::225::IOProcess::(_processLogs) (7801) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:12,968::__init__::225::IOProcess::(_processLogs) (7801) Building response >Thread-19::DEBUG::2014-09-09 11:38:12,968::__init__::225::IOProcess::(_processLogs) (7801) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:12,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:12,968::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:38:12,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:13,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896373 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:13,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:13,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3636::DEBUG::2014-09-09 11:38:13,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2a48914-e271-4029-9ebd-28e91b47ba9c`::moving from state init -> state preparing >Thread-3636::INFO::2014-09-09 11:38:13,723::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3636::INFO::2014-09-09 11:38:13,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103703', 'lastCheck': '5.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000976647', 'lastCheck': '0.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000994079', 'lastCheck': '1.3', 'valid': True}} >Thread-3636::DEBUG::2014-09-09 11:38:13,724::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2a48914-e271-4029-9ebd-28e91b47ba9c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103703', 'lastCheck': '5.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000976647', 'lastCheck': '0.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000994079', 'lastCheck': '1.3', 'valid': True}} >Thread-3636::DEBUG::2014-09-09 11:38:13,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2a48914-e271-4029-9ebd-28e91b47ba9c`::moving from state preparing -> state finished >Thread-3636::DEBUG::2014-09-09 11:38:13,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3636::DEBUG::2014-09-09 11:38:13,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3636::DEBUG::2014-09-09 11:38:13,724::task::993::Storage.TaskManager.Task::(_decref) Task=`f2a48914-e271-4029-9ebd-28e91b47ba9c`::ref 0 aborting False >Thread-3636::DEBUG::2014-09-09 11:38:13,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:13,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:13,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3637::DEBUG::2014-09-09 11:38:13,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:14,266::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:14,267::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3638::DEBUG::2014-09-09 11:38:14,267::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3638::DEBUG::2014-09-09 11:38:14,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fa75610-0575-4a27-8c50-f3556d50950a`::moving from state init -> state preparing >Thread-3638::INFO::2014-09-09 11:38:14,268::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3638::INFO::2014-09-09 11:38:14,268::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3638::DEBUG::2014-09-09 11:38:14,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fa75610-0575-4a27-8c50-f3556d50950a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3638::DEBUG::2014-09-09 11:38:14,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fa75610-0575-4a27-8c50-f3556d50950a`::moving from state preparing -> state finished >Thread-3638::DEBUG::2014-09-09 11:38:14,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3638::DEBUG::2014-09-09 11:38:14,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3638::DEBUG::2014-09-09 11:38:14,269::task::993::Storage.TaskManager.Task::(_decref) Task=`3fa75610-0575-4a27-8c50-f3556d50950a`::ref 0 aborting False >Thread-3638::DEBUG::2014-09-09 11:38:14,269::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3638::DEBUG::2014-09-09 11:38:14,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:14,298::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:14,299::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3639::DEBUG::2014-09-09 11:38:14,299::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3639::DEBUG::2014-09-09 11:38:14,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`81cab1c6-fb0d-4bea-8635-65a098ac836a`::moving from state init -> state preparing >Thread-3639::INFO::2014-09-09 11:38:14,299::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3639::DEBUG::2014-09-09 11:38:14,300::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bbaac71c-cb9b-46c1-b23c-4d9adad05161`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3639::DEBUG::2014-09-09 11:38:14,300::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3639::DEBUG::2014-09-09 11:38:14,300::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3639::DEBUG::2014-09-09 11:38:14,300::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bbaac71c-cb9b-46c1-b23c-4d9adad05161`::Granted request >Thread-3639::DEBUG::2014-09-09 11:38:14,300::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81cab1c6-fb0d-4bea-8635-65a098ac836a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3639::DEBUG::2014-09-09 11:38:14,300::task::993::Storage.TaskManager.Task::(_decref) Task=`81cab1c6-fb0d-4bea-8635-65a098ac836a`::ref 1 aborting False >Thread-3639::INFO::2014-09-09 11:38:14,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3639::DEBUG::2014-09-09 11:38:14,302::task::1191::Storage.TaskManager.Task::(prepare) Task=`81cab1c6-fb0d-4bea-8635-65a098ac836a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3639::DEBUG::2014-09-09 11:38:14,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`81cab1c6-fb0d-4bea-8635-65a098ac836a`::moving from state preparing -> state finished >Thread-3639::DEBUG::2014-09-09 11:38:14,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3639::DEBUG::2014-09-09 11:38:14,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3639::DEBUG::2014-09-09 11:38:14,302::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3639::DEBUG::2014-09-09 11:38:14,303::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3639::DEBUG::2014-09-09 11:38:14,303::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3639::DEBUG::2014-09-09 11:38:14,303::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3639::DEBUG::2014-09-09 11:38:14,303::task::993::Storage.TaskManager.Task::(_decref) Task=`81cab1c6-fb0d-4bea-8635-65a098ac836a`::ref 0 aborting False >Thread-3639::DEBUG::2014-09-09 11:38:14,303::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3639::DEBUG::2014-09-09 11:38:14,303::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:15,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:15,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902914 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:16,821::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:16,822::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3640::DEBUG::2014-09-09 11:38:16,823::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:17,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:17,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897998 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) (7802) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:18,027::__init__::225::IOProcess::(_processLogs) (7802) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:18,028::__init__::225::IOProcess::(_processLogs) DEBUG|(7802) Building response >Thread-19::DEBUG::2014-09-09 11:38:18,028::__init__::225::IOProcess::(_processLogs) (7802) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:18,028::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:38:18,028::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:38:18,029::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:38:18,035::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00102068 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) (7803) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:18,036::__init__::225::IOProcess::(_processLogs) (7803) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:18,037::__init__::225::IOProcess::(_processLogs) DEBUG|(7803) Building response >Thread-19::DEBUG::2014-09-09 11:38:18,037::__init__::225::IOProcess::(_processLogs) (7803) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:18,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:18,038::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:38:19,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:19,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0953628 s, 10.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:19,832::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:19,833::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3641::DEBUG::2014-09-09 11:38:19,837::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:21,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:21,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898192 s, 11.4 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:38:22,406::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:38:22,408::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:22,408::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:38:22,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:22,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,409::__init__::225::IOProcess::(_processLogs) (7804) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:22,409::__init__::225::IOProcess::(_processLogs) (7804) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:22,409::__init__::225::IOProcess::(_processLogs) DEBUG|(7804) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,410::__init__::225::IOProcess::(_processLogs) (7804) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,411::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:38:22,413::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:22,413::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:38:22,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3443::DEBUG::2014-09-09 11:38:22,415::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:38:22,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,416::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,416::__init__::225::IOProcess::(_processLogs) (7805) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) (7805) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) (7805) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) (7805) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,418::__init__::225::IOProcess::(_processLogs) (7806) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:22,418::__init__::225::IOProcess::(_processLogs) (7806) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,418::__init__::225::IOProcess::(_processLogs) (7806) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,418::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,418::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:38:22,418::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:38:22,419::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,419::__init__::225::IOProcess::(_processLogs) (7807) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:38:22,419::__init__::225::IOProcess::(_processLogs) (7807) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:38:22,436::__init__::225::IOProcess::(_processLogs) (7807) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,436::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3443::DEBUG::2014-09-09 11:38:22,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) (7808) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:38:22,437::__init__::225::IOProcess::(_processLogs) (7808) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:38:22,439::__init__::225::IOProcess::(_processLogs) (7808) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,439::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,439::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-3443::DEBUG::2014-09-09 11:38:22,439::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:38:22,440::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:38:22,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) (7809) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) (7809) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) (7809) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) (7809) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,441::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) (7810) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:38:22,442::__init__::225::IOProcess::(_processLogs) (7810) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:38:22,443::__init__::225::IOProcess::(_processLogs) (7810) Queuing response >Thread-3443::DEBUG::2014-09-09 11:38:22,443::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:38:22,443::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::INFO::2014-09-09 11:38:22,444::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 11:38:22,444::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:38:22,444::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:22,444::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:22,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,445::__init__::225::IOProcess::(_processLogs) (7811) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:22,445::__init__::225::IOProcess::(_processLogs) (7811) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:22,445::__init__::225::IOProcess::(_processLogs) (7811) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,445::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:38:22,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:38:22,452::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0009156 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:22,452::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) (7812) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) (7812) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:22,453::__init__::225::IOProcess::(_processLogs) (7812) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,454::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:22,844::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:22,845::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3645::DEBUG::2014-09-09 11:38:22,845::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:38:22,967::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) (7813) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) (7813) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:22,968::__init__::225::IOProcess::(_processLogs) (7813) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:38:22,969::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:38:22,975::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00107943 s, 508 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:22,976::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:22,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,977::__init__::225::IOProcess::(_processLogs) (7814) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:22,977::__init__::225::IOProcess::(_processLogs) (7814) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:22,977::__init__::225::IOProcess::(_processLogs) (7814) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,978::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:38:22,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:22,978::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,978::__init__::225::IOProcess::(_processLogs) (7815) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) (7815) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) (7815) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) (7815) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,979::__init__::225::IOProcess::(_processLogs) (7816) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) (7816) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) (7816) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) (7816) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:38:22,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) (7817) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) (7817) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) (7817) Building response >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) (7817) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:22,981::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:38:23,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:23,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896396 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:24,342::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:24,343::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3646::DEBUG::2014-09-09 11:38:24,343::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3646::DEBUG::2014-09-09 11:38:24,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ac14579-2a1d-4b5f-b434-e804d6a3ecf7`::moving from state init -> state preparing >Thread-3646::INFO::2014-09-09 11:38:24,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3646::INFO::2014-09-09 11:38:24,344::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3646::DEBUG::2014-09-09 11:38:24,344::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ac14579-2a1d-4b5f-b434-e804d6a3ecf7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3646::DEBUG::2014-09-09 11:38:24,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ac14579-2a1d-4b5f-b434-e804d6a3ecf7`::moving from state preparing -> state finished >Thread-3646::DEBUG::2014-09-09 11:38:24,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3646::DEBUG::2014-09-09 11:38:24,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3646::DEBUG::2014-09-09 11:38:24,345::task::993::Storage.TaskManager.Task::(_decref) Task=`2ac14579-2a1d-4b5f-b434-e804d6a3ecf7`::ref 0 aborting False >Thread-3646::DEBUG::2014-09-09 11:38:24,345::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3646::DEBUG::2014-09-09 11:38:24,345::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:24,395::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:24,396::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3647::DEBUG::2014-09-09 11:38:24,396::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3647::DEBUG::2014-09-09 11:38:24,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`03e73ac5-a52f-428e-af73-be38e579efd6`::moving from state init -> state preparing >Thread-3647::INFO::2014-09-09 11:38:24,397::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3647::DEBUG::2014-09-09 11:38:24,397::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b5133255-220c-4a75-954e-3ced605def94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3647::DEBUG::2014-09-09 11:38:24,397::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3647::DEBUG::2014-09-09 11:38:24,397::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3647::DEBUG::2014-09-09 11:38:24,397::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b5133255-220c-4a75-954e-3ced605def94`::Granted request >Thread-3647::DEBUG::2014-09-09 11:38:24,398::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`03e73ac5-a52f-428e-af73-be38e579efd6`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3647::DEBUG::2014-09-09 11:38:24,398::task::993::Storage.TaskManager.Task::(_decref) Task=`03e73ac5-a52f-428e-af73-be38e579efd6`::ref 1 aborting False >Thread-3647::INFO::2014-09-09 11:38:24,399::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3647::DEBUG::2014-09-09 11:38:24,399::task::1191::Storage.TaskManager.Task::(prepare) Task=`03e73ac5-a52f-428e-af73-be38e579efd6`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3647::DEBUG::2014-09-09 11:38:24,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`03e73ac5-a52f-428e-af73-be38e579efd6`::moving from state preparing -> state finished >Thread-3647::DEBUG::2014-09-09 11:38:24,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3647::DEBUG::2014-09-09 11:38:24,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3647::DEBUG::2014-09-09 11:38:24,400::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3647::DEBUG::2014-09-09 11:38:24,400::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3647::DEBUG::2014-09-09 11:38:24,400::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3647::DEBUG::2014-09-09 11:38:24,400::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3647::DEBUG::2014-09-09 11:38:24,400::task::993::Storage.TaskManager.Task::(_decref) Task=`03e73ac5-a52f-428e-af73-be38e579efd6`::ref 0 aborting False >Thread-3647::DEBUG::2014-09-09 11:38:24,400::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283926069248', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3647::DEBUG::2014-09-09 11:38:24,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:25,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:25,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895891 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:25,852::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:25,853::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3648::DEBUG::2014-09-09 11:38:25,854::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:27,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:27,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897374 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) (7818) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:28,038::__init__::225::IOProcess::(_processLogs) (7818) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:28,039::__init__::225::IOProcess::(_processLogs) (7818) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:28,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:38:28,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:38:28,045::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107439 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:28,046::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:28,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:28,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:28,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:28,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:28,047::__init__::225::IOProcess::(_processLogs) (7819) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:28,047::__init__::225::IOProcess::(_processLogs) (7819) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:28,047::__init__::225::IOProcess::(_processLogs) (7819) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:28,047::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:28,861::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:28,862::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3649::DEBUG::2014-09-09 11:38:28,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ced53ab-cf7b-476e-a0d8-972fe6668df4`::moving from state init -> state preparing >Thread-3649::INFO::2014-09-09 11:38:28,863::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3649::INFO::2014-09-09 11:38:28,864::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107439', 'lastCheck': '0.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107943', 'lastCheck': '5.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009156', 'lastCheck': '6.4', 'valid': True}} >Thread-3649::DEBUG::2014-09-09 11:38:28,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ced53ab-cf7b-476e-a0d8-972fe6668df4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107439', 'lastCheck': '0.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107943', 'lastCheck': '5.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009156', 'lastCheck': '6.4', 'valid': True}} >Thread-3649::DEBUG::2014-09-09 11:38:28,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ced53ab-cf7b-476e-a0d8-972fe6668df4`::moving from state preparing -> state finished >Thread-3649::DEBUG::2014-09-09 11:38:28,864::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3649::DEBUG::2014-09-09 11:38:28,864::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3649::DEBUG::2014-09-09 11:38:28,864::task::993::Storage.TaskManager.Task::(_decref) Task=`6ced53ab-cf7b-476e-a0d8-972fe6668df4`::ref 0 aborting False >Thread-3649::DEBUG::2014-09-09 11:38:28,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:28,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:28,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3650::DEBUG::2014-09-09 11:38:28,874::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:29,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:29,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089593 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:31,974::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:31,975::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3651::DEBUG::2014-09-09 11:38:31,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:31,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:32,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895089 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) (7820) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:32,455::__init__::225::IOProcess::(_processLogs) (7820) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:32,457::__init__::225::IOProcess::(_processLogs) (7820) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,457::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:38:32,458::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:38:32,465::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000919627 s, 386 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:32,465::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:32,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:32,465::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:32,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,466::__init__::225::IOProcess::(_processLogs) (7821) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:32,466::__init__::225::IOProcess::(_processLogs) (7821) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:32,466::__init__::225::IOProcess::(_processLogs) (7821) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,466::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) (7822) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:32,982::__init__::225::IOProcess::(_processLogs) (7822) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:32,983::__init__::225::IOProcess::(_processLogs) (7822) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:38:32,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:38:32,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000972387 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:32,990::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:32,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:32,990::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:32,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,991::__init__::225::IOProcess::(_processLogs) (7823) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:32,991::__init__::225::IOProcess::(_processLogs) (7823) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:32,991::__init__::225::IOProcess::(_processLogs) (7823) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,991::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) (7824) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) (7824) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) (7824) Building response >Thread-19::DEBUG::2014-09-09 11:38:32,992::__init__::225::IOProcess::(_processLogs) (7824) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,993::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:32,993::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:32,993::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) (7825) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) (7825) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) (7825) Building response >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) (7825) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:32,994::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) (7826) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) (7826) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:32,995::__init__::225::IOProcess::(_processLogs) (7826) Building response >Thread-19::DEBUG::2014-09-09 11:38:32,996::__init__::225::IOProcess::(_processLogs) (7826) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:32,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:32,996::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:38:34,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:34,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895766 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:34,452::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:34,453::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3652::DEBUG::2014-09-09 11:38:34,453::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3652::DEBUG::2014-09-09 11:38:34,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`651a35dc-aa53-4aae-a67b-986172ca818b`::moving from state init -> state preparing >Thread-3652::INFO::2014-09-09 11:38:34,454::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3652::INFO::2014-09-09 11:38:34,454::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3652::DEBUG::2014-09-09 11:38:34,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`651a35dc-aa53-4aae-a67b-986172ca818b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3652::DEBUG::2014-09-09 11:38:34,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`651a35dc-aa53-4aae-a67b-986172ca818b`::moving from state preparing -> state finished >Thread-3652::DEBUG::2014-09-09 11:38:34,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3652::DEBUG::2014-09-09 11:38:34,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3652::DEBUG::2014-09-09 11:38:34,455::task::993::Storage.TaskManager.Task::(_decref) Task=`651a35dc-aa53-4aae-a67b-986172ca818b`::ref 0 aborting False >Thread-3652::DEBUG::2014-09-09 11:38:34,455::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3652::DEBUG::2014-09-09 11:38:34,455::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:34,484::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:34,485::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3653::DEBUG::2014-09-09 11:38:34,485::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3653::DEBUG::2014-09-09 11:38:34,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fb5f408-5e44-469e-a1de-c13bb940b624`::moving from state init -> state preparing >Thread-3653::INFO::2014-09-09 11:38:34,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3653::DEBUG::2014-09-09 11:38:34,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f84442bc-93c3-4dbe-b3e6-8ab4f826ec6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3653::DEBUG::2014-09-09 11:38:34,486::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3653::DEBUG::2014-09-09 11:38:34,486::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3653::DEBUG::2014-09-09 11:38:34,486::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f84442bc-93c3-4dbe-b3e6-8ab4f826ec6c`::Granted request >Thread-3653::DEBUG::2014-09-09 11:38:34,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8fb5f408-5e44-469e-a1de-c13bb940b624`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3653::DEBUG::2014-09-09 11:38:34,488::task::993::Storage.TaskManager.Task::(_decref) Task=`8fb5f408-5e44-469e-a1de-c13bb940b624`::ref 1 aborting False >Thread-3653::INFO::2014-09-09 11:38:34,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3653::DEBUG::2014-09-09 11:38:34,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fb5f408-5e44-469e-a1de-c13bb940b624`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3653::DEBUG::2014-09-09 11:38:34,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fb5f408-5e44-469e-a1de-c13bb940b624`::moving from state preparing -> state finished >Thread-3653::DEBUG::2014-09-09 11:38:34,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3653::DEBUG::2014-09-09 11:38:34,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3653::DEBUG::2014-09-09 11:38:34,490::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3653::DEBUG::2014-09-09 11:38:34,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3653::DEBUG::2014-09-09 11:38:34,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3653::DEBUG::2014-09-09 11:38:34,490::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3653::DEBUG::2014-09-09 11:38:34,490::task::993::Storage.TaskManager.Task::(_decref) Task=`8fb5f408-5e44-469e-a1de-c13bb940b624`::ref 0 aborting False >Thread-3653::DEBUG::2014-09-09 11:38:34,490::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3653::DEBUG::2014-09-09 11:38:34,490::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:34,983::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:34,984::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3654::DEBUG::2014-09-09 11:38:34,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:36,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:36,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896079 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:37,993::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:37,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3655::DEBUG::2014-09-09 11:38:37,994::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) (7827) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:38,048::__init__::225::IOProcess::(_processLogs) (7827) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:38,049::__init__::225::IOProcess::(_processLogs) (7827) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:38,049::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:38:38,050::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:38:38,057::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115998 s, 968 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) (7828) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:38,058::__init__::225::IOProcess::(_processLogs) (7828) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:38,059::__init__::225::IOProcess::(_processLogs) (7828) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:38,059::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:38:38,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:38,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896443 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:38:40,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:40,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897597 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:41,001::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:41,003::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3656::DEBUG::2014-09-09 11:38:41,005::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:38:42,467::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:42,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:42,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:42,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:42,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:42,468::__init__::225::IOProcess::(_processLogs) (7829) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:42,468::__init__::225::IOProcess::(_processLogs) (7829) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:42,468::__init__::225::IOProcess::(_processLogs) (7829) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:42,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:38:42,469::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:38:42,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00104748 s, 339 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:42,475::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) (7830) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) (7830) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:42,476::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7830) Building response >Thread-19::DEBUG::2014-09-09 11:38:42,477::__init__::225::IOProcess::(_processLogs) (7830) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:42,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:42,477::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:38:42,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:42,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898394 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) (7831) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:42,996::__init__::225::IOProcess::(_processLogs) (7831) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:42,997::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7831) Building response >Thread-19::DEBUG::2014-09-09 11:38:42,998::__init__::225::IOProcess::(_processLogs) (7831) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:42,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:42,998::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:38:42,998::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:38:43,005::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000999179 s, 548 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:43,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:43,007::__init__::225::IOProcess::(_processLogs) (7832) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:43,007::__init__::225::IOProcess::(_processLogs) (7832) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:43,007::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7832) Building response >Thread-19::DEBUG::2014-09-09 11:38:43,007::__init__::225::IOProcess::(_processLogs) (7832) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:43,007::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:43,007::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:38:43,008::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:43,008::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:38:43,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) (7833) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) (7833) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7833) Building response >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) (7833) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:43,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) (7834) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:43,010::__init__::225::IOProcess::(_processLogs) (7834) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:43,011::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(7834) Building response >Thread-19::DEBUG::2014-09-09 11:38:43,011::__init__::225::IOProcess::(_processLogs) (7834) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:43,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:43,011::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:43,011::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:38:43,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) (7835) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) (7835) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:43,012::__init__::225::IOProcess::(_processLogs) (7835) Building response >Thread-19::DEBUG::2014-09-09 11:38:43,013::__init__::225::IOProcess::(_processLogs) (7835) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:43,013::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:43,013::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:44,044::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:44,044::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3657::DEBUG::2014-09-09 11:38:44,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`11b599a0-6e86-4be2-bcee-06fecf957007`::moving from state init -> state preparing >Thread-3657::INFO::2014-09-09 11:38:44,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3657::INFO::2014-09-09 11:38:44,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115998', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000999179', 'lastCheck': '1.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104748', 'lastCheck': '1.6', 'valid': True}} >Thread-3657::DEBUG::2014-09-09 11:38:44,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`11b599a0-6e86-4be2-bcee-06fecf957007`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115998', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000999179', 'lastCheck': '1.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104748', 'lastCheck': '1.6', 'valid': True}} >Thread-3657::DEBUG::2014-09-09 11:38:44,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`11b599a0-6e86-4be2-bcee-06fecf957007`::moving from state preparing -> state finished >Thread-3657::DEBUG::2014-09-09 11:38:44,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3657::DEBUG::2014-09-09 11:38:44,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3657::DEBUG::2014-09-09 11:38:44,046::task::993::Storage.TaskManager.Task::(_decref) Task=`11b599a0-6e86-4be2-bcee-06fecf957007`::ref 0 aborting False >Thread-3657::DEBUG::2014-09-09 11:38:44,047::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:44,055::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:44,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3658::DEBUG::2014-09-09 11:38:44,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:44,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:44,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3659::DEBUG::2014-09-09 11:38:44,529::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3659::DEBUG::2014-09-09 11:38:44,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba4610a-920f-4e3d-860d-4a9f46dcd9a3`::moving from state init -> state preparing >Thread-3659::INFO::2014-09-09 11:38:44,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3659::INFO::2014-09-09 11:38:44,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3659::DEBUG::2014-09-09 11:38:44,530::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ba4610a-920f-4e3d-860d-4a9f46dcd9a3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3659::DEBUG::2014-09-09 11:38:44,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba4610a-920f-4e3d-860d-4a9f46dcd9a3`::moving from state preparing -> state finished >Thread-3659::DEBUG::2014-09-09 11:38:44,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3659::DEBUG::2014-09-09 11:38:44,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3659::DEBUG::2014-09-09 11:38:44,531::task::993::Storage.TaskManager.Task::(_decref) Task=`6ba4610a-920f-4e3d-860d-4a9f46dcd9a3`::ref 0 aborting False >Thread-3659::DEBUG::2014-09-09 11:38:44,531::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3659::DEBUG::2014-09-09 11:38:44,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:44,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:44,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3660::DEBUG::2014-09-09 11:38:44,583::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3660::DEBUG::2014-09-09 11:38:44,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ce01230-184a-43c6-8d83-a00c2667ed3a`::moving from state init -> state preparing >Thread-3660::INFO::2014-09-09 11:38:44,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3660::DEBUG::2014-09-09 11:38:44,584::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f7f06dc3-b3ed-424f-81ba-d928bf998017`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3660::DEBUG::2014-09-09 11:38:44,584::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3660::DEBUG::2014-09-09 11:38:44,584::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3660::DEBUG::2014-09-09 11:38:44,585::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f7f06dc3-b3ed-424f-81ba-d928bf998017`::Granted request >Thread-3660::DEBUG::2014-09-09 11:38:44,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8ce01230-184a-43c6-8d83-a00c2667ed3a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3660::DEBUG::2014-09-09 11:38:44,586::task::993::Storage.TaskManager.Task::(_decref) Task=`8ce01230-184a-43c6-8d83-a00c2667ed3a`::ref 1 aborting False >Thread-3660::INFO::2014-09-09 11:38:44,587::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3660::DEBUG::2014-09-09 11:38:44,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ce01230-184a-43c6-8d83-a00c2667ed3a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3660::DEBUG::2014-09-09 11:38:44,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ce01230-184a-43c6-8d83-a00c2667ed3a`::moving from state preparing -> state finished >Thread-3660::DEBUG::2014-09-09 11:38:44,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3660::DEBUG::2014-09-09 11:38:44,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3660::DEBUG::2014-09-09 11:38:44,588::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3660::DEBUG::2014-09-09 11:38:44,588::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3660::DEBUG::2014-09-09 11:38:44,588::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3660::DEBUG::2014-09-09 11:38:44,588::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3660::DEBUG::2014-09-09 11:38:44,588::task::993::Storage.TaskManager.Task::(_decref) Task=`8ce01230-184a-43c6-8d83-a00c2667ed3a`::ref 0 aborting False >Thread-3660::DEBUG::2014-09-09 11:38:44,588::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3660::DEBUG::2014-09-09 11:38:44,589::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:44,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:44,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895159 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:38:46,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:46,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894621 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:47,108::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:47,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3661::DEBUG::2014-09-09 11:38:47,110::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:38:48,060::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:48,060::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:48,060::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:48,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:48,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:48,060::__init__::225::IOProcess::(_processLogs) (7836) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:48,061::__init__::225::IOProcess::(_processLogs) (7836) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:48,061::__init__::225::IOProcess::(_processLogs) (7836) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:48,061::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:38:48,062::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:38:48,068::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110496 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) (7837) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:48,069::__init__::225::IOProcess::(_processLogs) (7837) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:48,070::__init__::225::IOProcess::(_processLogs) (7837) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:48,070::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:38:48,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:48,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897172 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:50,116::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:50,118::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3662::DEBUG::2014-09-09 11:38:50,121::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:50,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:51,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895978 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:52,478::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:52,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:52,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:52,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:52,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:52,479::__init__::225::IOProcess::(_processLogs) (7838) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:52,479::__init__::225::IOProcess::(_processLogs) (7838) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:52,479::__init__::225::IOProcess::(_processLogs) (7838) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:52,479::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:52,479::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:38:52,479::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:38:52,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00114206 s, 311 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:52,486::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:38:52,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:52,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:52,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:52,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:52,487::__init__::225::IOProcess::(_processLogs) (7839) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:52,487::__init__::225::IOProcess::(_processLogs) (7839) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:52,487::__init__::225::IOProcess::(_processLogs) (7839) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:52,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:52,488::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:38:53,012::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) (7840) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) (7840) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) (7840) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:53,013::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:38:53,014::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:53,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-24::DEBUG::2014-09-09 11:38:53,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000919963 s, 596 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) (7841) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:53,023::__init__::225::IOProcess::(_processLogs) (7841) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:53,024::__init__::225::IOProcess::(_processLogs) (7841) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:53,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:53,024::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:38:53,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) (7842) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) (7842) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) (7842) Building response >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) (7842) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:53,025::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) (7843) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) (7843) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) (7843) Building response >Thread-19::DEBUG::2014-09-09 11:38:53,026::__init__::225::IOProcess::(_processLogs) (7843) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:53,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:53,027::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:38:53,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:53,027::__init__::225::IOProcess::(_processLogs) (7844) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:38:53,027::__init__::225::IOProcess::(_processLogs) (7844) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:38:53,112::__init__::225::IOProcess::(_processLogs) (7844) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:53,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:53,113::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:38:53,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0917218 s, 11.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:53,128::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:53,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3663::DEBUG::2014-09-09 11:38:53,130::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:54,638::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3664::DEBUG::2014-09-09 11:38:54,638::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:38:54,638::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3664::DEBUG::2014-09-09 11:38:54,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`d822004e-0848-4a05-a922-52f78f6ee1f5`::moving from state init -> state preparing >Thread-3664::INFO::2014-09-09 11:38:54,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3664::INFO::2014-09-09 11:38:54,640::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3664::DEBUG::2014-09-09 11:38:54,640::task::1191::Storage.TaskManager.Task::(prepare) Task=`d822004e-0848-4a05-a922-52f78f6ee1f5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3664::DEBUG::2014-09-09 11:38:54,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`d822004e-0848-4a05-a922-52f78f6ee1f5`::moving from state preparing -> state finished >Thread-3664::DEBUG::2014-09-09 11:38:54,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3664::DEBUG::2014-09-09 11:38:54,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3664::DEBUG::2014-09-09 11:38:54,640::task::993::Storage.TaskManager.Task::(_decref) Task=`d822004e-0848-4a05-a922-52f78f6ee1f5`::ref 0 aborting False >Thread-3664::DEBUG::2014-09-09 11:38:54,640::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3664::DEBUG::2014-09-09 11:38:54,640::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:54,677::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:54,677::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3665::DEBUG::2014-09-09 11:38:54,677::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3665::DEBUG::2014-09-09 11:38:54,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`bad75bf2-4eb5-49d5-9361-210e180e53d7`::moving from state init -> state preparing >Thread-3665::INFO::2014-09-09 11:38:54,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3665::DEBUG::2014-09-09 11:38:54,679::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1e6f1ff-4d08-479c-9109-3f7a068075d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3665::DEBUG::2014-09-09 11:38:54,679::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3665::DEBUG::2014-09-09 11:38:54,679::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3665::DEBUG::2014-09-09 11:38:54,679::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1e6f1ff-4d08-479c-9109-3f7a068075d4`::Granted request >Thread-3665::DEBUG::2014-09-09 11:38:54,679::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bad75bf2-4eb5-49d5-9361-210e180e53d7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3665::DEBUG::2014-09-09 11:38:54,679::task::993::Storage.TaskManager.Task::(_decref) Task=`bad75bf2-4eb5-49d5-9361-210e180e53d7`::ref 1 aborting False >Thread-3665::INFO::2014-09-09 11:38:54,681::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3665::DEBUG::2014-09-09 11:38:54,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`bad75bf2-4eb5-49d5-9361-210e180e53d7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3665::DEBUG::2014-09-09 11:38:54,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`bad75bf2-4eb5-49d5-9361-210e180e53d7`::moving from state preparing -> state finished >Thread-3665::DEBUG::2014-09-09 11:38:54,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3665::DEBUG::2014-09-09 11:38:54,681::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3665::DEBUG::2014-09-09 11:38:54,681::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3665::DEBUG::2014-09-09 11:38:54,681::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3665::DEBUG::2014-09-09 11:38:54,681::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3665::DEBUG::2014-09-09 11:38:54,681::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3665::DEBUG::2014-09-09 11:38:54,682::task::993::Storage.TaskManager.Task::(_decref) Task=`bad75bf2-4eb5-49d5-9361-210e180e53d7`::ref 0 aborting False >Thread-3665::DEBUG::2014-09-09 11:38:54,682::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3665::DEBUG::2014-09-09 11:38:54,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:55,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:55,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896333 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:56,138::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:56,139::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3666::DEBUG::2014-09-09 11:38:56,140::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:57,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:57,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896339 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) (7845) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:58,071::__init__::225::IOProcess::(_processLogs) (7845) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:58,072::__init__::225::IOProcess::(_processLogs) (7845) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:58,072::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:58,072::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:38:58,072::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:38:58,079::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117976 s, 952 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:38:58,080::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:38:58,080::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:38:58,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:38:58,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:38:58,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:38:58,080::__init__::225::IOProcess::(_processLogs) (7846) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:38:58,081::__init__::225::IOProcess::(_processLogs) (7846) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:38:58,081::__init__::225::IOProcess::(_processLogs) (7846) Queuing response >Thread-19::DEBUG::2014-09-09 11:38:58,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:38:58,081::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:59,148::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:59,149::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3667::DEBUG::2014-09-09 11:38:59,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e652472-79bb-4cd2-999a-8130da044424`::moving from state init -> state preparing >Thread-3667::INFO::2014-09-09 11:38:59,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3667::INFO::2014-09-09 11:38:59,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117976', 'lastCheck': '1.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000919963', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114206', 'lastCheck': '6.7', 'valid': True}} >Thread-3667::DEBUG::2014-09-09 11:38:59,151::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e652472-79bb-4cd2-999a-8130da044424`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117976', 'lastCheck': '1.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000919963', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114206', 'lastCheck': '6.7', 'valid': True}} >Thread-3667::DEBUG::2014-09-09 11:38:59,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e652472-79bb-4cd2-999a-8130da044424`::moving from state preparing -> state finished >Thread-3667::DEBUG::2014-09-09 11:38:59,151::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3667::DEBUG::2014-09-09 11:38:59,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3667::DEBUG::2014-09-09 11:38:59,151::task::993::Storage.TaskManager.Task::(_decref) Task=`8e652472-79bb-4cd2-999a-8130da044424`::ref 0 aborting False >Thread-3667::DEBUG::2014-09-09 11:38:59,152::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:38:59,164::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:38:59,164::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3668::DEBUG::2014-09-09 11:38:59,165::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:38:59,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:38:59,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896416 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:39:01,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:01,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896644 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:02,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:02,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3669::DEBUG::2014-09-09 11:39:02,279::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:39:02,488::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:02,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) (7847) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) (7847) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) (7847) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:02,489::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:39:02,490::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:39:02,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000913659 s, 389 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) (7848) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) (7848) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) (7848) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:02,498::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:03,115::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:03,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:03,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:03,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:03,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:03,116::__init__::225::IOProcess::(_processLogs) (7849) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:03,116::__init__::225::IOProcess::(_processLogs) (7849) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:03,116::__init__::225::IOProcess::(_processLogs) (7849) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:03,117::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:39:03,117::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:03,117::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:39:03,124::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000949819 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) (7850) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:03,125::__init__::225::IOProcess::(_processLogs) (7850) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:03,126::__init__::225::IOProcess::(_processLogs) (7850) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:03,126::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:03,126::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:39:03,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) (7851) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) (7851) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) (7851) Building response >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) (7851) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:03,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) (7852) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:03,128::__init__::225::IOProcess::(_processLogs) (7852) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) (7852) Building response >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) (7852) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:03,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) (7853) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) (7853) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) (7853) Building response >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) (7853) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:03,130::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:39:03,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:03,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896132 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:04,722::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3670::DEBUG::2014-09-09 11:39:04,722::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:39:04,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3670::DEBUG::2014-09-09 11:39:04,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c8d4146-fa1e-47ae-ad37-fba90628346f`::moving from state init -> state preparing >Thread-3670::INFO::2014-09-09 11:39:04,724::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3670::INFO::2014-09-09 11:39:04,724::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3670::DEBUG::2014-09-09 11:39:04,724::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c8d4146-fa1e-47ae-ad37-fba90628346f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3670::DEBUG::2014-09-09 11:39:04,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c8d4146-fa1e-47ae-ad37-fba90628346f`::moving from state preparing -> state finished >Thread-3670::DEBUG::2014-09-09 11:39:04,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3670::DEBUG::2014-09-09 11:39:04,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3670::DEBUG::2014-09-09 11:39:04,724::task::993::Storage.TaskManager.Task::(_decref) Task=`4c8d4146-fa1e-47ae-ad37-fba90628346f`::ref 0 aborting False >Thread-3670::DEBUG::2014-09-09 11:39:04,724::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3670::DEBUG::2014-09-09 11:39:04,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:04,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:04,789::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3671::DEBUG::2014-09-09 11:39:04,789::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3671::DEBUG::2014-09-09 11:39:04,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`072c0f68-e504-41aa-b34b-6ea8dc31a38f`::moving from state init -> state preparing >Thread-3671::INFO::2014-09-09 11:39:04,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3671::DEBUG::2014-09-09 11:39:04,790::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e0d4ba34-488c-41c2-9b3d-32c700d6da73`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3671::DEBUG::2014-09-09 11:39:04,791::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3671::DEBUG::2014-09-09 11:39:04,791::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3671::DEBUG::2014-09-09 11:39:04,791::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e0d4ba34-488c-41c2-9b3d-32c700d6da73`::Granted request >Thread-3671::DEBUG::2014-09-09 11:39:04,791::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`072c0f68-e504-41aa-b34b-6ea8dc31a38f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3671::DEBUG::2014-09-09 11:39:04,791::task::993::Storage.TaskManager.Task::(_decref) Task=`072c0f68-e504-41aa-b34b-6ea8dc31a38f`::ref 1 aborting False >Thread-3671::INFO::2014-09-09 11:39:04,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3671::DEBUG::2014-09-09 11:39:04,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`072c0f68-e504-41aa-b34b-6ea8dc31a38f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3671::DEBUG::2014-09-09 11:39:04,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`072c0f68-e504-41aa-b34b-6ea8dc31a38f`::moving from state preparing -> state finished >Thread-3671::DEBUG::2014-09-09 11:39:04,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3671::DEBUG::2014-09-09 11:39:04,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3671::DEBUG::2014-09-09 11:39:04,793::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3671::DEBUG::2014-09-09 11:39:04,793::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3671::DEBUG::2014-09-09 11:39:04,793::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3671::DEBUG::2014-09-09 11:39:04,793::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3671::DEBUG::2014-09-09 11:39:04,794::task::993::Storage.TaskManager.Task::(_decref) Task=`072c0f68-e504-41aa-b34b-6ea8dc31a38f`::ref 0 aborting False >Thread-3671::DEBUG::2014-09-09 11:39:04,794::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3671::DEBUG::2014-09-09 11:39:04,794::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:05,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:05,287::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3672::DEBUG::2014-09-09 11:39:05,288::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:05,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:05,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897997 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:39:07,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:07,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898449 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:08,082::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:08,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:08,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:08,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:08,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:08,083::__init__::225::IOProcess::(_processLogs) (7854) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:08,083::__init__::225::IOProcess::(_processLogs) (7854) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:08,084::__init__::225::IOProcess::(_processLogs) (7854) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:08,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:08,084::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:39:08,084::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:39:08,092::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117373 s, 957 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:08,092::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:08,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:08,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:08,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:08,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:08,093::__init__::225::IOProcess::(_processLogs) (7855) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:08,093::__init__::225::IOProcess::(_processLogs) (7855) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:08,093::__init__::225::IOProcess::(_processLogs) (7855) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:08,093::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:08,296::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:08,297::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3673::DEBUG::2014-09-09 11:39:08,298::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:09,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:09,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897998 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:11,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:11,305::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3674::DEBUG::2014-09-09 11:39:11,306::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:11,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:12,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896299 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) (7856) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) (7856) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:12,500::__init__::225::IOProcess::(_processLogs) (7856) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:12,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:12,501::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:39:12,501::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:39:12,508::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00101042 s, 351 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) (7857) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:12,509::__init__::225::IOProcess::(_processLogs) (7857) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:12,510::__init__::225::IOProcess::(_processLogs) (7857) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:12,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:12,510::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:13,130::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:13,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:13,130::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:13,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:13,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:13,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:13,131::__init__::225::IOProcess::(_processLogs) (7858) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:13,131::__init__::225::IOProcess::(_processLogs) (7858) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:13,132::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|(7858) Building response >Thread-19::DEBUG::2014-09-09 11:39:13,132::__init__::225::IOProcess::(_processLogs) (7858) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:13,132::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:39:13,132::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:13,133::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:39:13,142::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104016 s, 527 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:13,142::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:13,142::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:13,142::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:13,142::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) (7859) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) (7859) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|(7859) Building response >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) (7859) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:13,143::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:13,144::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:13,144::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:13,144::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:39:13,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:13,144::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) (7860) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) (7860) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) (7860) Building response >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) (7860) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:13,145::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) (7861) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) (7861) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:13,146::__init__::225::IOProcess::(_processLogs) (7861) Building response >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) (7861) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:13,147::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) (7862) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) (7862) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) (7862) Building response >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) (7862) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:13,148::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:39:14,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:14,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896565 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:14,315::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:14,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3675::DEBUG::2014-09-09 11:39:14,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5a139e3-c43a-43a7-92c4-e98fd2afc22c`::moving from state init -> state preparing >Thread-3675::INFO::2014-09-09 11:39:14,317::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3675::INFO::2014-09-09 11:39:14,317::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117373', 'lastCheck': '6.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104016', 'lastCheck': '1.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101042', 'lastCheck': '1.8', 'valid': True}} >Thread-3675::DEBUG::2014-09-09 11:39:14,317::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5a139e3-c43a-43a7-92c4-e98fd2afc22c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117373', 'lastCheck': '6.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104016', 'lastCheck': '1.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101042', 'lastCheck': '1.8', 'valid': True}} >Thread-3675::DEBUG::2014-09-09 11:39:14,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5a139e3-c43a-43a7-92c4-e98fd2afc22c`::moving from state preparing -> state finished >Thread-3675::DEBUG::2014-09-09 11:39:14,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3675::DEBUG::2014-09-09 11:39:14,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3675::DEBUG::2014-09-09 11:39:14,317::task::993::Storage.TaskManager.Task::(_decref) Task=`f5a139e3-c43a-43a7-92c4-e98fd2afc22c`::ref 0 aborting False >Thread-3675::DEBUG::2014-09-09 11:39:14,318::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:14,329::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:14,330::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3676::DEBUG::2014-09-09 11:39:14,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:14,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3677::DEBUG::2014-09-09 11:39:14,848::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:39:14,848::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3677::DEBUG::2014-09-09 11:39:14,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`bdff1d49-78b8-4f02-a6fd-073ccbdc0c1c`::moving from state init -> state preparing >Thread-3677::INFO::2014-09-09 11:39:14,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3677::INFO::2014-09-09 11:39:14,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3677::DEBUG::2014-09-09 11:39:14,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`bdff1d49-78b8-4f02-a6fd-073ccbdc0c1c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3677::DEBUG::2014-09-09 11:39:14,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`bdff1d49-78b8-4f02-a6fd-073ccbdc0c1c`::moving from state preparing -> state finished >Thread-3677::DEBUG::2014-09-09 11:39:14,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3677::DEBUG::2014-09-09 11:39:14,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3677::DEBUG::2014-09-09 11:39:14,850::task::993::Storage.TaskManager.Task::(_decref) Task=`bdff1d49-78b8-4f02-a6fd-073ccbdc0c1c`::ref 0 aborting False >Thread-3677::DEBUG::2014-09-09 11:39:14,850::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3677::DEBUG::2014-09-09 11:39:14,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:14,879::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3678::DEBUG::2014-09-09 11:39:14,879::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:39:14,879::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3678::DEBUG::2014-09-09 11:39:14,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1ffc216-8e94-434f-ab0f-f0196938ec60`::moving from state init -> state preparing >Thread-3678::INFO::2014-09-09 11:39:14,880::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3678::DEBUG::2014-09-09 11:39:14,881::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b8710863-7750-4d85-b1ab-bee196b3a868`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3678::DEBUG::2014-09-09 11:39:14,881::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3678::DEBUG::2014-09-09 11:39:14,881::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3678::DEBUG::2014-09-09 11:39:14,881::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b8710863-7750-4d85-b1ab-bee196b3a868`::Granted request >Thread-3678::DEBUG::2014-09-09 11:39:14,881::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e1ffc216-8e94-434f-ab0f-f0196938ec60`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3678::DEBUG::2014-09-09 11:39:14,881::task::993::Storage.TaskManager.Task::(_decref) Task=`e1ffc216-8e94-434f-ab0f-f0196938ec60`::ref 1 aborting False >Thread-3678::INFO::2014-09-09 11:39:14,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3678::DEBUG::2014-09-09 11:39:14,883::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1ffc216-8e94-434f-ab0f-f0196938ec60`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3678::DEBUG::2014-09-09 11:39:14,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1ffc216-8e94-434f-ab0f-f0196938ec60`::moving from state preparing -> state finished >Thread-3678::DEBUG::2014-09-09 11:39:14,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3678::DEBUG::2014-09-09 11:39:14,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3678::DEBUG::2014-09-09 11:39:14,884::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3678::DEBUG::2014-09-09 11:39:14,884::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3678::DEBUG::2014-09-09 11:39:14,884::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3678::DEBUG::2014-09-09 11:39:14,884::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3678::DEBUG::2014-09-09 11:39:14,884::task::993::Storage.TaskManager.Task::(_decref) Task=`e1ffc216-8e94-434f-ab0f-f0196938ec60`::ref 0 aborting False >Thread-3678::DEBUG::2014-09-09 11:39:14,884::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3678::DEBUG::2014-09-09 11:39:14,884::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:16,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:16,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897123 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:17,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:17,423::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3679::DEBUG::2014-09-09 11:39:17,424::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:39:18,094::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:18,094::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:18,094::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:18,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:18,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:18,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:18,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:18,095::__init__::225::IOProcess::(_processLogs) (7863) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:18,095::__init__::225::IOProcess::(_processLogs) (7863) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:18,095::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|(7863) Building response >Thread-23::DEBUG::2014-09-09 11:39:18,096::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:18,096::__init__::225::IOProcess::(_processLogs) (7863) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:18,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:18,101::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:39:18,102::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110591 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:18,103::__init__::225::IOProcess::(_processLogs) (7864) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:18,104::__init__::225::IOProcess::(_processLogs) (7864) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:18,104::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|(7864) Building response >Thread-19::DEBUG::2014-09-09 11:39:18,104::__init__::225::IOProcess::(_processLogs) (7864) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:18,104::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:18,105::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:39:18,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:18,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896606 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:39:20,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:20,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:20,441::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3680::DEBUG::2014-09-09 11:39:20,442::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:20,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897322 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:39:22,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) (7865) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:22,511::__init__::225::IOProcess::(_processLogs) (7865) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:22,571::__init__::225::IOProcess::(_processLogs) Message size is 148DEBUG|(7865) Building response >Thread-19::DEBUG::2014-09-09 11:39:22,571::__init__::225::IOProcess::(_processLogs) (7865) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:22,572::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:39:22,573::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:22,573::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:39:22,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970981 s, 10.5 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:39:22,580::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000881696 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:22,581::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:22,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:22,582::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:22,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:22,583::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:22,584::__init__::225::IOProcess::(_processLogs) (7866) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:22,585::__init__::225::IOProcess::(_processLogs) (7866) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:22,585::__init__::225::IOProcess::(_processLogs) (7866) Building response >Thread-19::DEBUG::2014-09-09 11:39:22,586::__init__::225::IOProcess::(_processLogs) (7866) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:22,586::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:22,587::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:23,148::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:23,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:23,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:23,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:23,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:23,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:23,149::__init__::225::IOProcess::(_processLogs) (7867) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:23,149::__init__::225::IOProcess::(_processLogs) (7867) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:23,149::__init__::225::IOProcess::(_processLogs) (7867) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:23,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:39:23,149::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:39:23,157::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00105608 s, 519 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:23,157::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:23,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:23,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:23,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:23,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) (7868) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) (7868) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7868) Building response >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) (7868) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:23,158::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:23,159::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:23,159::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:39:23,159::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:23,159::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:23,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:23,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) (7869) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) (7869) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) (7869) Building response >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) (7869) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:39:23,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) (7870) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) (7870) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) (7870) Building response >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) (7870) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:23,161::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:23,162::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:23,162::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:39:23,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:23,162::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:23,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:23,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) (7871) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) (7871) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) (7871) Building response >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) (7871) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:23,163::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:23,450::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:23,450::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3681::DEBUG::2014-09-09 11:39:23,451::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:24,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:24,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902533 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:24,923::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:24,924::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3682::DEBUG::2014-09-09 11:39:24,924::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3682::DEBUG::2014-09-09 11:39:24,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`16ac705d-2a12-4560-b66e-814f07d52d23`::moving from state init -> state preparing >Thread-3682::INFO::2014-09-09 11:39:24,925::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3682::INFO::2014-09-09 11:39:24,925::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3682::DEBUG::2014-09-09 11:39:24,926::task::1191::Storage.TaskManager.Task::(prepare) Task=`16ac705d-2a12-4560-b66e-814f07d52d23`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3682::DEBUG::2014-09-09 11:39:24,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`16ac705d-2a12-4560-b66e-814f07d52d23`::moving from state preparing -> state finished >Thread-3682::DEBUG::2014-09-09 11:39:24,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3682::DEBUG::2014-09-09 11:39:24,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3682::DEBUG::2014-09-09 11:39:24,926::task::993::Storage.TaskManager.Task::(_decref) Task=`16ac705d-2a12-4560-b66e-814f07d52d23`::ref 0 aborting False >Thread-3682::DEBUG::2014-09-09 11:39:24,926::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3682::DEBUG::2014-09-09 11:39:24,926::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:24,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:24,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3683::DEBUG::2014-09-09 11:39:24,987::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3683::DEBUG::2014-09-09 11:39:24,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`d54f726c-8377-41ee-b2ed-4b15688ceb50`::moving from state init -> state preparing >Thread-3683::INFO::2014-09-09 11:39:24,988::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3683::DEBUG::2014-09-09 11:39:24,989::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1dc06089-c2ea-4eca-910b-c928978265ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3683::DEBUG::2014-09-09 11:39:24,989::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3683::DEBUG::2014-09-09 11:39:24,989::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3683::DEBUG::2014-09-09 11:39:24,989::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1dc06089-c2ea-4eca-910b-c928978265ab`::Granted request >Thread-3683::DEBUG::2014-09-09 11:39:24,989::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d54f726c-8377-41ee-b2ed-4b15688ceb50`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3683::DEBUG::2014-09-09 11:39:24,989::task::993::Storage.TaskManager.Task::(_decref) Task=`d54f726c-8377-41ee-b2ed-4b15688ceb50`::ref 1 aborting False >Thread-3683::INFO::2014-09-09 11:39:24,991::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3683::DEBUG::2014-09-09 11:39:24,991::task::1191::Storage.TaskManager.Task::(prepare) Task=`d54f726c-8377-41ee-b2ed-4b15688ceb50`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3683::DEBUG::2014-09-09 11:39:24,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`d54f726c-8377-41ee-b2ed-4b15688ceb50`::moving from state preparing -> state finished >Thread-3683::DEBUG::2014-09-09 11:39:24,991::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3683::DEBUG::2014-09-09 11:39:24,991::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3683::DEBUG::2014-09-09 11:39:24,991::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3683::DEBUG::2014-09-09 11:39:24,992::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3683::DEBUG::2014-09-09 11:39:24,992::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3683::DEBUG::2014-09-09 11:39:24,992::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3683::DEBUG::2014-09-09 11:39:24,992::task::993::Storage.TaskManager.Task::(_decref) Task=`d54f726c-8377-41ee-b2ed-4b15688ceb50`::ref 0 aborting False >Thread-3683::DEBUG::2014-09-09 11:39:24,992::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3683::DEBUG::2014-09-09 11:39:24,992::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:26,461::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:26,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3684::DEBUG::2014-09-09 11:39:26,463::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:26,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:26,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901356 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:28,105::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:28,105::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) (7872) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) (7872) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:28,106::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7872) Building response >Thread-23::DEBUG::2014-09-09 11:39:28,107::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:28,107::__init__::225::IOProcess::(_processLogs) (7872) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:28,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:28,112::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:39:28,114::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114498 s, 981 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:28,114::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:28,114::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:28,114::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:28,114::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) (7873) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) (7873) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7873) Building response >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) (7873) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:28,115::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:28,116::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:39:28,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:28,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898936 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:29,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:29,473::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3685::DEBUG::2014-09-09 11:39:29,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f37059e-70c5-4ed3-8d3f-8ae4b4f46669`::moving from state init -> state preparing >Thread-3685::INFO::2014-09-09 11:39:29,475::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3685::INFO::2014-09-09 11:39:29,475::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114498', 'lastCheck': '1.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105608', 'lastCheck': '6.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000881696', 'lastCheck': '6.9', 'valid': True}} >Thread-3685::DEBUG::2014-09-09 11:39:29,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f37059e-70c5-4ed3-8d3f-8ae4b4f46669`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114498', 'lastCheck': '1.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105608', 'lastCheck': '6.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000881696', 'lastCheck': '6.9', 'valid': True}} >Thread-3685::DEBUG::2014-09-09 11:39:29,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f37059e-70c5-4ed3-8d3f-8ae4b4f46669`::moving from state preparing -> state finished >Thread-3685::DEBUG::2014-09-09 11:39:29,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3685::DEBUG::2014-09-09 11:39:29,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3685::DEBUG::2014-09-09 11:39:29,475::task::993::Storage.TaskManager.Task::(_decref) Task=`0f37059e-70c5-4ed3-8d3f-8ae4b4f46669`::ref 0 aborting False >Thread-3685::DEBUG::2014-09-09 11:39:29,476::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:29,488::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:29,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3686::DEBUG::2014-09-09 11:39:29,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:30,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:31,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899429 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:32,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:32,574::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3687::DEBUG::2014-09-09 11:39:32,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:32,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:32,586::__init__::225::IOProcess::(_processLogs) (7874) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:32,586::__init__::225::IOProcess::(_processLogs) (7874) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:32,587::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7874) Building response >Thread-19::DEBUG::2014-09-09 11:39:32,587::__init__::225::IOProcess::(_processLogs) (7874) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:32,588::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:39:32,588::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:32,588::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:39:32,595::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000929464 s, 382 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:32,596::__init__::225::IOProcess::(_processLogs) (7875) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:32,597::__init__::225::IOProcess::(_processLogs) (7875) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:32,597::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7875) Building response >Thread-19::DEBUG::2014-09-09 11:39:32,597::__init__::225::IOProcess::(_processLogs) (7875) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:32,597::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:32,598::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:39:33,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:33,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897558 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:33,163::__init__::225::IOProcess::(_processLogs) (7876) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:33,164::__init__::225::IOProcess::(_processLogs) (7876) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:33,164::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7876) Building response >Thread-19::DEBUG::2014-09-09 11:39:33,164::__init__::225::IOProcess::(_processLogs) (7876) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:33,164::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:39:33,164::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:33,165::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:39:33,172::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000935464 s, 586 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:33,172::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:33,172::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) (7877) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) (7877) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(7877) Building response >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) (7877) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:33,173::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:33,174::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:33,174::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:33,174::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:39:33,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) (7878) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) (7878) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) (7878) Building response >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) (7878) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:33,175::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:33,176::__init__::225::IOProcess::(_processLogs) (7879) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) (7879) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) (7879) Building response >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) (7879) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:33,177::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) (7880) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) (7880) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) (7880) Building response >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) (7880) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:33,178::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:35,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3688::DEBUG::2014-09-09 11:39:35,049::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:39:35,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3688::DEBUG::2014-09-09 11:39:35,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`34321f99-3f4d-48a0-b6ab-a7145cdb9374`::moving from state init -> state preparing >Thread-3688::INFO::2014-09-09 11:39:35,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3688::INFO::2014-09-09 11:39:35,050::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3688::DEBUG::2014-09-09 11:39:35,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`34321f99-3f4d-48a0-b6ab-a7145cdb9374`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3688::DEBUG::2014-09-09 11:39:35,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`34321f99-3f4d-48a0-b6ab-a7145cdb9374`::moving from state preparing -> state finished >Thread-3688::DEBUG::2014-09-09 11:39:35,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3688::DEBUG::2014-09-09 11:39:35,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3688::DEBUG::2014-09-09 11:39:35,051::task::993::Storage.TaskManager.Task::(_decref) Task=`34321f99-3f4d-48a0-b6ab-a7145cdb9374`::ref 0 aborting False >Thread-3688::DEBUG::2014-09-09 11:39:35,051::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3688::DEBUG::2014-09-09 11:39:35,051::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:35,081::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:35,082::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3689::DEBUG::2014-09-09 11:39:35,082::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3689::DEBUG::2014-09-09 11:39:35,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`23c35690-2a53-4548-96fe-81ea5cbf74be`::moving from state init -> state preparing >Thread-3689::INFO::2014-09-09 11:39:35,082::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3689::DEBUG::2014-09-09 11:39:35,083::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`710ea1b2-05d5-4e70-aa40-0b2b888aac00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3689::DEBUG::2014-09-09 11:39:35,083::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3689::DEBUG::2014-09-09 11:39:35,083::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3689::DEBUG::2014-09-09 11:39:35,083::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`710ea1b2-05d5-4e70-aa40-0b2b888aac00`::Granted request >Thread-3689::DEBUG::2014-09-09 11:39:35,083::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`23c35690-2a53-4548-96fe-81ea5cbf74be`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3689::DEBUG::2014-09-09 11:39:35,083::task::993::Storage.TaskManager.Task::(_decref) Task=`23c35690-2a53-4548-96fe-81ea5cbf74be`::ref 1 aborting False >Thread-3689::INFO::2014-09-09 11:39:35,085::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3689::DEBUG::2014-09-09 11:39:35,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`23c35690-2a53-4548-96fe-81ea5cbf74be`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3689::DEBUG::2014-09-09 11:39:35,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`23c35690-2a53-4548-96fe-81ea5cbf74be`::moving from state preparing -> state finished >Thread-3689::DEBUG::2014-09-09 11:39:35,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3689::DEBUG::2014-09-09 11:39:35,085::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3689::DEBUG::2014-09-09 11:39:35,085::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3689::DEBUG::2014-09-09 11:39:35,086::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3689::DEBUG::2014-09-09 11:39:35,086::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3689::DEBUG::2014-09-09 11:39:35,086::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3689::DEBUG::2014-09-09 11:39:35,086::task::993::Storage.TaskManager.Task::(_decref) Task=`23c35690-2a53-4548-96fe-81ea5cbf74be`::ref 0 aborting False >Thread-3689::DEBUG::2014-09-09 11:39:35,086::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3689::DEBUG::2014-09-09 11:39:35,086::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:35,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:35,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089791 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:35,582::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:35,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3690::DEBUG::2014-09-09 11:39:35,584::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:37,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:37,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897658 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) (7881) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:38,117::__init__::225::IOProcess::(_processLogs) (7881) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:38,118::__init__::225::IOProcess::(_processLogs) (7881) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:38,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:38,118::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:39:38,119::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:39:38,126::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111372 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:38,126::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:38,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:38,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) (7882) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) (7882) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) (7882) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:38,127::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:38,593::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:38,593::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3691::DEBUG::2014-09-09 11:39:38,594::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:39,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:39,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897042 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:39:41,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:41,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897606 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:41,601::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:41,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3692::DEBUG::2014-09-09 11:39:41,603::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:39:42,598::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:42,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:42,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:42,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:42,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:42,599::__init__::225::IOProcess::(_processLogs) (7883) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:42,599::__init__::225::IOProcess::(_processLogs) (7883) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:42,599::__init__::225::IOProcess::(_processLogs) (7883) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:42,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:42,599::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:39:42,600::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:39:42,606::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00106726 s, 333 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:42,606::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) (7884) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) (7884) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) (7884) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:42,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:42,608::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:43,178::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:43,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:43,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:43,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:43,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:43,179::__init__::225::IOProcess::(_processLogs) (7885) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:43,179::__init__::225::IOProcess::(_processLogs) (7885) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:43,179::__init__::225::IOProcess::(_processLogs) (7885) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:43,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:39:43,180::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:43,180::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:39:43,187::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000973419 s, 563 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) (7886) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:43,188::__init__::225::IOProcess::(_processLogs) (7886) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:43,189::__init__::225::IOProcess::(_processLogs) (7886) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:43,189::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) (7887) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:43,190::__init__::225::IOProcess::(_processLogs) (7887) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) (7887) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:43,191::__init__::225::IOProcess::(_processLogs) (7888) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:43,192::__init__::225::IOProcess::(_processLogs) (7888) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:43,192::__init__::225::IOProcess::(_processLogs) (7888) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:43,192::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:43,192::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:39:43,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:43,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:43,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:43,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:43,193::__init__::225::IOProcess::(_processLogs) (7889) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:43,193::__init__::225::IOProcess::(_processLogs) (7889) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:43,193::__init__::225::IOProcess::(_processLogs) (7889) Building response >Thread-19::DEBUG::2014-09-09 11:39:43,194::__init__::225::IOProcess::(_processLogs) (7889) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:43,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:43,194::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:39:43,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:43,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896733 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:44,641::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:44,642::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3693::DEBUG::2014-09-09 11:39:44,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2acefb2-7f9b-425d-b33b-416569e46591`::moving from state init -> state preparing >Thread-3693::INFO::2014-09-09 11:39:44,643::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3693::INFO::2014-09-09 11:39:44,644::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111372', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000973419', 'lastCheck': '1.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106726', 'lastCheck': '2.0', 'valid': True}} >Thread-3693::DEBUG::2014-09-09 11:39:44,644::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2acefb2-7f9b-425d-b33b-416569e46591`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111372', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000973419', 'lastCheck': '1.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106726', 'lastCheck': '2.0', 'valid': True}} >Thread-3693::DEBUG::2014-09-09 11:39:44,644::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2acefb2-7f9b-425d-b33b-416569e46591`::moving from state preparing -> state finished >Thread-3693::DEBUG::2014-09-09 11:39:44,644::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3693::DEBUG::2014-09-09 11:39:44,644::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3693::DEBUG::2014-09-09 11:39:44,644::task::993::Storage.TaskManager.Task::(_decref) Task=`e2acefb2-7f9b-425d-b33b-416569e46591`::ref 0 aborting False >Thread-3693::DEBUG::2014-09-09 11:39:44,645::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:44,655::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:44,656::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3694::DEBUG::2014-09-09 11:39:44,656::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:45,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:45,128::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3695::DEBUG::2014-09-09 11:39:45,128::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3695::DEBUG::2014-09-09 11:39:45,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`9603527c-e4fe-44be-b18b-4226f847d318`::moving from state init -> state preparing >Thread-3695::INFO::2014-09-09 11:39:45,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3695::INFO::2014-09-09 11:39:45,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3695::DEBUG::2014-09-09 11:39:45,129::task::1191::Storage.TaskManager.Task::(prepare) Task=`9603527c-e4fe-44be-b18b-4226f847d318`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3695::DEBUG::2014-09-09 11:39:45,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`9603527c-e4fe-44be-b18b-4226f847d318`::moving from state preparing -> state finished >Thread-3695::DEBUG::2014-09-09 11:39:45,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3695::DEBUG::2014-09-09 11:39:45,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3695::DEBUG::2014-09-09 11:39:45,129::task::993::Storage.TaskManager.Task::(_decref) Task=`9603527c-e4fe-44be-b18b-4226f847d318`::ref 0 aborting False >Thread-3695::DEBUG::2014-09-09 11:39:45,129::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3695::DEBUG::2014-09-09 11:39:45,130::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:45,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:45,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3696::DEBUG::2014-09-09 11:39:45,192::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3696::DEBUG::2014-09-09 11:39:45,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ba65a2f-ec1e-41f8-9abf-2c213325547d`::moving from state init -> state preparing >Thread-3696::INFO::2014-09-09 11:39:45,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3696::DEBUG::2014-09-09 11:39:45,193::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`91225e4e-32b0-4218-9ea2-09806aa4a835`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3696::DEBUG::2014-09-09 11:39:45,193::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3696::DEBUG::2014-09-09 11:39:45,193::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3696::DEBUG::2014-09-09 11:39:45,194::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`91225e4e-32b0-4218-9ea2-09806aa4a835`::Granted request >Thread-3696::DEBUG::2014-09-09 11:39:45,194::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4ba65a2f-ec1e-41f8-9abf-2c213325547d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3696::DEBUG::2014-09-09 11:39:45,194::task::993::Storage.TaskManager.Task::(_decref) Task=`4ba65a2f-ec1e-41f8-9abf-2c213325547d`::ref 1 aborting False >Thread-3696::INFO::2014-09-09 11:39:45,195::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3696::DEBUG::2014-09-09 11:39:45,195::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ba65a2f-ec1e-41f8-9abf-2c213325547d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3696::DEBUG::2014-09-09 11:39:45,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ba65a2f-ec1e-41f8-9abf-2c213325547d`::moving from state preparing -> state finished >Thread-3696::DEBUG::2014-09-09 11:39:45,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3696::DEBUG::2014-09-09 11:39:45,196::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3696::DEBUG::2014-09-09 11:39:45,196::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3696::DEBUG::2014-09-09 11:39:45,196::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3696::DEBUG::2014-09-09 11:39:45,196::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3696::DEBUG::2014-09-09 11:39:45,196::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3696::DEBUG::2014-09-09 11:39:45,196::task::993::Storage.TaskManager.Task::(_decref) Task=`4ba65a2f-ec1e-41f8-9abf-2c213325547d`::ref 0 aborting False >Thread-3696::DEBUG::2014-09-09 11:39:45,196::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3696::DEBUG::2014-09-09 11:39:45,197::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:45,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:45,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896428 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:47,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:47,707::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3697::DEBUG::2014-09-09 11:39:47,708::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:47,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:47,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897059 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:48,128::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:48,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) (7890) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) (7890) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) (7890) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:48,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:39:48,130::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:39:48,136::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00118467 s, 948 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) (7891) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) (7891) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:48,137::__init__::225::IOProcess::(_processLogs) (7891) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:48,138::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:39:49,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:49,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0948349 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:50,715::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:50,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3698::DEBUG::2014-09-09 11:39:50,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:52,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:52,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897289 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:52,608::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) (7892) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) (7892) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) (7892) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:52,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:39:52,610::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:52,610::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:39:52,616::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000943849 s, 376 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:52,617::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:52,617::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:39:52,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:52,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:52,617::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:52,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:52,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:52,618::__init__::225::IOProcess::(_processLogs) (7893) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:52,618::__init__::225::IOProcess::(_processLogs) (7893) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:52,618::__init__::225::IOProcess::(_processLogs) DEBUG|(7893) Building response >Thread-19::DEBUG::2014-09-09 11:39:52,618::__init__::225::IOProcess::(_processLogs) (7893) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:52,618::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:52,619::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:53,193::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) (7894) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) (7894) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) DEBUG|(7894) Building response >Thread-19::DEBUG::2014-09-09 11:39:53,194::__init__::225::IOProcess::(_processLogs) (7894) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:53,195::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:53,195::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:39:53,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:39:53,203::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000987046 s, 555 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:53,203::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:53,203::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:39:53,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:53,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:53,203::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) (7895) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) (7895) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) DEBUG|(7895) Building response >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) (7895) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:53,204::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:39:53,205::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:53,205::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:39:53,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:53,205::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:53,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) (7896) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) (7896) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) (7896) Building response >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) (7896) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:39:53,206::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) (7897) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) (7897) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) (7897) Building response >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) (7897) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:53,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) (7898) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) (7898) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:39:53,208::__init__::225::IOProcess::(_processLogs) DEBUG|(7898) Building response >Thread-19::DEBUG::2014-09-09 11:39:53,209::__init__::225::IOProcess::(_processLogs) (7898) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:53,209::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:53,209::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:53,724::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:53,724::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3699::DEBUG::2014-09-09 11:39:53,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:54,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:54,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901829 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:55,250::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3700::DEBUG::2014-09-09 11:39:55,251::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:39:55,251::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3700::DEBUG::2014-09-09 11:39:55,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3387103-cd7e-4818-9acd-2e8ded4d35a6`::moving from state init -> state preparing >Thread-3700::INFO::2014-09-09 11:39:55,252::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3700::INFO::2014-09-09 11:39:55,252::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3700::DEBUG::2014-09-09 11:39:55,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3387103-cd7e-4818-9acd-2e8ded4d35a6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3700::DEBUG::2014-09-09 11:39:55,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3387103-cd7e-4818-9acd-2e8ded4d35a6`::moving from state preparing -> state finished >Thread-3700::DEBUG::2014-09-09 11:39:55,253::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3700::DEBUG::2014-09-09 11:39:55,253::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3700::DEBUG::2014-09-09 11:39:55,253::task::993::Storage.TaskManager.Task::(_decref) Task=`c3387103-cd7e-4818-9acd-2e8ded4d35a6`::ref 0 aborting False >Thread-3700::DEBUG::2014-09-09 11:39:55,253::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3700::DEBUG::2014-09-09 11:39:55,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:55,282::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:55,283::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3701::DEBUG::2014-09-09 11:39:55,283::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3701::DEBUG::2014-09-09 11:39:55,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`af71df4c-b722-4ed6-9e6f-7eddffde27e4`::moving from state init -> state preparing >Thread-3701::INFO::2014-09-09 11:39:55,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3701::DEBUG::2014-09-09 11:39:55,284::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9fb8ebfc-6f89-43c6-8c82-19f506097fa1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3701::DEBUG::2014-09-09 11:39:55,284::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3701::DEBUG::2014-09-09 11:39:55,285::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3701::DEBUG::2014-09-09 11:39:55,285::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9fb8ebfc-6f89-43c6-8c82-19f506097fa1`::Granted request >Thread-3701::DEBUG::2014-09-09 11:39:55,286::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af71df4c-b722-4ed6-9e6f-7eddffde27e4`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3701::DEBUG::2014-09-09 11:39:55,286::task::993::Storage.TaskManager.Task::(_decref) Task=`af71df4c-b722-4ed6-9e6f-7eddffde27e4`::ref 1 aborting False >Thread-3701::INFO::2014-09-09 11:39:55,287::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3701::DEBUG::2014-09-09 11:39:55,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`af71df4c-b722-4ed6-9e6f-7eddffde27e4`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3701::DEBUG::2014-09-09 11:39:55,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`af71df4c-b722-4ed6-9e6f-7eddffde27e4`::moving from state preparing -> state finished >Thread-3701::DEBUG::2014-09-09 11:39:55,287::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3701::DEBUG::2014-09-09 11:39:55,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3701::DEBUG::2014-09-09 11:39:55,288::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3701::DEBUG::2014-09-09 11:39:55,288::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3701::DEBUG::2014-09-09 11:39:55,288::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3701::DEBUG::2014-09-09 11:39:55,288::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3701::DEBUG::2014-09-09 11:39:55,288::task::993::Storage.TaskManager.Task::(_decref) Task=`af71df4c-b722-4ed6-9e6f-7eddffde27e4`::ref 0 aborting False >Thread-3701::DEBUG::2014-09-09 11:39:55,288::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3701::DEBUG::2014-09-09 11:39:55,288::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:39:56,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:56,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897049 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:56,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:56,731::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3702::DEBUG::2014-09-09 11:39:56,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:39:58,138::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) (7899) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) (7899) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) DEBUG|(7899) Building response >Thread-19::DEBUG::2014-09-09 11:39:58,139::__init__::225::IOProcess::(_processLogs) (7899) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:58,140::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:39:58,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:39:58,140::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:39:58,148::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109953 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:39:58,148::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:39:58,148::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:39:58,148::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) (7900) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) (7900) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) DEBUG|(7900) Building response >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) (7900) Queuing response >Thread-19::DEBUG::2014-09-09 11:39:58,149::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:39:58,150::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:39:58,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:39:58,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896338 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:59,739::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:59,740::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3703::DEBUG::2014-09-09 11:39:59,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`a347d956-95cd-4479-bd6f-a6fe96bf16ce`::moving from state init -> state preparing >Thread-3703::INFO::2014-09-09 11:39:59,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3703::INFO::2014-09-09 11:39:59,742::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109953', 'lastCheck': '1.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987046', 'lastCheck': '6.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000943849', 'lastCheck': '7.1', 'valid': True}} >Thread-3703::DEBUG::2014-09-09 11:39:59,742::task::1191::Storage.TaskManager.Task::(prepare) Task=`a347d956-95cd-4479-bd6f-a6fe96bf16ce`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109953', 'lastCheck': '1.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987046', 'lastCheck': '6.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000943849', 'lastCheck': '7.1', 'valid': True}} >Thread-3703::DEBUG::2014-09-09 11:39:59,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`a347d956-95cd-4479-bd6f-a6fe96bf16ce`::moving from state preparing -> state finished >Thread-3703::DEBUG::2014-09-09 11:39:59,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3703::DEBUG::2014-09-09 11:39:59,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3703::DEBUG::2014-09-09 11:39:59,742::task::993::Storage.TaskManager.Task::(_decref) Task=`a347d956-95cd-4479-bd6f-a6fe96bf16ce`::ref 0 aborting False >Thread-3703::DEBUG::2014-09-09 11:39:59,743::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:39:59,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:39:59,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3704::DEBUG::2014-09-09 11:39:59,755::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:00,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:00,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897364 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:40:02,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:02,619::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) (7901) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:02,620::__init__::225::IOProcess::(_processLogs) (7901) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:02,634::__init__::225::IOProcess::(_processLogs) DEBUG|(7901) Building response >Thread-19::DEBUG::2014-09-09 11:40:02,635::__init__::225::IOProcess::(_processLogs) (7901) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:02,635::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:40:02,636::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:02,637::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:40:02,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.096806 s, 10.6 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:40:02,644::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000902671 s, 393 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:02,645::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:02,646::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:02,646::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:02,647::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:02,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:02,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:02,648::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:02,649::__init__::225::IOProcess::(_processLogs) (7902) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:02,650::__init__::225::IOProcess::(_processLogs) (7902) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:02,650::__init__::225::IOProcess::(_processLogs) (7902) Building response >Thread-19::DEBUG::2014-09-09 11:40:02,650::__init__::225::IOProcess::(_processLogs) (7902) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:02,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:02,651::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:02,819::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:02,819::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3705::DEBUG::2014-09-09 11:40:02,820::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:40:03,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) (7903) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) (7903) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) DEBUG|(7903) Building response >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) (7903) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:03,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:03,211::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:40:03,211::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:40:03,218::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00103398 s, 530 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:03,218::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:03,218::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:03,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:03,218::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) (7904) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) (7904) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) DEBUG|(7904) Building response >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) (7904) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:03,219::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:40:03,220::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:40:03,220::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:03,220::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:40:03,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:03,220::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) (7905) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) (7905) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) (7905) Building response >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) (7905) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:03,221::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) (7906) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) (7906) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) (7906) Building response >Thread-19::DEBUG::2014-09-09 11:40:03,222::__init__::225::IOProcess::(_processLogs) (7906) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:03,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:03,223::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:03,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:03,223::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:40:03,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:03,223::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) (7907) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) (7907) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) (7907) Building response >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) (7907) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:03,224::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:40:04,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:04,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901792 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:05,327::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3706::DEBUG::2014-09-09 11:40:05,327::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:40:05,327::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3706::DEBUG::2014-09-09 11:40:05,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bfe2dc1-06a2-4bbe-8b20-1a73cd286960`::moving from state init -> state preparing >Thread-3706::INFO::2014-09-09 11:40:05,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3706::INFO::2014-09-09 11:40:05,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3706::DEBUG::2014-09-09 11:40:05,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bfe2dc1-06a2-4bbe-8b20-1a73cd286960`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3706::DEBUG::2014-09-09 11:40:05,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bfe2dc1-06a2-4bbe-8b20-1a73cd286960`::moving from state preparing -> state finished >Thread-3706::DEBUG::2014-09-09 11:40:05,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3706::DEBUG::2014-09-09 11:40:05,329::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3706::DEBUG::2014-09-09 11:40:05,329::task::993::Storage.TaskManager.Task::(_decref) Task=`5bfe2dc1-06a2-4bbe-8b20-1a73cd286960`::ref 0 aborting False >Thread-3706::DEBUG::2014-09-09 11:40:05,329::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3706::DEBUG::2014-09-09 11:40:05,329::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:05,392::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:05,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3707::DEBUG::2014-09-09 11:40:05,392::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3707::DEBUG::2014-09-09 11:40:05,393::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ea42ee7-e0b1-40c6-bb6d-7724b1065558`::moving from state init -> state preparing >Thread-3707::INFO::2014-09-09 11:40:05,393::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3707::DEBUG::2014-09-09 11:40:05,393::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`babc4f9f-a4a1-4927-a827-2a9b6dfdb061`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3707::DEBUG::2014-09-09 11:40:05,393::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3707::DEBUG::2014-09-09 11:40:05,394::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3707::DEBUG::2014-09-09 11:40:05,394::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`babc4f9f-a4a1-4927-a827-2a9b6dfdb061`::Granted request >Thread-3707::DEBUG::2014-09-09 11:40:05,394::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4ea42ee7-e0b1-40c6-bb6d-7724b1065558`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3707::DEBUG::2014-09-09 11:40:05,394::task::993::Storage.TaskManager.Task::(_decref) Task=`4ea42ee7-e0b1-40c6-bb6d-7724b1065558`::ref 1 aborting False >Thread-3707::INFO::2014-09-09 11:40:05,396::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3707::DEBUG::2014-09-09 11:40:05,396::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ea42ee7-e0b1-40c6-bb6d-7724b1065558`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3707::DEBUG::2014-09-09 11:40:05,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ea42ee7-e0b1-40c6-bb6d-7724b1065558`::moving from state preparing -> state finished >Thread-3707::DEBUG::2014-09-09 11:40:05,396::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3707::DEBUG::2014-09-09 11:40:05,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3707::DEBUG::2014-09-09 11:40:05,396::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3707::DEBUG::2014-09-09 11:40:05,396::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3707::DEBUG::2014-09-09 11:40:05,396::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3707::DEBUG::2014-09-09 11:40:05,396::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3707::DEBUG::2014-09-09 11:40:05,397::task::993::Storage.TaskManager.Task::(_decref) Task=`4ea42ee7-e0b1-40c6-bb6d-7724b1065558`::ref 0 aborting False >Thread-3707::DEBUG::2014-09-09 11:40:05,397::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3707::DEBUG::2014-09-09 11:40:05,397::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:05,830::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:05,831::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3708::DEBUG::2014-09-09 11:40:05,832::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:06,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:06,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895218 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:08,150::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) (7908) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:08,151::__init__::225::IOProcess::(_processLogs) (7908) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:08,152::__init__::225::IOProcess::(_processLogs) DEBUG|(7908) Building response >Thread-19::DEBUG::2014-09-09 11:40:08,152::__init__::225::IOProcess::(_processLogs) (7908) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:08,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:08,152::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:40:08,152::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:40:08,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119021 s, 944 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:08,160::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:08,160::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:08,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) (7909) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) (7909) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) DEBUG|(7909) Building response >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) (7909) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:08,161::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:08,839::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:08,840::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3709::DEBUG::2014-09-09 11:40:08,841::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:08,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:08,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895534 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:40:10,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:11,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08982 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:11,845::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:11,846::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3710::DEBUG::2014-09-09 11:40:11,847::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:40:12,650::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:12,650::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:12,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:12,650::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:12,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:12,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:12,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:12,651::__init__::225::IOProcess::(_processLogs) (7910) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:12,651::__init__::225::IOProcess::(_processLogs) (7910) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:12,651::__init__::225::IOProcess::(_processLogs) DEBUG|(7910) Building response >Thread-19::DEBUG::2014-09-09 11:40:12,651::__init__::225::IOProcess::(_processLogs) (7910) Queuing response >Thread-3443::DEBUG::2014-09-09 11:40:12,652::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:12,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:12,657::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:40:12,659::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00094928 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:12,659::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:12,659::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) (7911) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) (7911) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) DEBUG|(7911) Building response >Thread-19::DEBUG::2014-09-09 11:40:12,660::__init__::225::IOProcess::(_processLogs) (7911) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:12,661::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:40:12,661::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:40:13,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:13,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896852 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:13,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:13,225::__init__::225::IOProcess::(_processLogs) (7912) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:13,225::__init__::225::IOProcess::(_processLogs) (7912) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:13,225::__init__::225::IOProcess::(_processLogs) (7912) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:13,226::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:40:13,226::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:40:13,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000940976 s, 582 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:13,235::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:13,235::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:13,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:13,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:13,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:13,236::__init__::225::IOProcess::(_processLogs) (7913) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:13,236::__init__::225::IOProcess::(_processLogs) (7913) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:13,236::__init__::225::IOProcess::(_processLogs) (7913) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:13,236::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:40:13,237::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:40:13,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:13,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:13,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:13,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:13,237::__init__::225::IOProcess::(_processLogs) (7914) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) (7914) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) (7914) Building response >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) (7914) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:13,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) (7915) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) (7915) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) (7915) Building response >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) (7915) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:40:13,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) (7916) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) (7916) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) (7916) Building response >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) (7916) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:13,240::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:14,853::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:14,854::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3711::DEBUG::2014-09-09 11:40:14,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c18523b-bcb2-4119-a01d-a6b3dc7a3702`::moving from state init -> state preparing >Thread-3711::INFO::2014-09-09 11:40:14,855::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3711::INFO::2014-09-09 11:40:14,856::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119021', 'lastCheck': '6.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000940976', 'lastCheck': '1.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00094928', 'lastCheck': '2.2', 'valid': True}} >Thread-3711::DEBUG::2014-09-09 11:40:14,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c18523b-bcb2-4119-a01d-a6b3dc7a3702`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119021', 'lastCheck': '6.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000940976', 'lastCheck': '1.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00094928', 'lastCheck': '2.2', 'valid': True}} >Thread-3711::DEBUG::2014-09-09 11:40:14,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c18523b-bcb2-4119-a01d-a6b3dc7a3702`::moving from state preparing -> state finished >Thread-3711::DEBUG::2014-09-09 11:40:14,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3711::DEBUG::2014-09-09 11:40:14,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3711::DEBUG::2014-09-09 11:40:14,856::task::993::Storage.TaskManager.Task::(_decref) Task=`0c18523b-bcb2-4119-a01d-a6b3dc7a3702`::ref 0 aborting False >Thread-3711::DEBUG::2014-09-09 11:40:14,857::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:14,864::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:14,865::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3712::DEBUG::2014-09-09 11:40:14,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:15,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:15,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896057 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:15,439::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:15,440::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3713::DEBUG::2014-09-09 11:40:15,440::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3713::DEBUG::2014-09-09 11:40:15,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c1d8b94-7f6e-45c4-b7b6-5edb43535c58`::moving from state init -> state preparing >Thread-3713::INFO::2014-09-09 11:40:15,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3713::INFO::2014-09-09 11:40:15,441::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3713::DEBUG::2014-09-09 11:40:15,441::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c1d8b94-7f6e-45c4-b7b6-5edb43535c58`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3713::DEBUG::2014-09-09 11:40:15,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c1d8b94-7f6e-45c4-b7b6-5edb43535c58`::moving from state preparing -> state finished >Thread-3713::DEBUG::2014-09-09 11:40:15,441::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3713::DEBUG::2014-09-09 11:40:15,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3713::DEBUG::2014-09-09 11:40:15,441::task::993::Storage.TaskManager.Task::(_decref) Task=`7c1d8b94-7f6e-45c4-b7b6-5edb43535c58`::ref 0 aborting False >Thread-3713::DEBUG::2014-09-09 11:40:15,441::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3713::DEBUG::2014-09-09 11:40:15,442::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:15,476::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:15,476::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3714::DEBUG::2014-09-09 11:40:15,476::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3714::DEBUG::2014-09-09 11:40:15,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`94084be4-9826-4720-b91d-44b8defee5b3`::moving from state init -> state preparing >Thread-3714::INFO::2014-09-09 11:40:15,477::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3714::DEBUG::2014-09-09 11:40:15,478::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`215d24c4-cbf6-4a83-ad1d-898a9eb45cd0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3714::DEBUG::2014-09-09 11:40:15,478::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3714::DEBUG::2014-09-09 11:40:15,478::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3714::DEBUG::2014-09-09 11:40:15,478::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`215d24c4-cbf6-4a83-ad1d-898a9eb45cd0`::Granted request >Thread-3714::DEBUG::2014-09-09 11:40:15,478::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94084be4-9826-4720-b91d-44b8defee5b3`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3714::DEBUG::2014-09-09 11:40:15,478::task::993::Storage.TaskManager.Task::(_decref) Task=`94084be4-9826-4720-b91d-44b8defee5b3`::ref 1 aborting False >Thread-3714::INFO::2014-09-09 11:40:15,480::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3714::DEBUG::2014-09-09 11:40:15,480::task::1191::Storage.TaskManager.Task::(prepare) Task=`94084be4-9826-4720-b91d-44b8defee5b3`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3714::DEBUG::2014-09-09 11:40:15,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`94084be4-9826-4720-b91d-44b8defee5b3`::moving from state preparing -> state finished >Thread-3714::DEBUG::2014-09-09 11:40:15,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3714::DEBUG::2014-09-09 11:40:15,480::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3714::DEBUG::2014-09-09 11:40:15,480::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3714::DEBUG::2014-09-09 11:40:15,480::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3714::DEBUG::2014-09-09 11:40:15,481::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3714::DEBUG::2014-09-09 11:40:15,481::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3714::DEBUG::2014-09-09 11:40:15,481::task::993::Storage.TaskManager.Task::(_decref) Task=`94084be4-9826-4720-b91d-44b8defee5b3`::ref 0 aborting False >Thread-3714::DEBUG::2014-09-09 11:40:15,481::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283925020672', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3714::DEBUG::2014-09-09 11:40:15,481::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:17,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:17,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896606 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:17,974::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:17,974::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3715::DEBUG::2014-09-09 11:40:17,975::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:40:18,162::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:18,162::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:18,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:18,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:18,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:18,163::__init__::225::IOProcess::(_processLogs) (7917) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:18,163::__init__::225::IOProcess::(_processLogs) (7917) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:18,163::__init__::225::IOProcess::(_processLogs) (7917) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:18,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:40:18,163::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:40:18,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00121491 s, 924 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:18,170::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:18,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) (7918) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) (7918) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) (7918) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:18,171::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:40:19,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:19,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0950346 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:20,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:20,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3716::DEBUG::2014-09-09 11:40:20,982::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:21,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:21,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896701 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) (7919) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) (7919) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:22,662::__init__::225::IOProcess::(_processLogs) (7919) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:22,663::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:40:22,663::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:40:22,669::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000918081 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) (7920) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:22,670::__init__::225::IOProcess::(_processLogs) (7920) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:22,671::__init__::225::IOProcess::(_processLogs) (7920) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:22,671::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:40:23,240::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:23,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:23,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:23,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:23,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:23,241::__init__::225::IOProcess::(_processLogs) (7921) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:23,241::__init__::225::IOProcess::(_processLogs) (7921) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:23,241::__init__::225::IOProcess::(_processLogs) (7921) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:23,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:40:23,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:23,242::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:40:23,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000948203 s, 578 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:23,249::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:23,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:23,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:23,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:23,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:23,250::__init__::225::IOProcess::(_processLogs) (7922) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:23,250::__init__::225::IOProcess::(_processLogs) (7922) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:23,250::__init__::225::IOProcess::(_processLogs) (7922) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:23,250::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:40:23,251::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:40:23,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:23,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) (7923) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) (7923) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) (7923) Building response >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) (7923) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:40:23,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) (7924) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) (7924) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) (7924) Building response >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) (7924) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:23,253::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:23,254::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:40:23,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:23,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:23,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:23,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:23,255::__init__::225::IOProcess::(_processLogs) (7925) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:23,255::__init__::225::IOProcess::(_processLogs) (7925) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:23,255::__init__::225::IOProcess::(_processLogs) (7925) Building response >Thread-19::DEBUG::2014-09-09 11:40:23,255::__init__::225::IOProcess::(_processLogs) (7925) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:23,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:23,255::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:40:23,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:23,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897382 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:23,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:23,988::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3717::DEBUG::2014-09-09 11:40:23,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:25,519::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3718::DEBUG::2014-09-09 11:40:25,520::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:40:25,520::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3718::DEBUG::2014-09-09 11:40:25,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f65576-8f7c-4f42-9477-b6916fa4b94c`::moving from state init -> state preparing >Thread-3718::INFO::2014-09-09 11:40:25,521::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3718::INFO::2014-09-09 11:40:25,521::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3718::DEBUG::2014-09-09 11:40:25,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0f65576-8f7c-4f42-9477-b6916fa4b94c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3718::DEBUG::2014-09-09 11:40:25,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f65576-8f7c-4f42-9477-b6916fa4b94c`::moving from state preparing -> state finished >Thread-3718::DEBUG::2014-09-09 11:40:25,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3718::DEBUG::2014-09-09 11:40:25,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3718::DEBUG::2014-09-09 11:40:25,522::task::993::Storage.TaskManager.Task::(_decref) Task=`c0f65576-8f7c-4f42-9477-b6916fa4b94c`::ref 0 aborting False >Thread-3718::DEBUG::2014-09-09 11:40:25,522::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3718::DEBUG::2014-09-09 11:40:25,522::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:25,575::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:25,576::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3719::DEBUG::2014-09-09 11:40:25,576::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3719::DEBUG::2014-09-09 11:40:25,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5d514bf-2903-48f3-b571-557652d2441f`::moving from state init -> state preparing >Thread-3719::INFO::2014-09-09 11:40:25,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3719::DEBUG::2014-09-09 11:40:25,577::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`03a7be2b-d6d1-4f77-a0d1-546524589254`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3719::DEBUG::2014-09-09 11:40:25,577::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3719::DEBUG::2014-09-09 11:40:25,577::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3719::DEBUG::2014-09-09 11:40:25,578::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`03a7be2b-d6d1-4f77-a0d1-546524589254`::Granted request >Thread-3719::DEBUG::2014-09-09 11:40:25,578::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c5d514bf-2903-48f3-b571-557652d2441f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3719::DEBUG::2014-09-09 11:40:25,578::task::993::Storage.TaskManager.Task::(_decref) Task=`c5d514bf-2903-48f3-b571-557652d2441f`::ref 1 aborting False >Thread-3719::INFO::2014-09-09 11:40:25,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3719::DEBUG::2014-09-09 11:40:25,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5d514bf-2903-48f3-b571-557652d2441f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3719::DEBUG::2014-09-09 11:40:25,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5d514bf-2903-48f3-b571-557652d2441f`::moving from state preparing -> state finished >Thread-3719::DEBUG::2014-09-09 11:40:25,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3719::DEBUG::2014-09-09 11:40:25,580::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3719::DEBUG::2014-09-09 11:40:25,580::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3719::DEBUG::2014-09-09 11:40:25,580::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3719::DEBUG::2014-09-09 11:40:25,580::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3719::DEBUG::2014-09-09 11:40:25,580::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3719::DEBUG::2014-09-09 11:40:25,580::task::993::Storage.TaskManager.Task::(_decref) Task=`c5d514bf-2903-48f3-b571-557652d2441f`::ref 0 aborting False >Thread-3719::DEBUG::2014-09-09 11:40:25,581::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3719::DEBUG::2014-09-09 11:40:25,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:25,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:25,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896902 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:26,996::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:26,998::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3720::DEBUG::2014-09-09 11:40:27,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:27,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:27,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895963 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:28,172::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) (7926) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) (7926) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) (7926) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:28,173::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:40:28,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:40:28,180::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108039 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) (7927) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:28,181::__init__::225::IOProcess::(_processLogs) (7927) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:28,182::__init__::225::IOProcess::(_processLogs) (7927) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:28,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:28,182::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:40:29,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:30,016::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:30,017::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3721::DEBUG::2014-09-09 11:40:30,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`34023d9c-ea80-4ca9-bfb7-5eb77f50873d`::moving from state init -> state preparing >Thread-3721::INFO::2014-09-09 11:40:30,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3721::INFO::2014-09-09 11:40:30,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108039', 'lastCheck': '1.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948203', 'lastCheck': '6.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000918081', 'lastCheck': '7.3', 'valid': True}} >Thread-3721::DEBUG::2014-09-09 11:40:30,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`34023d9c-ea80-4ca9-bfb7-5eb77f50873d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108039', 'lastCheck': '1.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948203', 'lastCheck': '6.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000918081', 'lastCheck': '7.3', 'valid': True}} >Thread-3721::DEBUG::2014-09-09 11:40:30,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`34023d9c-ea80-4ca9-bfb7-5eb77f50873d`::moving from state preparing -> state finished >Thread-3721::DEBUG::2014-09-09 11:40:30,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3721::DEBUG::2014-09-09 11:40:30,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3721::DEBUG::2014-09-09 11:40:30,019::task::993::Storage.TaskManager.Task::(_decref) Task=`34023d9c-ea80-4ca9-bfb7-5eb77f50873d`::ref 0 aborting False >Thread-3721::DEBUG::2014-09-09 11:40:30,020::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:30,040::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:30,040::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3722::DEBUG::2014-09-09 11:40:30,041::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:30,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900229 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:40:32,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:32,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896704 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:32,672::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:32,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:32,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:32,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:32,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:32,673::__init__::225::IOProcess::(_processLogs) (7928) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:32,673::__init__::225::IOProcess::(_processLogs) (7928) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:32,674::__init__::225::IOProcess::(_processLogs) (7928) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:32,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:40:32,675::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:40:32,682::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000939009 s, 378 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:32,682::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) (7929) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) (7929) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) (7929) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:32,683::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:33,115::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:33,116::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3723::DEBUG::2014-09-09 11:40:33,117::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) (7930) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) (7930) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:33,255::__init__::225::IOProcess::(_processLogs) (7930) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:33,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:40:33,256::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:40:33,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000967066 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:33,263::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:33,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:33,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:33,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:33,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:33,263::__init__::225::IOProcess::(_processLogs) (7931) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:33,264::__init__::225::IOProcess::(_processLogs) (7931) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:33,264::__init__::225::IOProcess::(_processLogs) (7931) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:33,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:33,264::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) (7932) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) (7932) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:33,265::__init__::225::IOProcess::(_processLogs) (7932) Building response >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) (7932) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:33,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) (7933) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) (7933) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) (7933) Building response >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) (7933) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:40:33,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) (7934) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) (7934) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) (7934) Building response >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) (7934) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:33,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:33,269::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:40:34,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:34,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894408 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:35,664::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3724::DEBUG::2014-09-09 11:40:35,665::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:40:35,665::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3724::DEBUG::2014-09-09 11:40:35,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`91f018ed-bd06-4487-b033-cac35f7ce99c`::moving from state init -> state preparing >Thread-3724::INFO::2014-09-09 11:40:35,666::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3724::INFO::2014-09-09 11:40:35,667::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3724::DEBUG::2014-09-09 11:40:35,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`91f018ed-bd06-4487-b033-cac35f7ce99c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3724::DEBUG::2014-09-09 11:40:35,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`91f018ed-bd06-4487-b033-cac35f7ce99c`::moving from state preparing -> state finished >Thread-3724::DEBUG::2014-09-09 11:40:35,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3724::DEBUG::2014-09-09 11:40:35,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3724::DEBUG::2014-09-09 11:40:35,667::task::993::Storage.TaskManager.Task::(_decref) Task=`91f018ed-bd06-4487-b033-cac35f7ce99c`::ref 0 aborting False >Thread-3724::DEBUG::2014-09-09 11:40:35,667::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3724::DEBUG::2014-09-09 11:40:35,667::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:35,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3725::DEBUG::2014-09-09 11:40:35,696::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:40:35,696::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3725::DEBUG::2014-09-09 11:40:35,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`41fa7480-bb2f-4ad2-b58d-fc671ade7b0d`::moving from state init -> state preparing >Thread-3725::INFO::2014-09-09 11:40:35,697::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3725::DEBUG::2014-09-09 11:40:35,698::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e24e6ca5-1816-4617-804b-df9ccd1bd8f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3725::DEBUG::2014-09-09 11:40:35,698::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3725::DEBUG::2014-09-09 11:40:35,698::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3725::DEBUG::2014-09-09 11:40:35,698::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e24e6ca5-1816-4617-804b-df9ccd1bd8f1`::Granted request >Thread-3725::DEBUG::2014-09-09 11:40:35,698::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`41fa7480-bb2f-4ad2-b58d-fc671ade7b0d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3725::DEBUG::2014-09-09 11:40:35,698::task::993::Storage.TaskManager.Task::(_decref) Task=`41fa7480-bb2f-4ad2-b58d-fc671ade7b0d`::ref 1 aborting False >Thread-3725::INFO::2014-09-09 11:40:35,700::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3725::DEBUG::2014-09-09 11:40:35,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`41fa7480-bb2f-4ad2-b58d-fc671ade7b0d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3725::DEBUG::2014-09-09 11:40:35,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`41fa7480-bb2f-4ad2-b58d-fc671ade7b0d`::moving from state preparing -> state finished >Thread-3725::DEBUG::2014-09-09 11:40:35,700::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3725::DEBUG::2014-09-09 11:40:35,700::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3725::DEBUG::2014-09-09 11:40:35,700::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3725::DEBUG::2014-09-09 11:40:35,701::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3725::DEBUG::2014-09-09 11:40:35,701::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3725::DEBUG::2014-09-09 11:40:35,701::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3725::DEBUG::2014-09-09 11:40:35,701::task::993::Storage.TaskManager.Task::(_decref) Task=`41fa7480-bb2f-4ad2-b58d-fc671ade7b0d`::ref 0 aborting False >Thread-3725::DEBUG::2014-09-09 11:40:35,701::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3725::DEBUG::2014-09-09 11:40:35,701::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:36,126::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:36,126::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3726::DEBUG::2014-09-09 11:40:36,127::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:36,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:36,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089706 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) (7935) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:38,183::__init__::225::IOProcess::(_processLogs) (7935) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:38,184::__init__::225::IOProcess::(_processLogs) (7935) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:38,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:38,185::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:40:38,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:40:38,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00120854 s, 929 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) (7936) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) (7936) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:38,193::__init__::225::IOProcess::(_processLogs) (7936) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:38,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:38,194::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:40:38,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:38,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896388 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:39,135::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:39,136::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3727::DEBUG::2014-09-09 11:40:39,137::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:40,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:40,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896199 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:42,143::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:42,143::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3728::DEBUG::2014-09-09 11:40:42,144::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:42,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:42,684::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) (7937) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:42,685::__init__::225::IOProcess::(_processLogs) (7937) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:42,690::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7937) Building response >Thread-19::DEBUG::2014-09-09 11:40:42,691::__init__::225::IOProcess::(_processLogs) (7937) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:42,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:42,692::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:40:42,693::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:42,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0971337 s, 10.5 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:40:42,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000857812 s, 414 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:42,701::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:42,702::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:42,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:42,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:42,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:42,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:42,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:42,706::__init__::225::IOProcess::(_processLogs) (7938) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:42,707::__init__::225::IOProcess::(_processLogs) (7938) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:42,708::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7938) Building response >Thread-19::DEBUG::2014-09-09 11:40:42,709::__init__::225::IOProcess::(_processLogs) (7938) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:42,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:42,711::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:40:43,268::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:43,268::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:43,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:43,269::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:43,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:43,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:43,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:43,269::__init__::225::IOProcess::(_processLogs) (7939) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:43,269::__init__::225::IOProcess::(_processLogs) (7939) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:43,270::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7939) Building response >Thread-19::DEBUG::2014-09-09 11:40:43,270::__init__::225::IOProcess::(_processLogs) (7939) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:43,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:43,270::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:40:43,271::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:40:43,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000992244 s, 552 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:43,278::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:43,278::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:43,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) (7940) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) (7940) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7940) Building response >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) (7940) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:43,279::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:40:43,280::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:40:43,280::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:43,280::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:40:43,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:43,280::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) (7941) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) (7941) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7941) Building response >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) (7941) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:43,281::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) (7942) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:43,282::__init__::225::IOProcess::(_processLogs) (7942) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7942) Building response >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) (7942) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:40:43,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) (7943) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) (7943) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:43,284::__init__::225::IOProcess::(_processLogs) (7943) Building response >Thread-19::DEBUG::2014-09-09 11:40:43,285::__init__::225::IOProcess::(_processLogs) (7943) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:43,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:43,285::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:40:44,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:44,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089668 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:45,150::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:45,151::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3729::DEBUG::2014-09-09 11:40:45,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd5dd2df-b2b6-4709-b285-40f1503cfd48`::moving from state init -> state preparing >Thread-3729::INFO::2014-09-09 11:40:45,152::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3729::INFO::2014-09-09 11:40:45,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120854', 'lastCheck': '7.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000992244', 'lastCheck': '1.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000857812', 'lastCheck': '2.4', 'valid': True}} >Thread-3729::DEBUG::2014-09-09 11:40:45,152::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd5dd2df-b2b6-4709-b285-40f1503cfd48`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120854', 'lastCheck': '7.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000992244', 'lastCheck': '1.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000857812', 'lastCheck': '2.4', 'valid': True}} >Thread-3729::DEBUG::2014-09-09 11:40:45,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd5dd2df-b2b6-4709-b285-40f1503cfd48`::moving from state preparing -> state finished >Thread-3729::DEBUG::2014-09-09 11:40:45,152::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3729::DEBUG::2014-09-09 11:40:45,152::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3729::DEBUG::2014-09-09 11:40:45,153::task::993::Storage.TaskManager.Task::(_decref) Task=`dd5dd2df-b2b6-4709-b285-40f1503cfd48`::ref 0 aborting False >Thread-3729::DEBUG::2014-09-09 11:40:45,153::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:45,162::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:45,163::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3730::DEBUG::2014-09-09 11:40:45,163::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:45,795::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:45,796::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3731::DEBUG::2014-09-09 11:40:45,796::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3731::DEBUG::2014-09-09 11:40:45,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`3650ef0a-4f79-48d9-a10f-95957530f89d`::moving from state init -> state preparing >Thread-3731::INFO::2014-09-09 11:40:45,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3731::INFO::2014-09-09 11:40:45,797::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3731::DEBUG::2014-09-09 11:40:45,797::task::1191::Storage.TaskManager.Task::(prepare) Task=`3650ef0a-4f79-48d9-a10f-95957530f89d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3731::DEBUG::2014-09-09 11:40:45,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`3650ef0a-4f79-48d9-a10f-95957530f89d`::moving from state preparing -> state finished >Thread-3731::DEBUG::2014-09-09 11:40:45,797::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3731::DEBUG::2014-09-09 11:40:45,798::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3731::DEBUG::2014-09-09 11:40:45,798::task::993::Storage.TaskManager.Task::(_decref) Task=`3650ef0a-4f79-48d9-a10f-95957530f89d`::ref 0 aborting False >Thread-3731::DEBUG::2014-09-09 11:40:45,798::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3731::DEBUG::2014-09-09 11:40:45,798::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:45,812::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3732::DEBUG::2014-09-09 11:40:45,812::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:40:45,812::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3732::DEBUG::2014-09-09 11:40:45,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d495db6-3a8d-4172-8b38-3892d7bc8283`::moving from state init -> state preparing >Thread-3732::INFO::2014-09-09 11:40:45,813::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3732::DEBUG::2014-09-09 11:40:45,814::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ebfa2d0e-5c54-4255-87d9-191706f2fb76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3732::DEBUG::2014-09-09 11:40:45,814::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3732::DEBUG::2014-09-09 11:40:45,814::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3732::DEBUG::2014-09-09 11:40:45,814::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ebfa2d0e-5c54-4255-87d9-191706f2fb76`::Granted request >Thread-3732::DEBUG::2014-09-09 11:40:45,814::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3d495db6-3a8d-4172-8b38-3892d7bc8283`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3732::DEBUG::2014-09-09 11:40:45,814::task::993::Storage.TaskManager.Task::(_decref) Task=`3d495db6-3a8d-4172-8b38-3892d7bc8283`::ref 1 aborting False >Thread-3732::INFO::2014-09-09 11:40:45,816::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3732::DEBUG::2014-09-09 11:40:45,816::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d495db6-3a8d-4172-8b38-3892d7bc8283`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3732::DEBUG::2014-09-09 11:40:45,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d495db6-3a8d-4172-8b38-3892d7bc8283`::moving from state preparing -> state finished >Thread-3732::DEBUG::2014-09-09 11:40:45,816::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3732::DEBUG::2014-09-09 11:40:45,816::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3732::DEBUG::2014-09-09 11:40:45,816::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3732::DEBUG::2014-09-09 11:40:45,817::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3732::DEBUG::2014-09-09 11:40:45,817::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3732::DEBUG::2014-09-09 11:40:45,817::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3732::DEBUG::2014-09-09 11:40:45,817::task::993::Storage.TaskManager.Task::(_decref) Task=`3d495db6-3a8d-4172-8b38-3892d7bc8283`::ref 0 aborting False >Thread-3732::DEBUG::2014-09-09 11:40:45,817::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3732::DEBUG::2014-09-09 11:40:45,817::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:46,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:46,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897172 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:48,196::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:48,196::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:48,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) (7944) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) (7944) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:48,197::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7944) Building response >Thread-23::DEBUG::2014-09-09 11:40:48,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:48,198::__init__::225::IOProcess::(_processLogs) (7944) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:48,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:48,203::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:40:48,205::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115906 s, 969 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:48,205::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:48,205::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:48,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:48,205::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:48,205::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) (7945) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) (7945) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7945) Building response >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) (7945) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:48,206::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:48,251::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:48,252::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3733::DEBUG::2014-09-09 11:40:48,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:48,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:49,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08974 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:40:51,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:51,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896599 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:51,262::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:51,262::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3734::DEBUG::2014-09-09 11:40:51,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) (7946) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:52,710::__init__::225::IOProcess::(_processLogs) (7946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:52,711::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7946) Building response >Thread-3443::DEBUG::2014-09-09 11:40:52,711::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:40:52,711::__init__::225::IOProcess::(_processLogs) (7946) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:52,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:52,716::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:40:52,718::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000868341 s, 409 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:52,718::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:52,718::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:40:52,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:52,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:52,718::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:52,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:52,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:52,719::__init__::225::IOProcess::(_processLogs) (7947) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:52,719::__init__::225::IOProcess::(_processLogs) (7947) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:52,719::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7947) Building response >Thread-19::DEBUG::2014-09-09 11:40:52,719::__init__::225::IOProcess::(_processLogs) (7947) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:52,719::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:40:52,720::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:40:53,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:53,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896898 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:53,284::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) (7948) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:53,285::__init__::225::IOProcess::(_processLogs) (7948) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:53,286::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(7948) Building response >Thread-19::DEBUG::2014-09-09 11:40:53,286::__init__::225::IOProcess::(_processLogs) (7948) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:53,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:53,286::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:40:53,286::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:40:53,294::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000986088 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) (7949) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:53,295::__init__::225::IOProcess::(_processLogs) (7949) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:53,296::__init__::225::IOProcess::(_processLogs) (7949) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:53,296::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:53,296::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:40:53,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:53,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) (7950) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) (7950) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) (7950) Building response >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) (7950) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:53,297::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) (7951) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) (7951) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) (7951) Building response >Thread-19::DEBUG::2014-09-09 11:40:53,298::__init__::225::IOProcess::(_processLogs) (7951) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) (7952) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:40:53,299::__init__::225::IOProcess::(_processLogs) (7952) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:40:53,300::__init__::225::IOProcess::(_processLogs) (7952) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:53,300::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:54,270::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:54,271::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3735::DEBUG::2014-09-09 11:40:54,272::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:55,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:55,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897043 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:55,858::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:55,859::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3736::DEBUG::2014-09-09 11:40:55,859::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3736::DEBUG::2014-09-09 11:40:55,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`55e832f6-42eb-4432-9bfa-141f02b5298d`::moving from state init -> state preparing >Thread-3736::INFO::2014-09-09 11:40:55,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3736::INFO::2014-09-09 11:40:55,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3736::DEBUG::2014-09-09 11:40:55,860::task::1191::Storage.TaskManager.Task::(prepare) Task=`55e832f6-42eb-4432-9bfa-141f02b5298d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3736::DEBUG::2014-09-09 11:40:55,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`55e832f6-42eb-4432-9bfa-141f02b5298d`::moving from state preparing -> state finished >Thread-3736::DEBUG::2014-09-09 11:40:55,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3736::DEBUG::2014-09-09 11:40:55,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3736::DEBUG::2014-09-09 11:40:55,861::task::993::Storage.TaskManager.Task::(_decref) Task=`55e832f6-42eb-4432-9bfa-141f02b5298d`::ref 0 aborting False >Thread-3736::DEBUG::2014-09-09 11:40:55,861::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3736::DEBUG::2014-09-09 11:40:55,861::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:55,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:55,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3737::DEBUG::2014-09-09 11:40:55,888::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3737::DEBUG::2014-09-09 11:40:55,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3848525-54ca-4602-8039-93c45333af33`::moving from state init -> state preparing >Thread-3737::INFO::2014-09-09 11:40:55,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3737::DEBUG::2014-09-09 11:40:55,890::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1f90479-007f-4d7c-bc57-c62722eb241b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3737::DEBUG::2014-09-09 11:40:55,890::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3737::DEBUG::2014-09-09 11:40:55,890::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3737::DEBUG::2014-09-09 11:40:55,890::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1f90479-007f-4d7c-bc57-c62722eb241b`::Granted request >Thread-3737::DEBUG::2014-09-09 11:40:55,890::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f3848525-54ca-4602-8039-93c45333af33`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3737::DEBUG::2014-09-09 11:40:55,890::task::993::Storage.TaskManager.Task::(_decref) Task=`f3848525-54ca-4602-8039-93c45333af33`::ref 1 aborting False >Thread-3737::INFO::2014-09-09 11:40:55,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3737::DEBUG::2014-09-09 11:40:55,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3848525-54ca-4602-8039-93c45333af33`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3737::DEBUG::2014-09-09 11:40:55,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3848525-54ca-4602-8039-93c45333af33`::moving from state preparing -> state finished >Thread-3737::DEBUG::2014-09-09 11:40:55,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3737::DEBUG::2014-09-09 11:40:55,892::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3737::DEBUG::2014-09-09 11:40:55,892::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3737::DEBUG::2014-09-09 11:40:55,892::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3737::DEBUG::2014-09-09 11:40:55,892::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3737::DEBUG::2014-09-09 11:40:55,893::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3737::DEBUG::2014-09-09 11:40:55,893::task::993::Storage.TaskManager.Task::(_decref) Task=`f3848525-54ca-4602-8039-93c45333af33`::ref 0 aborting False >Thread-3737::DEBUG::2014-09-09 11:40:55,893::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3737::DEBUG::2014-09-09 11:40:55,893::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:40:57,279::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:40:57,280::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3738::DEBUG::2014-09-09 11:40:57,281::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:40:57,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:57,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089903 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) (7953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) (7953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) (7953) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:58,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:40:58,209::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:40:58,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114681 s, 979 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) (7954) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) (7954) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:40:58,217::__init__::225::IOProcess::(_processLogs) (7954) Queuing response >Thread-19::DEBUG::2014-09-09 11:40:58,218::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:40:59,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:40:59,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895781 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:00,288::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:00,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3739::DEBUG::2014-09-09 11:41:00,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dc74791-12d0-4935-ab1a-c50aadf330d4`::moving from state init -> state preparing >Thread-3739::INFO::2014-09-09 11:41:00,290::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3739::INFO::2014-09-09 11:41:00,290::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114681', 'lastCheck': '2.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986088', 'lastCheck': '7.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000868341', 'lastCheck': '7.6', 'valid': True}} >Thread-3739::DEBUG::2014-09-09 11:41:00,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`8dc74791-12d0-4935-ab1a-c50aadf330d4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114681', 'lastCheck': '2.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986088', 'lastCheck': '7.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000868341', 'lastCheck': '7.6', 'valid': True}} >Thread-3739::DEBUG::2014-09-09 11:41:00,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dc74791-12d0-4935-ab1a-c50aadf330d4`::moving from state preparing -> state finished >Thread-3739::DEBUG::2014-09-09 11:41:00,291::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3739::DEBUG::2014-09-09 11:41:00,291::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3739::DEBUG::2014-09-09 11:41:00,291::task::993::Storage.TaskManager.Task::(_decref) Task=`8dc74791-12d0-4935-ab1a-c50aadf330d4`::ref 0 aborting False >Thread-3739::DEBUG::2014-09-09 11:41:00,292::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:00,302::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:00,303::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3740::DEBUG::2014-09-09 11:41:00,304::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:01,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:01,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896092 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:02,720::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:02,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) (7955) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) (7955) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) (7955) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:02,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:41:02,721::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:41:02,728::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000946263 s, 375 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) (7956) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:02,729::__init__::225::IOProcess::(_processLogs) (7956) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:02,730::__init__::225::IOProcess::(_processLogs) (7956) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:02,730::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) (7957) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:03,301::__init__::225::IOProcess::(_processLogs) (7957) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:03,302::__init__::225::IOProcess::(_processLogs) (7957) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:03,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:41:03,302::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:41:03,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000963199 s, 569 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:03,309::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) (7958) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) (7958) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:03,310::__init__::225::IOProcess::(_processLogs) (7958) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:03,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:03,311::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:41:03,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:03,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) (7959) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) (7959) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) (7959) Building response >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) (7959) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:41:03,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) (7960) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) (7960) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) (7960) Building response >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) (7960) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:03,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:03,314::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:03,314::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:41:03,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:03,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:03,314::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:03,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:03,315::__init__::225::IOProcess::(_processLogs) (7961) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:03,315::__init__::225::IOProcess::(_processLogs) (7961) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:03,315::__init__::225::IOProcess::(_processLogs) (7961) Building response >Thread-19::DEBUG::2014-09-09 11:41:03,315::__init__::225::IOProcess::(_processLogs) (7961) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:03,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:03,315::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:03,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:03,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3741::DEBUG::2014-09-09 11:41:03,390::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:03,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:03,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896231 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:41:05,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:05,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898509 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:05,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3742::DEBUG::2014-09-09 11:41:05,932::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:05,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3742::DEBUG::2014-09-09 11:41:05,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b10b529-6738-4b49-be68-097b2927d471`::moving from state init -> state preparing >Thread-3742::INFO::2014-09-09 11:41:05,933::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3742::INFO::2014-09-09 11:41:05,933::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3742::DEBUG::2014-09-09 11:41:05,933::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b10b529-6738-4b49-be68-097b2927d471`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3742::DEBUG::2014-09-09 11:41:05,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b10b529-6738-4b49-be68-097b2927d471`::moving from state preparing -> state finished >Thread-3742::DEBUG::2014-09-09 11:41:05,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3742::DEBUG::2014-09-09 11:41:05,934::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3742::DEBUG::2014-09-09 11:41:05,934::task::993::Storage.TaskManager.Task::(_decref) Task=`0b10b529-6738-4b49-be68-097b2927d471`::ref 0 aborting False >Thread-3742::DEBUG::2014-09-09 11:41:05,934::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3742::DEBUG::2014-09-09 11:41:05,934::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:05,963::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:05,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3743::DEBUG::2014-09-09 11:41:05,964::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3743::DEBUG::2014-09-09 11:41:05,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6ead8aa-0ccb-4a1c-a948-7a35e3cb9e6a`::moving from state init -> state preparing >Thread-3743::INFO::2014-09-09 11:41:05,965::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3743::DEBUG::2014-09-09 11:41:05,966::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3995b64d-7e4c-49ba-81f9-d6d1165c8ad7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3743::DEBUG::2014-09-09 11:41:05,966::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3743::DEBUG::2014-09-09 11:41:05,966::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3743::DEBUG::2014-09-09 11:41:05,966::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3995b64d-7e4c-49ba-81f9-d6d1165c8ad7`::Granted request >Thread-3743::DEBUG::2014-09-09 11:41:05,966::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f6ead8aa-0ccb-4a1c-a948-7a35e3cb9e6a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3743::DEBUG::2014-09-09 11:41:05,967::task::993::Storage.TaskManager.Task::(_decref) Task=`f6ead8aa-0ccb-4a1c-a948-7a35e3cb9e6a`::ref 1 aborting False >Thread-3743::INFO::2014-09-09 11:41:05,968::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3743::DEBUG::2014-09-09 11:41:05,968::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6ead8aa-0ccb-4a1c-a948-7a35e3cb9e6a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3743::DEBUG::2014-09-09 11:41:05,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6ead8aa-0ccb-4a1c-a948-7a35e3cb9e6a`::moving from state preparing -> state finished >Thread-3743::DEBUG::2014-09-09 11:41:05,968::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3743::DEBUG::2014-09-09 11:41:05,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3743::DEBUG::2014-09-09 11:41:05,969::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3743::DEBUG::2014-09-09 11:41:05,969::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3743::DEBUG::2014-09-09 11:41:05,969::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3743::DEBUG::2014-09-09 11:41:05,969::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3743::DEBUG::2014-09-09 11:41:05,969::task::993::Storage.TaskManager.Task::(_decref) Task=`f6ead8aa-0ccb-4a1c-a948-7a35e3cb9e6a`::ref 0 aborting False >Thread-3743::DEBUG::2014-09-09 11:41:05,969::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3743::DEBUG::2014-09-09 11:41:05,969::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:06,395::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:06,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3744::DEBUG::2014-09-09 11:41:06,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:07,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:07,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902907 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:08,218::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:08,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:08,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:08,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:08,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:08,219::__init__::225::IOProcess::(_processLogs) (7962) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:08,219::__init__::225::IOProcess::(_processLogs) (7962) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:08,220::__init__::225::IOProcess::(_processLogs) (7962) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:08,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:41:08,220::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:41:08,227::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109274 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) (7963) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:08,228::__init__::225::IOProcess::(_processLogs) (7963) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:08,229::__init__::225::IOProcess::(_processLogs) (7963) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:08,229::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:09,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:09,408::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3745::DEBUG::2014-09-09 11:41:09,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:09,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:10,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896492 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:41:12,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:12,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896358 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:12,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:12,417::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3746::DEBUG::2014-09-09 11:41:12,418::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:41:12,731::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:12,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) (7964) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) (7964) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) (7964) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:12,732::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:41:12,733::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:41:12,740::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000932117 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:12,740::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:12,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:12,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:12,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:12,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:12,741::__init__::225::IOProcess::(_processLogs) (7965) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:12,741::__init__::225::IOProcess::(_processLogs) (7965) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:12,741::__init__::225::IOProcess::(_processLogs) (7965) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:12,742::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) (7966) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:13,315::__init__::225::IOProcess::(_processLogs) (7966) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:13,316::__init__::225::IOProcess::(_processLogs) (7966) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:13,317::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:41:13,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:41:13,326::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000979971 s, 559 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:13,326::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:13,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:13,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:13,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:13,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:13,327::__init__::225::IOProcess::(_processLogs) (7967) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:13,327::__init__::225::IOProcess::(_processLogs) (7967) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:13,327::__init__::225::IOProcess::(_processLogs) (7967) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:13,327::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:13,328::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:41:13,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:13,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) (7968) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) (7968) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) (7968) Building response >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) (7968) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:13,329::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) (7969) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) (7969) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) (7969) Building response >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) (7969) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:13,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:13,331::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:13,331::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:41:13,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:13,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:13,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:13,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:13,332::__init__::225::IOProcess::(_processLogs) (7970) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:13,332::__init__::225::IOProcess::(_processLogs) (7970) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:13,332::__init__::225::IOProcess::(_processLogs) (7970) Building response >Thread-19::DEBUG::2014-09-09 11:41:13,332::__init__::225::IOProcess::(_processLogs) (7970) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:13,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:13,332::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:41:14,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:14,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896254 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:15,424::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:15,425::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3747::DEBUG::2014-09-09 11:41:15,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6119fa9-6a1a-4d32-9d4b-88503bd6e9bc`::moving from state init -> state preparing >Thread-3747::INFO::2014-09-09 11:41:15,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3747::INFO::2014-09-09 11:41:15,427::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109274', 'lastCheck': '7.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000979971', 'lastCheck': '2.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000932117', 'lastCheck': '2.7', 'valid': True}} >Thread-3747::DEBUG::2014-09-09 11:41:15,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6119fa9-6a1a-4d32-9d4b-88503bd6e9bc`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109274', 'lastCheck': '7.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000979971', 'lastCheck': '2.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000932117', 'lastCheck': '2.7', 'valid': True}} >Thread-3747::DEBUG::2014-09-09 11:41:15,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6119fa9-6a1a-4d32-9d4b-88503bd6e9bc`::moving from state preparing -> state finished >Thread-3747::DEBUG::2014-09-09 11:41:15,427::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3747::DEBUG::2014-09-09 11:41:15,427::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3747::DEBUG::2014-09-09 11:41:15,427::task::993::Storage.TaskManager.Task::(_decref) Task=`f6119fa9-6a1a-4d32-9d4b-88503bd6e9bc`::ref 0 aborting False >Thread-3747::DEBUG::2014-09-09 11:41:15,428::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:15,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:15,437::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3748::DEBUG::2014-09-09 11:41:15,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:16,008::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3749::DEBUG::2014-09-09 11:41:16,008::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:16,008::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3749::DEBUG::2014-09-09 11:41:16,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`20a75bd7-2a83-4984-8cc8-5891d41d9e77`::moving from state init -> state preparing >Thread-3749::INFO::2014-09-09 11:41:16,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3749::INFO::2014-09-09 11:41:16,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3749::DEBUG::2014-09-09 11:41:16,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`20a75bd7-2a83-4984-8cc8-5891d41d9e77`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3749::DEBUG::2014-09-09 11:41:16,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`20a75bd7-2a83-4984-8cc8-5891d41d9e77`::moving from state preparing -> state finished >Thread-3749::DEBUG::2014-09-09 11:41:16,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3749::DEBUG::2014-09-09 11:41:16,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3749::DEBUG::2014-09-09 11:41:16,010::task::993::Storage.TaskManager.Task::(_decref) Task=`20a75bd7-2a83-4984-8cc8-5891d41d9e77`::ref 0 aborting False >Thread-3749::DEBUG::2014-09-09 11:41:16,010::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3749::DEBUG::2014-09-09 11:41:16,010::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:16,076::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3750::DEBUG::2014-09-09 11:41:16,077::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:16,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3750::DEBUG::2014-09-09 11:41:16,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fc6ccfb-eaa7-4763-a26d-6d4fff35259f`::moving from state init -> state preparing >Thread-3750::INFO::2014-09-09 11:41:16,078::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3750::DEBUG::2014-09-09 11:41:16,078::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`90305ba9-fffd-4725-94d4-94f4c623094c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3750::DEBUG::2014-09-09 11:41:16,078::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3750::DEBUG::2014-09-09 11:41:16,079::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3750::DEBUG::2014-09-09 11:41:16,079::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`90305ba9-fffd-4725-94d4-94f4c623094c`::Granted request >Thread-3750::DEBUG::2014-09-09 11:41:16,080::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1fc6ccfb-eaa7-4763-a26d-6d4fff35259f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3750::DEBUG::2014-09-09 11:41:16,080::task::993::Storage.TaskManager.Task::(_decref) Task=`1fc6ccfb-eaa7-4763-a26d-6d4fff35259f`::ref 1 aborting False >Thread-3750::INFO::2014-09-09 11:41:16,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3750::DEBUG::2014-09-09 11:41:16,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fc6ccfb-eaa7-4763-a26d-6d4fff35259f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3750::DEBUG::2014-09-09 11:41:16,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fc6ccfb-eaa7-4763-a26d-6d4fff35259f`::moving from state preparing -> state finished >Thread-3750::DEBUG::2014-09-09 11:41:16,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3750::DEBUG::2014-09-09 11:41:16,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3750::DEBUG::2014-09-09 11:41:16,082::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3750::DEBUG::2014-09-09 11:41:16,082::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3750::DEBUG::2014-09-09 11:41:16,082::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3750::DEBUG::2014-09-09 11:41:16,082::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3750::DEBUG::2014-09-09 11:41:16,082::task::993::Storage.TaskManager.Task::(_decref) Task=`1fc6ccfb-eaa7-4763-a26d-6d4fff35259f`::ref 0 aborting False >Thread-3750::DEBUG::2014-09-09 11:41:16,082::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3750::DEBUG::2014-09-09 11:41:16,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:16,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:16,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896484 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:18,230::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:18,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:18,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:18,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:18,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:18,231::__init__::225::IOProcess::(_processLogs) (7971) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:18,231::__init__::225::IOProcess::(_processLogs) (7971) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:18,231::__init__::225::IOProcess::(_processLogs) (7971) Queuing response >Thread-23::DEBUG::2014-09-09 11:41:18,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:41:18,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:18,237::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:41:18,239::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110893 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:18,239::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:18,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:18,239::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:18,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:18,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:18,240::__init__::225::IOProcess::(_processLogs) (7972) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:18,240::__init__::225::IOProcess::(_processLogs) (7972) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:18,240::__init__::225::IOProcess::(_processLogs) (7972) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:18,240::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:41:18,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:18,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897827 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:18,516::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:18,517::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3751::DEBUG::2014-09-09 11:41:18,517::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:20,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:20,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897575 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:21,526::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:21,526::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3752::DEBUG::2014-09-09 11:41:21,527::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:22,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:22,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897321 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:22,742::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) (7973) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) (7973) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:22,743::__init__::225::IOProcess::(_processLogs) (7973) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:22,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:41:22,744::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:41:22,750::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00095414 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) (7974) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) (7974) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:22,751::__init__::225::IOProcess::(_processLogs) (7974) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:22,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:23,332::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:23,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:23,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:23,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:23,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:23,333::__init__::225::IOProcess::(_processLogs) (7975) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:23,333::__init__::225::IOProcess::(_processLogs) (7975) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:23,333::__init__::225::IOProcess::(_processLogs) (7975) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:23,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:41:23,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:41:23,334::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:41:23,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000971312 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) (7976) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) (7976) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:23,342::__init__::225::IOProcess::(_processLogs) (7976) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:23,343::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:23,343::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) (7977) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) (7977) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) (7977) Building response >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) (7977) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:23,344::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) (7978) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) (7978) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:23,345::__init__::225::IOProcess::(_processLogs) (7978) Building response >Thread-19::DEBUG::2014-09-09 11:41:23,346::__init__::225::IOProcess::(_processLogs) (7978) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:23,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:23,346::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:23,346::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:41:23,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:23,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) (7979) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) (7979) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) (7979) Building response >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) (7979) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:23,347::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:24,537::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:24,537::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3753::DEBUG::2014-09-09 11:41:24,538::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:24,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:24,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089672 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:26,135::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3754::DEBUG::2014-09-09 11:41:26,136::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:26,136::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3754::DEBUG::2014-09-09 11:41:26,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`90611f10-1a4c-4d88-b235-1e48bfa1e40f`::moving from state init -> state preparing >Thread-3754::INFO::2014-09-09 11:41:26,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3754::INFO::2014-09-09 11:41:26,138::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3754::DEBUG::2014-09-09 11:41:26,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`90611f10-1a4c-4d88-b235-1e48bfa1e40f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3754::DEBUG::2014-09-09 11:41:26,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`90611f10-1a4c-4d88-b235-1e48bfa1e40f`::moving from state preparing -> state finished >Thread-3754::DEBUG::2014-09-09 11:41:26,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3754::DEBUG::2014-09-09 11:41:26,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3754::DEBUG::2014-09-09 11:41:26,138::task::993::Storage.TaskManager.Task::(_decref) Task=`90611f10-1a4c-4d88-b235-1e48bfa1e40f`::ref 0 aborting False >Thread-3754::DEBUG::2014-09-09 11:41:26,138::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3754::DEBUG::2014-09-09 11:41:26,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:26,192::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3755::DEBUG::2014-09-09 11:41:26,193::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:26,193::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3755::DEBUG::2014-09-09 11:41:26,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`802a4699-13d0-45b3-ad12-1c2e544937a7`::moving from state init -> state preparing >Thread-3755::INFO::2014-09-09 11:41:26,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3755::DEBUG::2014-09-09 11:41:26,194::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`46d67a12-9dda-4dc4-b816-521b6f91d65f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3755::DEBUG::2014-09-09 11:41:26,194::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3755::DEBUG::2014-09-09 11:41:26,194::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3755::DEBUG::2014-09-09 11:41:26,195::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`46d67a12-9dda-4dc4-b816-521b6f91d65f`::Granted request >Thread-3755::DEBUG::2014-09-09 11:41:26,195::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`802a4699-13d0-45b3-ad12-1c2e544937a7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3755::DEBUG::2014-09-09 11:41:26,195::task::993::Storage.TaskManager.Task::(_decref) Task=`802a4699-13d0-45b3-ad12-1c2e544937a7`::ref 1 aborting False >Thread-3755::INFO::2014-09-09 11:41:26,196::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3755::DEBUG::2014-09-09 11:41:26,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`802a4699-13d0-45b3-ad12-1c2e544937a7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3755::DEBUG::2014-09-09 11:41:26,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`802a4699-13d0-45b3-ad12-1c2e544937a7`::moving from state preparing -> state finished >Thread-3755::DEBUG::2014-09-09 11:41:26,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3755::DEBUG::2014-09-09 11:41:26,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3755::DEBUG::2014-09-09 11:41:26,197::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3755::DEBUG::2014-09-09 11:41:26,197::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3755::DEBUG::2014-09-09 11:41:26,197::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3755::DEBUG::2014-09-09 11:41:26,197::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3755::DEBUG::2014-09-09 11:41:26,197::task::993::Storage.TaskManager.Task::(_decref) Task=`802a4699-13d0-45b3-ad12-1c2e544937a7`::ref 0 aborting False >Thread-3755::DEBUG::2014-09-09 11:41:26,197::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3755::DEBUG::2014-09-09 11:41:26,198::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:26,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:26,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089667 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:27,548::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:27,549::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3756::DEBUG::2014-09-09 11:41:27,550::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:41:28,241::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) (7980) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) (7980) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) (7980) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:28,242::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:41:28,243::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:41:28,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116692 s, 962 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) (7981) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:28,250::__init__::225::IOProcess::(_processLogs) (7981) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:28,251::__init__::225::IOProcess::(_processLogs) (7981) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:28,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:28,251::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:41:28,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:29,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897537 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:30,559::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:30,560::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3757::DEBUG::2014-09-09 11:41:30,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`72d4a94d-7a7c-4e56-9ee8-6a93249f892c`::moving from state init -> state preparing >Thread-3757::INFO::2014-09-09 11:41:30,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3757::INFO::2014-09-09 11:41:30,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116692', 'lastCheck': '2.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971312', 'lastCheck': '7.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00095414', 'lastCheck': '7.8', 'valid': True}} >Thread-3757::DEBUG::2014-09-09 11:41:30,561::task::1191::Storage.TaskManager.Task::(prepare) Task=`72d4a94d-7a7c-4e56-9ee8-6a93249f892c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116692', 'lastCheck': '2.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971312', 'lastCheck': '7.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00095414', 'lastCheck': '7.8', 'valid': True}} >Thread-3757::DEBUG::2014-09-09 11:41:30,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`72d4a94d-7a7c-4e56-9ee8-6a93249f892c`::moving from state preparing -> state finished >Thread-3757::DEBUG::2014-09-09 11:41:30,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3757::DEBUG::2014-09-09 11:41:30,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3757::DEBUG::2014-09-09 11:41:30,562::task::993::Storage.TaskManager.Task::(_decref) Task=`72d4a94d-7a7c-4e56-9ee8-6a93249f892c`::ref 0 aborting False >Thread-3757::DEBUG::2014-09-09 11:41:30,562::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:30,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:30,575::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3758::DEBUG::2014-09-09 11:41:30,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:31,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:31,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896341 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:32,752::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:32,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:32,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:32,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:32,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:32,753::__init__::225::IOProcess::(_processLogs) (7982) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:32,753::__init__::225::IOProcess::(_processLogs) (7982) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:32,755::__init__::225::IOProcess::(_processLogs) (7982) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:32,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:32,755::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:41:32,756::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:41:32,763::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00101973 s, 348 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:32,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:32,763::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:32,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) (7983) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) (7983) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) DEBUG|(7983) Building response >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) (7983) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:32,764::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:32,765::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:41:33,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:33,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898547 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:33,347::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:33,347::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:33,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:33,347::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:33,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) (7984) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) (7984) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) DEBUG|(7984) Building response >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) (7984) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:33,348::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:41:33,349::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:41:33,349::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:41:33,356::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101295 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) (7985) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:33,357::__init__::225::IOProcess::(_processLogs) (7985) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:33,358::__init__::225::IOProcess::(_processLogs) DEBUG|(7985) Building response >Thread-19::DEBUG::2014-09-09 11:41:33,358::__init__::225::IOProcess::(_processLogs) (7985) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:33,358::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:33,358::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:33,359::__init__::225::IOProcess::(_processLogs) (7986) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) (7986) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) (7986) Building response >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) (7986) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:33,360::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) (7987) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) (7987) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) (7987) Building response >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) (7987) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:33,361::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:33,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:33,362::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:41:33,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:33,362::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:33,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:33,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) (7988) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) (7988) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) (7988) Building response >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) (7988) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:33,363::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:33,701::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:33,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3759::DEBUG::2014-09-09 11:41:33,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:35,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:35,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897647 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:36,244::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:36,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3760::DEBUG::2014-09-09 11:41:36,244::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3760::DEBUG::2014-09-09 11:41:36,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eaae1e8-e5cc-4233-98ea-17aaa89bf2cf`::moving from state init -> state preparing >Thread-3760::INFO::2014-09-09 11:41:36,245::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3760::INFO::2014-09-09 11:41:36,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3760::DEBUG::2014-09-09 11:41:36,246::task::1191::Storage.TaskManager.Task::(prepare) Task=`1eaae1e8-e5cc-4233-98ea-17aaa89bf2cf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3760::DEBUG::2014-09-09 11:41:36,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eaae1e8-e5cc-4233-98ea-17aaa89bf2cf`::moving from state preparing -> state finished >Thread-3760::DEBUG::2014-09-09 11:41:36,246::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3760::DEBUG::2014-09-09 11:41:36,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3760::DEBUG::2014-09-09 11:41:36,246::task::993::Storage.TaskManager.Task::(_decref) Task=`1eaae1e8-e5cc-4233-98ea-17aaa89bf2cf`::ref 0 aborting False >Thread-3760::DEBUG::2014-09-09 11:41:36,246::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3760::DEBUG::2014-09-09 11:41:36,246::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:36,274::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3761::DEBUG::2014-09-09 11:41:36,275::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:36,275::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3761::DEBUG::2014-09-09 11:41:36,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`83009fd3-d188-4442-943e-7f6178bde7d9`::moving from state init -> state preparing >Thread-3761::INFO::2014-09-09 11:41:36,276::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3761::DEBUG::2014-09-09 11:41:36,276::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1f63284f-4ad6-4dc2-881a-e8267315af9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3761::DEBUG::2014-09-09 11:41:36,276::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3761::DEBUG::2014-09-09 11:41:36,277::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3761::DEBUG::2014-09-09 11:41:36,277::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1f63284f-4ad6-4dc2-881a-e8267315af9e`::Granted request >Thread-3761::DEBUG::2014-09-09 11:41:36,277::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`83009fd3-d188-4442-943e-7f6178bde7d9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3761::DEBUG::2014-09-09 11:41:36,277::task::993::Storage.TaskManager.Task::(_decref) Task=`83009fd3-d188-4442-943e-7f6178bde7d9`::ref 1 aborting False >Thread-3761::INFO::2014-09-09 11:41:36,279::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3761::DEBUG::2014-09-09 11:41:36,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`83009fd3-d188-4442-943e-7f6178bde7d9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3761::DEBUG::2014-09-09 11:41:36,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`83009fd3-d188-4442-943e-7f6178bde7d9`::moving from state preparing -> state finished >Thread-3761::DEBUG::2014-09-09 11:41:36,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3761::DEBUG::2014-09-09 11:41:36,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3761::DEBUG::2014-09-09 11:41:36,279::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3761::DEBUG::2014-09-09 11:41:36,279::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3761::DEBUG::2014-09-09 11:41:36,279::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3761::DEBUG::2014-09-09 11:41:36,279::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3761::DEBUG::2014-09-09 11:41:36,279::task::993::Storage.TaskManager.Task::(_decref) Task=`83009fd3-d188-4442-943e-7f6178bde7d9`::ref 0 aborting False >Thread-3761::DEBUG::2014-09-09 11:41:36,280::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3761::DEBUG::2014-09-09 11:41:36,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:36,711::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:36,712::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3762::DEBUG::2014-09-09 11:41:36,713::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:37,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:37,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898641 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:38,252::__init__::225::IOProcess::(_processLogs) (7989) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:38,253::__init__::225::IOProcess::(_processLogs) (7989) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:38,253::__init__::225::IOProcess::(_processLogs) DEBUG|(7989) Building response >Thread-19::DEBUG::2014-09-09 11:41:38,254::__init__::225::IOProcess::(_processLogs) (7989) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:38,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:38,254::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:41:38,254::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:41:38,261::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117172 s, 958 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:38,262::__init__::225::IOProcess::(_processLogs) (7990) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:38,263::__init__::225::IOProcess::(_processLogs) (7990) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:38,263::__init__::225::IOProcess::(_processLogs) DEBUG|(7990) Building response >Thread-19::DEBUG::2014-09-09 11:41:38,263::__init__::225::IOProcess::(_processLogs) (7990) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:38,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:38,263::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:41:39,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:39,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896302 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:39,720::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:39,721::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3763::DEBUG::2014-09-09 11:41:39,722::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:41,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:41,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896802 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:42,730::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:42,730::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3764::DEBUG::2014-09-09 11:41:42,731::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:41:42,765::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) (7991) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) (7991) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) DEBUG|(7991) Building response >Thread-19::DEBUG::2014-09-09 11:41:42,766::__init__::225::IOProcess::(_processLogs) (7991) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:42,767::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:41:42,767::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:41:42,767::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:41:42,774::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00091409 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:42,774::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:42,774::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:42,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:42,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:42,774::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:42,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:42,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:42,775::__init__::225::IOProcess::(_processLogs) (7992) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:42,775::__init__::225::IOProcess::(_processLogs) (7992) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:42,775::__init__::225::IOProcess::(_processLogs) DEBUG|(7992) Building response >Thread-19::DEBUG::2014-09-09 11:41:42,776::__init__::225::IOProcess::(_processLogs) (7992) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:42,776::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:42,776::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) (7993) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:43,363::__init__::225::IOProcess::(_processLogs) (7993) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:43,364::__init__::225::IOProcess::(_processLogs) DEBUG|(7993) Building response >Thread-19::DEBUG::2014-09-09 11:41:43,364::__init__::225::IOProcess::(_processLogs) (7993) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:43,365::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:41:43,365::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:41:43,365::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:41:43,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000936322 s, 585 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:43,373::__init__::225::IOProcess::(_processLogs) (7994) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:43,374::__init__::225::IOProcess::(_processLogs) (7994) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:43,374::__init__::225::IOProcess::(_processLogs) DEBUG|(7994) Building response >Thread-19::DEBUG::2014-09-09 11:41:43,374::__init__::225::IOProcess::(_processLogs) (7994) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:43,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) (7995) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) (7995) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:43,375::__init__::225::IOProcess::(_processLogs) DEBUG|(7995) Building response >Thread-19::DEBUG::2014-09-09 11:41:43,376::__init__::225::IOProcess::(_processLogs) (7995) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:43,376::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:43,376::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:43,376::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:43,376::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:41:43,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) (7996) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) (7996) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) DEBUG|(7996) Building response >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) (7996) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:43,377::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:43,378::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:43,378::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:43,378::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:41:43,378::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:43,378::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) (7997) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) (7997) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) (7997) Building response >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) (7997) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:43,379::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:41:43,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:43,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896797 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:45,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:45,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3765::DEBUG::2014-09-09 11:41:45,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`0dafb670-1540-495b-b3e7-d456ffdba2cf`::moving from state init -> state preparing >Thread-3765::INFO::2014-09-09 11:41:45,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3765::INFO::2014-09-09 11:41:45,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117172', 'lastCheck': '7.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000936322', 'lastCheck': '2.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00091409', 'lastCheck': '3.0', 'valid': True}} >Thread-3765::DEBUG::2014-09-09 11:41:45,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`0dafb670-1540-495b-b3e7-d456ffdba2cf`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117172', 'lastCheck': '7.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000936322', 'lastCheck': '2.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00091409', 'lastCheck': '3.0', 'valid': True}} >Thread-3765::DEBUG::2014-09-09 11:41:45,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`0dafb670-1540-495b-b3e7-d456ffdba2cf`::moving from state preparing -> state finished >Thread-3765::DEBUG::2014-09-09 11:41:45,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3765::DEBUG::2014-09-09 11:41:45,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3765::DEBUG::2014-09-09 11:41:45,739::task::993::Storage.TaskManager.Task::(_decref) Task=`0dafb670-1540-495b-b3e7-d456ffdba2cf`::ref 0 aborting False >Thread-3765::DEBUG::2014-09-09 11:41:45,740::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:45,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:45,746::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:45,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3766::DEBUG::2014-09-09 11:41:45,748::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:45,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897773 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:46,317::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:46,317::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3767::DEBUG::2014-09-09 11:41:46,317::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3767::DEBUG::2014-09-09 11:41:46,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc97706b-8382-4570-b6ed-d5f159c3d82c`::moving from state init -> state preparing >Thread-3767::INFO::2014-09-09 11:41:46,318::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3767::INFO::2014-09-09 11:41:46,319::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3767::DEBUG::2014-09-09 11:41:46,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc97706b-8382-4570-b6ed-d5f159c3d82c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3767::DEBUG::2014-09-09 11:41:46,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc97706b-8382-4570-b6ed-d5f159c3d82c`::moving from state preparing -> state finished >Thread-3767::DEBUG::2014-09-09 11:41:46,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3767::DEBUG::2014-09-09 11:41:46,319::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3767::DEBUG::2014-09-09 11:41:46,319::task::993::Storage.TaskManager.Task::(_decref) Task=`dc97706b-8382-4570-b6ed-d5f159c3d82c`::ref 0 aborting False >Thread-3767::DEBUG::2014-09-09 11:41:46,319::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3767::DEBUG::2014-09-09 11:41:46,319::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:46,385::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3768::DEBUG::2014-09-09 11:41:46,385::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:46,385::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3768::DEBUG::2014-09-09 11:41:46,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0e102f1-6f07-4290-858d-a1a566d8da2b`::moving from state init -> state preparing >Thread-3768::INFO::2014-09-09 11:41:46,386::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3768::DEBUG::2014-09-09 11:41:46,387::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`63d503ba-db14-4147-99d8-374f20adbd9a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3768::DEBUG::2014-09-09 11:41:46,387::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3768::DEBUG::2014-09-09 11:41:46,387::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3768::DEBUG::2014-09-09 11:41:46,387::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`63d503ba-db14-4147-99d8-374f20adbd9a`::Granted request >Thread-3768::DEBUG::2014-09-09 11:41:46,387::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e0e102f1-6f07-4290-858d-a1a566d8da2b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3768::DEBUG::2014-09-09 11:41:46,387::task::993::Storage.TaskManager.Task::(_decref) Task=`e0e102f1-6f07-4290-858d-a1a566d8da2b`::ref 1 aborting False >Thread-3768::INFO::2014-09-09 11:41:46,389::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3768::DEBUG::2014-09-09 11:41:46,389::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0e102f1-6f07-4290-858d-a1a566d8da2b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3768::DEBUG::2014-09-09 11:41:46,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0e102f1-6f07-4290-858d-a1a566d8da2b`::moving from state preparing -> state finished >Thread-3768::DEBUG::2014-09-09 11:41:46,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3768::DEBUG::2014-09-09 11:41:46,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3768::DEBUG::2014-09-09 11:41:46,389::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3768::DEBUG::2014-09-09 11:41:46,390::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3768::DEBUG::2014-09-09 11:41:46,390::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3768::DEBUG::2014-09-09 11:41:46,390::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3768::DEBUG::2014-09-09 11:41:46,390::task::993::Storage.TaskManager.Task::(_decref) Task=`e0e102f1-6f07-4290-858d-a1a566d8da2b`::ref 0 aborting False >Thread-3768::DEBUG::2014-09-09 11:41:46,390::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3768::DEBUG::2014-09-09 11:41:46,390::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:47,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:47,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896584 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:48,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:48,265::__init__::225::IOProcess::(_processLogs) (7998) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:48,265::__init__::225::IOProcess::(_processLogs) (7998) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:48,265::__init__::225::IOProcess::(_processLogs) DEBUG|(7998) Building response >Thread-19::DEBUG::2014-09-09 11:41:48,265::__init__::225::IOProcess::(_processLogs) (7998) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:48,265::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:48,266::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:41:48,266::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:41:48,272::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109045 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:48,273::__init__::225::IOProcess::(_processLogs) (7999) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:48,274::__init__::225::IOProcess::(_processLogs) (7999) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:48,274::__init__::225::IOProcess::(_processLogs) DEBUG|(7999) Building response >Thread-19::DEBUG::2014-09-09 11:41:48,274::__init__::225::IOProcess::(_processLogs) (7999) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:48,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:48,274::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:48,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:48,825::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3769::DEBUG::2014-09-09 11:41:48,826::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:49,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:50,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0950275 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:51,833::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:51,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3770::DEBUG::2014-09-09 11:41:51,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:52,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:52,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895361 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:52,776::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:52,776::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:52,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:52,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) (8000) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) (8000) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) DEBUG|(8000) Building response >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) (8000) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:52,777::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:41:52,778::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:41:52,784::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000895704 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) (8001) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) (8001) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:52,785::__init__::225::IOProcess::(_processLogs) DEBUG|(8001) Building response >Thread-19::DEBUG::2014-09-09 11:41:52,786::__init__::225::IOProcess::(_processLogs) (8001) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:52,786::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:52,786::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:53,379::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:53,379::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:53,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:53,380::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:53,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:53,380::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:53,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-24::DEBUG::2014-09-09 11:41:53,381::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:41:53,381::__init__::225::IOProcess::(_processLogs) (8002) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:53,386::__init__::225::IOProcess::(_processLogs) (8002) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:53,386::__init__::225::IOProcess::(_processLogs) (8002) Building response >Thread-19::DEBUG::2014-09-09 11:41:53,386::__init__::225::IOProcess::(_processLogs) (8002) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:53,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:53,386::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:41:53,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000882197 s, 621 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:53,388::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:53,388::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) (8003) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) (8003) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) DEBUG|(8003) Building response >Thread-19::DEBUG::2014-09-09 11:41:53,389::__init__::225::IOProcess::(_processLogs) (8003) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:53,390::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:53,390::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:41:53,390::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:53,390::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:41:53,390::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) (8004) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) (8004) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) (8004) Building response >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) (8004) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:53,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:53,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) (8005) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) (8005) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) (8005) Building response >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) (8005) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:53,393::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) (8006) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) (8006) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) DEBUG|(8006) Building response >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) (8006) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:53,394::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:53,395::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:41:54,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:54,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895637 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:54,842::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:54,843::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3771::DEBUG::2014-09-09 11:41:54,844::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:41:56,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:56,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898448 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:56,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3772::DEBUG::2014-09-09 11:41:56,465::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:41:56,465::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3772::DEBUG::2014-09-09 11:41:56,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`600d39e9-effe-4756-a53f-0f6606653793`::moving from state init -> state preparing >Thread-3772::INFO::2014-09-09 11:41:56,469::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3772::INFO::2014-09-09 11:41:56,470::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3772::DEBUG::2014-09-09 11:41:56,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`600d39e9-effe-4756-a53f-0f6606653793`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3772::DEBUG::2014-09-09 11:41:56,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`600d39e9-effe-4756-a53f-0f6606653793`::moving from state preparing -> state finished >Thread-3772::DEBUG::2014-09-09 11:41:56,471::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3772::DEBUG::2014-09-09 11:41:56,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3772::DEBUG::2014-09-09 11:41:56,472::task::993::Storage.TaskManager.Task::(_decref) Task=`600d39e9-effe-4756-a53f-0f6606653793`::ref 0 aborting False >Thread-3772::DEBUG::2014-09-09 11:41:56,472::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3772::DEBUG::2014-09-09 11:41:56,472::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:56,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:56,574::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3773::DEBUG::2014-09-09 11:41:56,574::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3773::DEBUG::2014-09-09 11:41:56,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`915509d3-a206-4d83-800b-687466a47b87`::moving from state init -> state preparing >Thread-3773::INFO::2014-09-09 11:41:56,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3773::DEBUG::2014-09-09 11:41:56,575::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`519bd897-123f-4797-9a37-d0c4d97f7886`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3773::DEBUG::2014-09-09 11:41:56,575::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3773::DEBUG::2014-09-09 11:41:56,575::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3773::DEBUG::2014-09-09 11:41:56,575::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`519bd897-123f-4797-9a37-d0c4d97f7886`::Granted request >Thread-3773::DEBUG::2014-09-09 11:41:56,576::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`915509d3-a206-4d83-800b-687466a47b87`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3773::DEBUG::2014-09-09 11:41:56,576::task::993::Storage.TaskManager.Task::(_decref) Task=`915509d3-a206-4d83-800b-687466a47b87`::ref 1 aborting False >Thread-3773::INFO::2014-09-09 11:41:56,577::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3773::DEBUG::2014-09-09 11:41:56,577::task::1191::Storage.TaskManager.Task::(prepare) Task=`915509d3-a206-4d83-800b-687466a47b87`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3773::DEBUG::2014-09-09 11:41:56,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`915509d3-a206-4d83-800b-687466a47b87`::moving from state preparing -> state finished >Thread-3773::DEBUG::2014-09-09 11:41:56,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3773::DEBUG::2014-09-09 11:41:56,578::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3773::DEBUG::2014-09-09 11:41:56,578::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3773::DEBUG::2014-09-09 11:41:56,578::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3773::DEBUG::2014-09-09 11:41:56,578::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3773::DEBUG::2014-09-09 11:41:56,578::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3773::DEBUG::2014-09-09 11:41:56,578::task::993::Storage.TaskManager.Task::(_decref) Task=`915509d3-a206-4d83-800b-687466a47b87`::ref 0 aborting False >Thread-3773::DEBUG::2014-09-09 11:41:56,578::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3773::DEBUG::2014-09-09 11:41:56,579::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:41:57,853::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:41:57,855::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3774::DEBUG::2014-09-09 11:41:57,856::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:41:58,275::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:58,275::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:58,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:58,275::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:58,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:58,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) (8007) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) (8007) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) DEBUG|(8007) Building response >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) (8007) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:41:58,276::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:41:58,277::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:41:58,284::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108947 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) (8008) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:41:58,285::__init__::225::IOProcess::(_processLogs) (8008) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:41:58,286::__init__::225::IOProcess::(_processLogs) DEBUG|(8008) Building response >Thread-19::DEBUG::2014-09-09 11:41:58,286::__init__::225::IOProcess::(_processLogs) (8008) Queuing response >Thread-19::DEBUG::2014-09-09 11:41:58,286::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:41:58,287::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:41:58,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:41:58,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899674 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:42:00,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:00,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899393 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:00,863::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:00,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3775::DEBUG::2014-09-09 11:42:00,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab3032cc-4d5f-4428-a9f2-9ef1962858da`::moving from state init -> state preparing >Thread-3775::INFO::2014-09-09 11:42:00,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3775::INFO::2014-09-09 11:42:00,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108947', 'lastCheck': '2.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882197', 'lastCheck': '7.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895704', 'lastCheck': '8.1', 'valid': True}} >Thread-3775::DEBUG::2014-09-09 11:42:00,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab3032cc-4d5f-4428-a9f2-9ef1962858da`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108947', 'lastCheck': '2.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882197', 'lastCheck': '7.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895704', 'lastCheck': '8.1', 'valid': True}} >Thread-3775::DEBUG::2014-09-09 11:42:00,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab3032cc-4d5f-4428-a9f2-9ef1962858da`::moving from state preparing -> state finished >Thread-3775::DEBUG::2014-09-09 11:42:00,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3775::DEBUG::2014-09-09 11:42:00,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3775::DEBUG::2014-09-09 11:42:00,866::task::993::Storage.TaskManager.Task::(_decref) Task=`ab3032cc-4d5f-4428-a9f2-9ef1962858da`::ref 0 aborting False >Thread-3775::DEBUG::2014-09-09 11:42:00,867::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:00,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:00,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3776::DEBUG::2014-09-09 11:42:00,874::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:02,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:02,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897246 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:02,787::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:02,787::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:02,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:02,787::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:02,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:02,787::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) (8009) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) (8009) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) DEBUG|(8009) Building response >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) (8009) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:02,788::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:42:02,789::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:42:02,796::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000892362 s, 398 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:02,796::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:02,796::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:02,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:02,796::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) (8010) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) (8010) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) DEBUG|(8010) Building response >Thread-19::DEBUG::2014-09-09 11:42:02,797::__init__::225::IOProcess::(_processLogs) (8010) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:02,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:02,798::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:03,395::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:03,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:03,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:03,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:03,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:03,395::__init__::225::IOProcess::(_processLogs) (8011) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:03,396::__init__::225::IOProcess::(_processLogs) (8011) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:03,396::__init__::225::IOProcess::(_processLogs) (8011) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:03,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:42:03,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:42:03,403::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0010145 s, 540 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:03,403::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:03,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:03,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:03,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:03,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:03,404::__init__::225::IOProcess::(_processLogs) (8012) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:03,404::__init__::225::IOProcess::(_processLogs) (8012) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:03,404::__init__::225::IOProcess::(_processLogs) (8012) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:03,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:03,405::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:42:03,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:03,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:03,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:03,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:03,405::__init__::225::IOProcess::(_processLogs) (8013) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) (8013) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) (8013) Building response >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) (8013) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:03,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) (8014) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) (8014) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) (8014) Building response >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) (8014) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:42:03,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) (8015) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) (8015) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:03,408::__init__::225::IOProcess::(_processLogs) (8015) Building response >Thread-19::DEBUG::2014-09-09 11:42:03,409::__init__::225::IOProcess::(_processLogs) (8015) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:03,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:03,409::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:03,940::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:03,941::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3777::DEBUG::2014-09-09 11:42:03,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:04,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:04,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089795 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:06,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:06,620::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3778::DEBUG::2014-09-09 11:42:06,620::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3778::DEBUG::2014-09-09 11:42:06,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab877386-d8e3-409b-a131-0eb6e9dca45d`::moving from state init -> state preparing >Thread-3778::INFO::2014-09-09 11:42:06,621::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3778::INFO::2014-09-09 11:42:06,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3778::DEBUG::2014-09-09 11:42:06,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab877386-d8e3-409b-a131-0eb6e9dca45d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3778::DEBUG::2014-09-09 11:42:06,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab877386-d8e3-409b-a131-0eb6e9dca45d`::moving from state preparing -> state finished >Thread-3778::DEBUG::2014-09-09 11:42:06,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3778::DEBUG::2014-09-09 11:42:06,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3778::DEBUG::2014-09-09 11:42:06,622::task::993::Storage.TaskManager.Task::(_decref) Task=`ab877386-d8e3-409b-a131-0eb6e9dca45d`::ref 0 aborting False >Thread-3778::DEBUG::2014-09-09 11:42:06,622::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3778::DEBUG::2014-09-09 11:42:06,622::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:06,685::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:06,686::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3779::DEBUG::2014-09-09 11:42:06,686::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3779::DEBUG::2014-09-09 11:42:06,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9cef351-e296-4e1f-aeee-49f31eabc87a`::moving from state init -> state preparing >Thread-3779::INFO::2014-09-09 11:42:06,687::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3779::DEBUG::2014-09-09 11:42:06,687::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`476b5e33-a1b2-46eb-8161-71573abe4ba5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3779::DEBUG::2014-09-09 11:42:06,687::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3779::DEBUG::2014-09-09 11:42:06,687::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3779::DEBUG::2014-09-09 11:42:06,687::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`476b5e33-a1b2-46eb-8161-71573abe4ba5`::Granted request >Thread-3779::DEBUG::2014-09-09 11:42:06,687::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c9cef351-e296-4e1f-aeee-49f31eabc87a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3779::DEBUG::2014-09-09 11:42:06,687::task::993::Storage.TaskManager.Task::(_decref) Task=`c9cef351-e296-4e1f-aeee-49f31eabc87a`::ref 1 aborting False >Thread-3779::INFO::2014-09-09 11:42:06,689::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3779::DEBUG::2014-09-09 11:42:06,689::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9cef351-e296-4e1f-aeee-49f31eabc87a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3779::DEBUG::2014-09-09 11:42:06,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9cef351-e296-4e1f-aeee-49f31eabc87a`::moving from state preparing -> state finished >Thread-3779::DEBUG::2014-09-09 11:42:06,689::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3779::DEBUG::2014-09-09 11:42:06,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3779::DEBUG::2014-09-09 11:42:06,690::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3779::DEBUG::2014-09-09 11:42:06,690::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3779::DEBUG::2014-09-09 11:42:06,690::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3779::DEBUG::2014-09-09 11:42:06,690::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3779::DEBUG::2014-09-09 11:42:06,690::task::993::Storage.TaskManager.Task::(_decref) Task=`c9cef351-e296-4e1f-aeee-49f31eabc87a`::ref 0 aborting False >Thread-3779::DEBUG::2014-09-09 11:42:06,690::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283923972096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3779::DEBUG::2014-09-09 11:42:06,690::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:06,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:06,950::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:06,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3780::DEBUG::2014-09-09 11:42:06,956::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:06,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0966878 s, 10.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:08,287::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:08,287::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:08,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:08,287::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:08,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:08,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:08,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:08,288::__init__::225::IOProcess::(_processLogs) (8016) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:08,288::__init__::225::IOProcess::(_processLogs) (8016) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:08,289::__init__::225::IOProcess::(_processLogs) DEBUG|(8016) Building response >Thread-19::DEBUG::2014-09-09 11:42:08,289::__init__::225::IOProcess::(_processLogs) (8016) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:08,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:08,289::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:42:08,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:42:08,297::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.001045 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:08,297::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:08,297::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:08,297::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:08,297::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) (8017) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) (8017) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) DEBUG|(8017) Building response >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) (8017) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:08,298::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:08,299::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:42:08,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:09,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089697 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:09,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:09,966::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3781::DEBUG::2014-09-09 11:42:09,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:11,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:11,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896978 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:12,798::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) (8018) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) (8018) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:12,799::__init__::225::IOProcess::(_processLogs) DEBUG|(8018) Building response >Thread-19::DEBUG::2014-09-09 11:42:12,800::__init__::225::IOProcess::(_processLogs) (8018) Queuing response >Thread-3443::DEBUG::2014-09-09 11:42:12,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:12,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:12,805::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:42:12,807::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000889042 s, 399 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:12,808::__init__::225::IOProcess::(_processLogs) (8019) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:12,809::__init__::225::IOProcess::(_processLogs) (8019) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:12,809::__init__::225::IOProcess::(_processLogs) (8019) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:12,809::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:12,974::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:12,975::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3782::DEBUG::2014-09-09 11:42:12,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:13,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:13,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895565 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:13,408::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:13,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:13,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:13,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:13,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:13,409::__init__::225::IOProcess::(_processLogs) (8020) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:13,409::__init__::225::IOProcess::(_processLogs) (8020) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:13,410::__init__::225::IOProcess::(_processLogs) (8020) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:13,410::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:42:13,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:42:13,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000903903 s, 606 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) (8021) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:13,420::__init__::225::IOProcess::(_processLogs) (8021) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:13,421::__init__::225::IOProcess::(_processLogs) (8021) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:13,421::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:13,421::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:42:13,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:13,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) (8022) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) (8022) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) (8022) Building response >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) (8022) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:13,422::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:13,423::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:42:13,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:13,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:13,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:13,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:13,424::__init__::225::IOProcess::(_processLogs) (8023) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:13,424::__init__::225::IOProcess::(_processLogs) (8023) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:13,424::__init__::225::IOProcess::(_processLogs) (8023) Building response >Thread-19::DEBUG::2014-09-09 11:42:13,424::__init__::225::IOProcess::(_processLogs) (8023) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:13,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:13,425::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:13,425::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:42:13,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:13,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:13,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) (8024) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) (8024) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) (8024) Building response >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) (8024) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:13,426::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:42:15,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:15,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896226 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:15,986::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:15,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3783::DEBUG::2014-09-09 11:42:15,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`3773b4b7-c5de-41f2-bf9a-07e1ccc7531f`::moving from state init -> state preparing >Thread-3783::INFO::2014-09-09 11:42:15,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3783::INFO::2014-09-09 11:42:15,988::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001045', 'lastCheck': '7.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000903903', 'lastCheck': '2.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000889042', 'lastCheck': '3.2', 'valid': True}} >Thread-3783::DEBUG::2014-09-09 11:42:15,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`3773b4b7-c5de-41f2-bf9a-07e1ccc7531f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001045', 'lastCheck': '7.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000903903', 'lastCheck': '2.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000889042', 'lastCheck': '3.2', 'valid': True}} >Thread-3783::DEBUG::2014-09-09 11:42:15,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`3773b4b7-c5de-41f2-bf9a-07e1ccc7531f`::moving from state preparing -> state finished >Thread-3783::DEBUG::2014-09-09 11:42:15,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3783::DEBUG::2014-09-09 11:42:15,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3783::DEBUG::2014-09-09 11:42:15,988::task::993::Storage.TaskManager.Task::(_decref) Task=`3773b4b7-c5de-41f2-bf9a-07e1ccc7531f`::ref 0 aborting False >Thread-3783::DEBUG::2014-09-09 11:42:15,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:15,999::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:16,000::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3784::DEBUG::2014-09-09 11:42:16,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:16,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:16,745::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3785::DEBUG::2014-09-09 11:42:16,745::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3785::DEBUG::2014-09-09 11:42:16,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d27387a-c4d9-406f-a0c5-6afa78809152`::moving from state init -> state preparing >Thread-3785::INFO::2014-09-09 11:42:16,746::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3785::INFO::2014-09-09 11:42:16,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3785::DEBUG::2014-09-09 11:42:16,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d27387a-c4d9-406f-a0c5-6afa78809152`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3785::DEBUG::2014-09-09 11:42:16,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d27387a-c4d9-406f-a0c5-6afa78809152`::moving from state preparing -> state finished >Thread-3785::DEBUG::2014-09-09 11:42:16,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3785::DEBUG::2014-09-09 11:42:16,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3785::DEBUG::2014-09-09 11:42:16,747::task::993::Storage.TaskManager.Task::(_decref) Task=`3d27387a-c4d9-406f-a0c5-6afa78809152`::ref 0 aborting False >Thread-3785::DEBUG::2014-09-09 11:42:16,747::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3785::DEBUG::2014-09-09 11:42:16,747::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:16,777::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:16,778::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3786::DEBUG::2014-09-09 11:42:16,778::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3786::DEBUG::2014-09-09 11:42:16,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2d227e9-edc9-4e43-8ec3-2a82a81c4475`::moving from state init -> state preparing >Thread-3786::INFO::2014-09-09 11:42:16,779::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3786::DEBUG::2014-09-09 11:42:16,779::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`813abf5f-5dfc-4500-95ef-4bcf672b5a8f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3786::DEBUG::2014-09-09 11:42:16,779::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3786::DEBUG::2014-09-09 11:42:16,779::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3786::DEBUG::2014-09-09 11:42:16,779::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`813abf5f-5dfc-4500-95ef-4bcf672b5a8f`::Granted request >Thread-3786::DEBUG::2014-09-09 11:42:16,780::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e2d227e9-edc9-4e43-8ec3-2a82a81c4475`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3786::DEBUG::2014-09-09 11:42:16,780::task::993::Storage.TaskManager.Task::(_decref) Task=`e2d227e9-edc9-4e43-8ec3-2a82a81c4475`::ref 1 aborting False >Thread-3786::INFO::2014-09-09 11:42:16,781::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3786::DEBUG::2014-09-09 11:42:16,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2d227e9-edc9-4e43-8ec3-2a82a81c4475`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3786::DEBUG::2014-09-09 11:42:16,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2d227e9-edc9-4e43-8ec3-2a82a81c4475`::moving from state preparing -> state finished >Thread-3786::DEBUG::2014-09-09 11:42:16,782::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3786::DEBUG::2014-09-09 11:42:16,782::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3786::DEBUG::2014-09-09 11:42:16,782::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3786::DEBUG::2014-09-09 11:42:16,782::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3786::DEBUG::2014-09-09 11:42:16,782::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3786::DEBUG::2014-09-09 11:42:16,782::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3786::DEBUG::2014-09-09 11:42:16,782::task::993::Storage.TaskManager.Task::(_decref) Task=`e2d227e9-edc9-4e43-8ec3-2a82a81c4475`::ref 0 aborting False >Thread-3786::DEBUG::2014-09-09 11:42:16,782::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3786::DEBUG::2014-09-09 11:42:16,783::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:17,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:17,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897629 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:18,299::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) (8025) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) (8025) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:18,300::__init__::225::IOProcess::(_processLogs) (8025) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:18,301::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:42:18,301::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:18,301::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:42:18,308::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107516 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:18,308::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) (8026) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) (8026) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:18,309::__init__::225::IOProcess::(_processLogs) (8026) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:18,310::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:19,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:19,068::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3787::DEBUG::2014-09-09 11:42:19,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:19,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:19,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0952299 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:42:21,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:21,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900568 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:22,074::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:22,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3788::DEBUG::2014-09-09 11:42:22,076::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:42:22,810::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:22,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:22,810::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:22,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:22,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:22,811::__init__::225::IOProcess::(_processLogs) (8027) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:22,811::__init__::225::IOProcess::(_processLogs) (8027) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:22,811::__init__::225::IOProcess::(_processLogs) (8027) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:22,811::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:42:22,812::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:42:22,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000938851 s, 378 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) (8028) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) (8028) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:22,819::__init__::225::IOProcess::(_processLogs) (8028) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:22,820::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) (8029) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:23,426::__init__::225::IOProcess::(_processLogs) (8029) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:23,427::__init__::225::IOProcess::(_processLogs) (8029) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:23,427::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:42:23,427::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:42:23,434::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00096339 s, 569 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:23,434::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:23,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:23,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:23,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:23,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:23,435::__init__::225::IOProcess::(_processLogs) (8030) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:23,435::__init__::225::IOProcess::(_processLogs) (8030) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:23,435::__init__::225::IOProcess::(_processLogs) (8030) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:23,435::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:23,436::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:42:23,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:23,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) (8031) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) (8031) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) (8031) Building response >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) (8031) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:42:23,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) (8032) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) (8032) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) (8032) Building response >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) (8032) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:23,438::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:23,439::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:42:23,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:23,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:23,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:23,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:23,439::__init__::225::IOProcess::(_processLogs) (8033) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:23,440::__init__::225::IOProcess::(_processLogs) (8033) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:23,440::__init__::225::IOProcess::(_processLogs) (8033) Building response >Thread-19::DEBUG::2014-09-09 11:42:23,440::__init__::225::IOProcess::(_processLogs) (8033) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:23,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:23,440::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:42:23,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:23,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896459 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:25,081::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:25,082::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3789::DEBUG::2014-09-09 11:42:25,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:25,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:25,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896259 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:26,822::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3790::DEBUG::2014-09-09 11:42:26,823::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:42:26,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3790::DEBUG::2014-09-09 11:42:26,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`a386884a-4796-4ce0-a3f0-69875ee85e15`::moving from state init -> state preparing >Thread-3790::INFO::2014-09-09 11:42:26,824::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3790::INFO::2014-09-09 11:42:26,824::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3790::DEBUG::2014-09-09 11:42:26,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`a386884a-4796-4ce0-a3f0-69875ee85e15`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3790::DEBUG::2014-09-09 11:42:26,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`a386884a-4796-4ce0-a3f0-69875ee85e15`::moving from state preparing -> state finished >Thread-3790::DEBUG::2014-09-09 11:42:26,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3790::DEBUG::2014-09-09 11:42:26,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3790::DEBUG::2014-09-09 11:42:26,825::task::993::Storage.TaskManager.Task::(_decref) Task=`a386884a-4796-4ce0-a3f0-69875ee85e15`::ref 0 aborting False >Thread-3790::DEBUG::2014-09-09 11:42:26,825::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3790::DEBUG::2014-09-09 11:42:26,825::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:26,853::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:26,854::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3791::DEBUG::2014-09-09 11:42:26,854::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3791::DEBUG::2014-09-09 11:42:26,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`dea93570-a270-4e20-a644-c55173a57096`::moving from state init -> state preparing >Thread-3791::INFO::2014-09-09 11:42:26,855::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3791::DEBUG::2014-09-09 11:42:26,855::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e4719b88-c402-4aa4-9539-2483dd5a2e97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3791::DEBUG::2014-09-09 11:42:26,855::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3791::DEBUG::2014-09-09 11:42:26,856::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3791::DEBUG::2014-09-09 11:42:26,856::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e4719b88-c402-4aa4-9539-2483dd5a2e97`::Granted request >Thread-3791::DEBUG::2014-09-09 11:42:26,856::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dea93570-a270-4e20-a644-c55173a57096`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3791::DEBUG::2014-09-09 11:42:26,857::task::993::Storage.TaskManager.Task::(_decref) Task=`dea93570-a270-4e20-a644-c55173a57096`::ref 1 aborting False >Thread-3791::INFO::2014-09-09 11:42:26,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3791::DEBUG::2014-09-09 11:42:26,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`dea93570-a270-4e20-a644-c55173a57096`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3791::DEBUG::2014-09-09 11:42:26,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`dea93570-a270-4e20-a644-c55173a57096`::moving from state preparing -> state finished >Thread-3791::DEBUG::2014-09-09 11:42:26,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3791::DEBUG::2014-09-09 11:42:26,859::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3791::DEBUG::2014-09-09 11:42:26,859::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3791::DEBUG::2014-09-09 11:42:26,859::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3791::DEBUG::2014-09-09 11:42:26,859::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3791::DEBUG::2014-09-09 11:42:26,859::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3791::DEBUG::2014-09-09 11:42:26,859::task::993::Storage.TaskManager.Task::(_decref) Task=`dea93570-a270-4e20-a644-c55173a57096`::ref 0 aborting False >Thread-3791::DEBUG::2014-09-09 11:42:26,859::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3791::DEBUG::2014-09-09 11:42:26,859::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:27,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:28,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089608 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:28,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:28,090::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3792::DEBUG::2014-09-09 11:42:28,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) (8034) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) (8034) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:28,311::__init__::225::IOProcess::(_processLogs) DEBUG|(8034) Building response >Thread-19::DEBUG::2014-09-09 11:42:28,312::__init__::225::IOProcess::(_processLogs) (8034) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:28,312::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:42:28,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:28,312::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:42:28,319::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108961 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) (8035) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:28,320::__init__::225::IOProcess::(_processLogs) (8035) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:28,321::__init__::225::IOProcess::(_processLogs) DEBUG|(8035) Building response >Thread-19::DEBUG::2014-09-09 11:42:28,321::__init__::225::IOProcess::(_processLogs) (8035) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:28,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:28,321::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:42:30,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:30,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895116 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:31,099::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:31,100::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3793::DEBUG::2014-09-09 11:42:31,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`81fef6ce-12bc-461f-a17c-98615890f5e9`::moving from state init -> state preparing >Thread-3793::INFO::2014-09-09 11:42:31,101::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3793::INFO::2014-09-09 11:42:31,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108961', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096339', 'lastCheck': '7.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000938851', 'lastCheck': '8.3', 'valid': True}} >Thread-3793::DEBUG::2014-09-09 11:42:31,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`81fef6ce-12bc-461f-a17c-98615890f5e9`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108961', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096339', 'lastCheck': '7.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000938851', 'lastCheck': '8.3', 'valid': True}} >Thread-3793::DEBUG::2014-09-09 11:42:31,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`81fef6ce-12bc-461f-a17c-98615890f5e9`::moving from state preparing -> state finished >Thread-3793::DEBUG::2014-09-09 11:42:31,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3793::DEBUG::2014-09-09 11:42:31,102::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3793::DEBUG::2014-09-09 11:42:31,102::task::993::Storage.TaskManager.Task::(_decref) Task=`81fef6ce-12bc-461f-a17c-98615890f5e9`::ref 0 aborting False >Thread-3793::DEBUG::2014-09-09 11:42:31,102::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:31,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:31,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3794::DEBUG::2014-09-09 11:42:31,115::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:32,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:32,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897958 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:32,821::__init__::225::IOProcess::(_processLogs) (8036) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:32,822::__init__::225::IOProcess::(_processLogs) (8036) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:32,823::__init__::225::IOProcess::(_processLogs) DEBUG|(8036) Building response >Thread-19::DEBUG::2014-09-09 11:42:32,823::__init__::225::IOProcess::(_processLogs) (8036) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:32,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:32,823::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:42:32,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:42:32,831::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910427 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:32,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:32,831::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:32,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) (8037) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) (8037) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) DEBUG|(8037) Building response >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) (8037) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:32,832::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:32,833::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:33,439::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) (8038) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) (8038) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) DEBUG|(8038) Building response >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) (8038) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:33,440::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:33,441::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:42:33,441::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:42:33,448::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00093541 s, 586 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:33,448::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) (8039) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) (8039) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) DEBUG|(8039) Building response >Thread-19::DEBUG::2014-09-09 11:42:33,449::__init__::225::IOProcess::(_processLogs) (8039) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:33,450::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:33,450::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:33,450::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:33,450::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) (8040) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) (8040) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) (8040) Building response >Thread-19::DEBUG::2014-09-09 11:42:33,451::__init__::225::IOProcess::(_processLogs) (8040) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:33,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) (8041) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) (8041) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) (8041) Building response >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) (8041) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:42:33,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) (8042) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) (8042) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:33,454::__init__::225::IOProcess::(_processLogs) (8042) Building response >Thread-19::DEBUG::2014-09-09 11:42:33,455::__init__::225::IOProcess::(_processLogs) (8042) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:33,455::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:33,455::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:34,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:34,221::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3795::DEBUG::2014-09-09 11:42:34,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:34,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:34,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896117 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:42:36,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:36,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896186 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:36,896::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:36,897::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3796::DEBUG::2014-09-09 11:42:36,897::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3796::DEBUG::2014-09-09 11:42:36,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e578f27-c847-4e97-ba24-3e81fb3fd912`::moving from state init -> state preparing >Thread-3796::INFO::2014-09-09 11:42:36,898::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3796::INFO::2014-09-09 11:42:36,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3796::DEBUG::2014-09-09 11:42:36,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e578f27-c847-4e97-ba24-3e81fb3fd912`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3796::DEBUG::2014-09-09 11:42:36,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e578f27-c847-4e97-ba24-3e81fb3fd912`::moving from state preparing -> state finished >Thread-3796::DEBUG::2014-09-09 11:42:36,899::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3796::DEBUG::2014-09-09 11:42:36,899::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3796::DEBUG::2014-09-09 11:42:36,899::task::993::Storage.TaskManager.Task::(_decref) Task=`7e578f27-c847-4e97-ba24-3e81fb3fd912`::ref 0 aborting False >Thread-3796::DEBUG::2014-09-09 11:42:36,899::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3796::DEBUG::2014-09-09 11:42:36,899::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:36,922::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3797::DEBUG::2014-09-09 11:42:36,922::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:42:36,922::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3797::DEBUG::2014-09-09 11:42:36,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`852a13cb-6a8c-4697-b30f-75aa900c9150`::moving from state init -> state preparing >Thread-3797::INFO::2014-09-09 11:42:36,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3797::DEBUG::2014-09-09 11:42:36,924::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e2b1927a-d142-40b5-84e4-a91d00b8a06b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3797::DEBUG::2014-09-09 11:42:36,924::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3797::DEBUG::2014-09-09 11:42:36,924::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3797::DEBUG::2014-09-09 11:42:36,924::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e2b1927a-d142-40b5-84e4-a91d00b8a06b`::Granted request >Thread-3797::DEBUG::2014-09-09 11:42:36,924::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`852a13cb-6a8c-4697-b30f-75aa900c9150`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3797::DEBUG::2014-09-09 11:42:36,924::task::993::Storage.TaskManager.Task::(_decref) Task=`852a13cb-6a8c-4697-b30f-75aa900c9150`::ref 1 aborting False >Thread-3797::INFO::2014-09-09 11:42:36,926::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3797::DEBUG::2014-09-09 11:42:36,926::task::1191::Storage.TaskManager.Task::(prepare) Task=`852a13cb-6a8c-4697-b30f-75aa900c9150`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3797::DEBUG::2014-09-09 11:42:36,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`852a13cb-6a8c-4697-b30f-75aa900c9150`::moving from state preparing -> state finished >Thread-3797::DEBUG::2014-09-09 11:42:36,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3797::DEBUG::2014-09-09 11:42:36,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3797::DEBUG::2014-09-09 11:42:36,927::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3797::DEBUG::2014-09-09 11:42:36,927::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3797::DEBUG::2014-09-09 11:42:36,927::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3797::DEBUG::2014-09-09 11:42:36,927::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3797::DEBUG::2014-09-09 11:42:36,927::task::993::Storage.TaskManager.Task::(_decref) Task=`852a13cb-6a8c-4697-b30f-75aa900c9150`::ref 0 aborting False >Thread-3797::DEBUG::2014-09-09 11:42:36,927::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3797::DEBUG::2014-09-09 11:42:36,927::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:37,229::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:37,230::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3798::DEBUG::2014-09-09 11:42:37,231::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) (8043) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:38,322::__init__::225::IOProcess::(_processLogs) (8043) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:38,323::__init__::225::IOProcess::(_processLogs) DEBUG|(8043) Building response >Thread-19::DEBUG::2014-09-09 11:42:38,323::__init__::225::IOProcess::(_processLogs) (8043) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:38,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:38,323::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:42:38,324::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:42:38,331::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110246 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) (8044) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:38,332::__init__::225::IOProcess::(_processLogs) (8044) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:38,333::__init__::225::IOProcess::(_processLogs) DEBUG|(8044) Building response >Thread-19::DEBUG::2014-09-09 11:42:38,333::__init__::225::IOProcess::(_processLogs) (8044) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:38,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:38,333::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:42:38,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:38,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896181 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:40,237::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:40,237::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3799::DEBUG::2014-09-09 11:42:40,238::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:40,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:40,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896969 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:42:42,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:42,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897764 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) (8045) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:42,834::__init__::225::IOProcess::(_processLogs) (8045) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:42,835::__init__::225::IOProcess::(_processLogs) DEBUG|(8045) Building response >Thread-3443::DEBUG::2014-09-09 11:42:42,835::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:42,835::__init__::225::IOProcess::(_processLogs) (8045) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:42,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:42,840::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:42:42,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000902315 s, 393 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:42,842::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:42,842::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:42,842::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:42,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:42,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) (8046) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) (8046) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) DEBUG|(8046) Building response >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) (8046) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:42,843::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:42,844::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:43,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:43,246::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3800::DEBUG::2014-09-09 11:42:43,247::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:42:43,454::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:43,454::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) (8047) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:43,455::__init__::225::IOProcess::(_processLogs) (8047) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:43,456::__init__::225::IOProcess::(_processLogs) DEBUG|(8047) Building response >Thread-19::DEBUG::2014-09-09 11:42:43,456::__init__::225::IOProcess::(_processLogs) (8047) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:43,456::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:42:43,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:43,457::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:42:43,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000913987 s, 600 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:43,464::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:43,464::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) (8048) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) (8048) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:43,465::__init__::225::IOProcess::(_processLogs) DEBUG|(8048) Building response >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) (8048) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:43,466::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) (8049) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) (8049) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) DEBUG|(8049) Building response >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) (8049) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:43,467::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) (8050) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:43,468::__init__::225::IOProcess::(_processLogs) (8050) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) DEBUG|(8050) Building response >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) (8050) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:42:43,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) (8051) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) (8051) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) (8051) Building response >Thread-19::DEBUG::2014-09-09 11:42:43,470::__init__::225::IOProcess::(_processLogs) (8051) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:43,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:43,471::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:42:44,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:44,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899842 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:46,257::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:46,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3801::DEBUG::2014-09-09 11:42:46,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`2352fd3c-bfaf-481a-9259-8dc67360b355`::moving from state init -> state preparing >Thread-3801::INFO::2014-09-09 11:42:46,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3801::INFO::2014-09-09 11:42:46,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110246', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000913987', 'lastCheck': '2.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000902315', 'lastCheck': '3.4', 'valid': True}} >Thread-3801::DEBUG::2014-09-09 11:42:46,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`2352fd3c-bfaf-481a-9259-8dc67360b355`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110246', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000913987', 'lastCheck': '2.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000902315', 'lastCheck': '3.4', 'valid': True}} >Thread-3801::DEBUG::2014-09-09 11:42:46,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`2352fd3c-bfaf-481a-9259-8dc67360b355`::moving from state preparing -> state finished >Thread-3801::DEBUG::2014-09-09 11:42:46,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3801::DEBUG::2014-09-09 11:42:46,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3801::DEBUG::2014-09-09 11:42:46,260::task::993::Storage.TaskManager.Task::(_decref) Task=`2352fd3c-bfaf-481a-9259-8dc67360b355`::ref 0 aborting False >Thread-3801::DEBUG::2014-09-09 11:42:46,261::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:46,272::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:46,272::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3802::DEBUG::2014-09-09 11:42:46,273::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:46,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:46,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:46,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3803::DEBUG::2014-09-09 11:42:46,981::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3803::DEBUG::2014-09-09 11:42:46,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`64c1d51f-e3b9-4d17-b01d-bdcd484332f7`::moving from state init -> state preparing >Thread-3803::INFO::2014-09-09 11:42:46,982::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3803::INFO::2014-09-09 11:42:46,982::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3803::DEBUG::2014-09-09 11:42:46,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`64c1d51f-e3b9-4d17-b01d-bdcd484332f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3803::DEBUG::2014-09-09 11:42:46,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`64c1d51f-e3b9-4d17-b01d-bdcd484332f7`::moving from state preparing -> state finished >Thread-3803::DEBUG::2014-09-09 11:42:46,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3803::DEBUG::2014-09-09 11:42:46,982::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3803::DEBUG::2014-09-09 11:42:46,982::task::993::Storage.TaskManager.Task::(_decref) Task=`64c1d51f-e3b9-4d17-b01d-bdcd484332f7`::ref 0 aborting False >Thread-3803::DEBUG::2014-09-09 11:42:46,983::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3803::DEBUG::2014-09-09 11:42:46,983::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:47,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897595 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:47,023::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:47,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3804::DEBUG::2014-09-09 11:42:47,024::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3804::DEBUG::2014-09-09 11:42:47,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`597fa651-03e0-4510-ad42-7a5930cca0ff`::moving from state init -> state preparing >Thread-3804::INFO::2014-09-09 11:42:47,024::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3804::DEBUG::2014-09-09 11:42:47,025::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eb80b9d9-f975-4e41-a2d7-527812336825`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3804::DEBUG::2014-09-09 11:42:47,025::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3804::DEBUG::2014-09-09 11:42:47,025::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3804::DEBUG::2014-09-09 11:42:47,025::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eb80b9d9-f975-4e41-a2d7-527812336825`::Granted request >Thread-3804::DEBUG::2014-09-09 11:42:47,025::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`597fa651-03e0-4510-ad42-7a5930cca0ff`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3804::DEBUG::2014-09-09 11:42:47,025::task::993::Storage.TaskManager.Task::(_decref) Task=`597fa651-03e0-4510-ad42-7a5930cca0ff`::ref 1 aborting False >Thread-3804::INFO::2014-09-09 11:42:47,027::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3804::DEBUG::2014-09-09 11:42:47,027::task::1191::Storage.TaskManager.Task::(prepare) Task=`597fa651-03e0-4510-ad42-7a5930cca0ff`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3804::DEBUG::2014-09-09 11:42:47,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`597fa651-03e0-4510-ad42-7a5930cca0ff`::moving from state preparing -> state finished >Thread-3804::DEBUG::2014-09-09 11:42:47,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3804::DEBUG::2014-09-09 11:42:47,027::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3804::DEBUG::2014-09-09 11:42:47,028::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3804::DEBUG::2014-09-09 11:42:47,028::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3804::DEBUG::2014-09-09 11:42:47,028::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3804::DEBUG::2014-09-09 11:42:47,028::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3804::DEBUG::2014-09-09 11:42:47,028::task::993::Storage.TaskManager.Task::(_decref) Task=`597fa651-03e0-4510-ad42-7a5930cca0ff`::ref 0 aborting False >Thread-3804::DEBUG::2014-09-09 11:42:47,028::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3804::DEBUG::2014-09-09 11:42:47,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:48,334::__init__::225::IOProcess::(_processLogs) (8052) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:48,335::__init__::225::IOProcess::(_processLogs) (8052) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:48,335::__init__::225::IOProcess::(_processLogs) DEBUG|(8052) Building response >Thread-19::DEBUG::2014-09-09 11:42:48,335::__init__::225::IOProcess::(_processLogs) (8052) Queuing response >Thread-23::DEBUG::2014-09-09 11:42:48,335::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:48,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:48,340::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:42:48,342::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108707 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) (8053) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:48,343::__init__::225::IOProcess::(_processLogs) (8053) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:48,344::__init__::225::IOProcess::(_processLogs) DEBUG|(8053) Building response >Thread-19::DEBUG::2014-09-09 11:42:48,344::__init__::225::IOProcess::(_processLogs) (8053) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:48,344::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:48,345::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:42:49,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:49,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898273 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:49,417::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:49,418::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3805::DEBUG::2014-09-09 11:42:49,421::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:51,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:51,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089813 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:52,430::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:52,431::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3806::DEBUG::2014-09-09 11:42:52,432::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:42:52,844::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:52,844::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) (8054) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) (8054) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:52,845::__init__::225::IOProcess::(_processLogs) DEBUG|(8054) Building response >Thread-19::DEBUG::2014-09-09 11:42:52,846::__init__::225::IOProcess::(_processLogs) (8054) Queuing response >Thread-3443::DEBUG::2014-09-09 11:42:52,846::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:52,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:52,851::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:42:52,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000943502 s, 376 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:52,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:52,853::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:42:52,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:52,853::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:52,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:52,853::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) (8055) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) (8055) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) DEBUG|(8055) Building response >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) (8055) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:52,854::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:42:53,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:53,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898032 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:53,470::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:53,470::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) (8056) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) (8056) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) DEBUG|(8056) Building response >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) (8056) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:53,471::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:42:53,472::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:53,472::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:42:53,480::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000961343 s, 570 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) (8057) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:53,481::__init__::225::IOProcess::(_processLogs) (8057) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:53,482::__init__::225::IOProcess::(_processLogs) DEBUG|(8057) Building response >Thread-19::DEBUG::2014-09-09 11:42:53,482::__init__::225::IOProcess::(_processLogs) (8057) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:53,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:53,482::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:53,483::__init__::225::IOProcess::(_processLogs) (8058) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) (8058) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) (8058) Building response >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) (8058) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:53,484::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) (8059) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) (8059) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) (8059) Building response >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) (8059) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:42:53,485::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) (8060) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) (8060) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) DEBUG|(8060) Building response >Thread-19::DEBUG::2014-09-09 11:42:53,486::__init__::225::IOProcess::(_processLogs) (8060) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:53,487::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:53,487::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:42:55,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:55,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896854 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:55,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:55,440::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3807::DEBUG::2014-09-09 11:42:55,441::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:57,210::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3808::DEBUG::2014-09-09 11:42:57,211::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:42:57,211::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3808::DEBUG::2014-09-09 11:42:57,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`8309a861-8ed3-431f-abd6-d6493b1a0793`::moving from state init -> state preparing >Thread-3808::INFO::2014-09-09 11:42:57,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3808::INFO::2014-09-09 11:42:57,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3808::DEBUG::2014-09-09 11:42:57,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`8309a861-8ed3-431f-abd6-d6493b1a0793`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3808::DEBUG::2014-09-09 11:42:57,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`8309a861-8ed3-431f-abd6-d6493b1a0793`::moving from state preparing -> state finished >Thread-3808::DEBUG::2014-09-09 11:42:57,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3808::DEBUG::2014-09-09 11:42:57,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3808::DEBUG::2014-09-09 11:42:57,212::task::993::Storage.TaskManager.Task::(_decref) Task=`8309a861-8ed3-431f-abd6-d6493b1a0793`::ref 0 aborting False >Thread-3808::DEBUG::2014-09-09 11:42:57,213::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3808::DEBUG::2014-09-09 11:42:57,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:57,282::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:57,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3809::DEBUG::2014-09-09 11:42:57,282::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3809::DEBUG::2014-09-09 11:42:57,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e3cefde-60ba-4a09-b4a6-7c5ae9cf8b67`::moving from state init -> state preparing >Thread-3809::INFO::2014-09-09 11:42:57,283::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3809::DEBUG::2014-09-09 11:42:57,284::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a3cac83b-f560-4fe0-aeb8-2fe7a38e2098`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3809::DEBUG::2014-09-09 11:42:57,284::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3809::DEBUG::2014-09-09 11:42:57,284::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3809::DEBUG::2014-09-09 11:42:57,284::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a3cac83b-f560-4fe0-aeb8-2fe7a38e2098`::Granted request >Thread-3809::DEBUG::2014-09-09 11:42:57,284::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1e3cefde-60ba-4a09-b4a6-7c5ae9cf8b67`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3809::DEBUG::2014-09-09 11:42:57,284::task::993::Storage.TaskManager.Task::(_decref) Task=`1e3cefde-60ba-4a09-b4a6-7c5ae9cf8b67`::ref 1 aborting False >Thread-3809::INFO::2014-09-09 11:42:57,286::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3809::DEBUG::2014-09-09 11:42:57,286::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e3cefde-60ba-4a09-b4a6-7c5ae9cf8b67`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3809::DEBUG::2014-09-09 11:42:57,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e3cefde-60ba-4a09-b4a6-7c5ae9cf8b67`::moving from state preparing -> state finished >Thread-3809::DEBUG::2014-09-09 11:42:57,286::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3809::DEBUG::2014-09-09 11:42:57,286::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3809::DEBUG::2014-09-09 11:42:57,286::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3809::DEBUG::2014-09-09 11:42:57,286::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3809::DEBUG::2014-09-09 11:42:57,286::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3809::DEBUG::2014-09-09 11:42:57,287::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3809::DEBUG::2014-09-09 11:42:57,287::task::993::Storage.TaskManager.Task::(_decref) Task=`1e3cefde-60ba-4a09-b4a6-7c5ae9cf8b67`::ref 0 aborting False >Thread-3809::DEBUG::2014-09-09 11:42:57,287::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3809::DEBUG::2014-09-09 11:42:57,287::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:57,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:57,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897439 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:58,345::__init__::225::IOProcess::(_processLogs) (8061) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:58,346::__init__::225::IOProcess::(_processLogs) (8061) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:58,346::__init__::225::IOProcess::(_processLogs) DEBUG|(8061) Building response >Thread-19::DEBUG::2014-09-09 11:42:58,346::__init__::225::IOProcess::(_processLogs) (8061) Queuing response >Thread-23::DEBUG::2014-09-09 11:42:58,347::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:42:58,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:42:58,352::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:42:58,354::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108142 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:42:58,355::__init__::225::IOProcess::(_processLogs) (8062) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:42:58,356::__init__::225::IOProcess::(_processLogs) (8062) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:42:58,356::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8062) Building response >Thread-19::DEBUG::2014-09-09 11:42:58,356::__init__::225::IOProcess::(_processLogs) (8062) Queuing response >Thread-19::DEBUG::2014-09-09 11:42:58,356::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:42:58,357::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:42:58,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:42:58,450::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3810::DEBUG::2014-09-09 11:42:58,450::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:42:59,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:42:59,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896915 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:01,457::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:01,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3811::DEBUG::2014-09-09 11:43:01,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef2a4a41-7cfe-459b-960e-5e77cddbbb42`::moving from state init -> state preparing >Thread-3811::INFO::2014-09-09 11:43:01,459::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3811::INFO::2014-09-09 11:43:01,459::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108142', 'lastCheck': '3.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000961343', 'lastCheck': '8.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000943502', 'lastCheck': '8.6', 'valid': True}} >Thread-3811::DEBUG::2014-09-09 11:43:01,460::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef2a4a41-7cfe-459b-960e-5e77cddbbb42`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108142', 'lastCheck': '3.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000961343', 'lastCheck': '8.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000943502', 'lastCheck': '8.6', 'valid': True}} >Thread-3811::DEBUG::2014-09-09 11:43:01,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef2a4a41-7cfe-459b-960e-5e77cddbbb42`::moving from state preparing -> state finished >Thread-3811::DEBUG::2014-09-09 11:43:01,460::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3811::DEBUG::2014-09-09 11:43:01,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3811::DEBUG::2014-09-09 11:43:01,460::task::993::Storage.TaskManager.Task::(_decref) Task=`ef2a4a41-7cfe-459b-960e-5e77cddbbb42`::ref 0 aborting False >Thread-3811::DEBUG::2014-09-09 11:43:01,461::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:01,467::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:01,468::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3812::DEBUG::2014-09-09 11:43:01,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:01,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:01,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896706 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:02,855::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:02,856::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:02,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:02,856::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-3443::DEBUG::2014-09-09 11:43:02,857::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:02,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) (8063) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) (8063) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) (8063) Building response >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) (8063) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:02,862::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:43:02,864::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000877156 s, 405 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) (8064) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) (8064) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8064) Building response >Thread-19::DEBUG::2014-09-09 11:43:02,865::__init__::225::IOProcess::(_processLogs) (8064) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:02,866::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:02,866::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:03,487::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) (8065) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) (8065) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:03,488::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8065) Building response >Thread-19::DEBUG::2014-09-09 11:43:03,489::__init__::225::IOProcess::(_processLogs) (8065) Queuing response >Thread-24::DEBUG::2014-09-09 11:43:03,489::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:03,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:03,494::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:43:03,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000878283 s, 624 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) (8066) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:03,497::__init__::225::IOProcess::(_processLogs) (8066) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:03,498::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8066) Building response >Thread-19::DEBUG::2014-09-09 11:43:03,498::__init__::225::IOProcess::(_processLogs) (8066) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:03,498::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:03,498::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:03,498::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) (8067) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:03,499::__init__::225::IOProcess::(_processLogs) (8067) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) (8067) Building response >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) (8067) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:03,500::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) (8068) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) (8068) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) (8068) Building response >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) (8068) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:03,501::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:43:03,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:03,502::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:03,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:03,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:03,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:03,502::__init__::225::IOProcess::(_processLogs) (8069) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:03,503::__init__::225::IOProcess::(_processLogs) (8069) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:03,503::__init__::225::IOProcess::(_processLogs) (8069) Building response >Thread-19::DEBUG::2014-09-09 11:43:03,503::__init__::225::IOProcess::(_processLogs) (8069) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:03,503::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:03,503::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:43:03,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:03,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895919 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:04,563::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:04,564::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3813::DEBUG::2014-09-09 11:43:04,565::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:05,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:05,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898649 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:07,433::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3814::DEBUG::2014-09-09 11:43:07,435::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:43:07,435::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3814::DEBUG::2014-09-09 11:43:07,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`c47e7d80-43e6-4a37-b22f-3ef003aace38`::moving from state init -> state preparing >Thread-3814::INFO::2014-09-09 11:43:07,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3814::INFO::2014-09-09 11:43:07,439::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3814::DEBUG::2014-09-09 11:43:07,440::task::1191::Storage.TaskManager.Task::(prepare) Task=`c47e7d80-43e6-4a37-b22f-3ef003aace38`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3814::DEBUG::2014-09-09 11:43:07,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`c47e7d80-43e6-4a37-b22f-3ef003aace38`::moving from state preparing -> state finished >Thread-3814::DEBUG::2014-09-09 11:43:07,440::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3814::DEBUG::2014-09-09 11:43:07,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3814::DEBUG::2014-09-09 11:43:07,441::task::993::Storage.TaskManager.Task::(_decref) Task=`c47e7d80-43e6-4a37-b22f-3ef003aace38`::ref 0 aborting False >Thread-3814::DEBUG::2014-09-09 11:43:07,442::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3814::DEBUG::2014-09-09 11:43:07,443::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:07,474::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:07,475::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3815::DEBUG::2014-09-09 11:43:07,475::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3815::DEBUG::2014-09-09 11:43:07,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d38f4f1-347a-4c2c-b55a-b1e3e082817b`::moving from state init -> state preparing >Thread-3815::INFO::2014-09-09 11:43:07,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3815::DEBUG::2014-09-09 11:43:07,476::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a41edcdb-1330-4a8a-8d7f-7aeea3e482b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3815::DEBUG::2014-09-09 11:43:07,476::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3815::DEBUG::2014-09-09 11:43:07,476::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3815::DEBUG::2014-09-09 11:43:07,476::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a41edcdb-1330-4a8a-8d7f-7aeea3e482b2`::Granted request >Thread-3815::DEBUG::2014-09-09 11:43:07,477::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d38f4f1-347a-4c2c-b55a-b1e3e082817b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3815::DEBUG::2014-09-09 11:43:07,477::task::993::Storage.TaskManager.Task::(_decref) Task=`8d38f4f1-347a-4c2c-b55a-b1e3e082817b`::ref 1 aborting False >Thread-3815::INFO::2014-09-09 11:43:07,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3815::DEBUG::2014-09-09 11:43:07,478::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d38f4f1-347a-4c2c-b55a-b1e3e082817b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3815::DEBUG::2014-09-09 11:43:07,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d38f4f1-347a-4c2c-b55a-b1e3e082817b`::moving from state preparing -> state finished >Thread-3815::DEBUG::2014-09-09 11:43:07,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3815::DEBUG::2014-09-09 11:43:07,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3815::DEBUG::2014-09-09 11:43:07,479::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3815::DEBUG::2014-09-09 11:43:07,479::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3815::DEBUG::2014-09-09 11:43:07,479::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3815::DEBUG::2014-09-09 11:43:07,479::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3815::DEBUG::2014-09-09 11:43:07,479::task::993::Storage.TaskManager.Task::(_decref) Task=`8d38f4f1-347a-4c2c-b55a-b1e3e082817b`::ref 0 aborting False >Thread-3815::DEBUG::2014-09-09 11:43:07,479::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3815::DEBUG::2014-09-09 11:43:07,480::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:07,571::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:07,572::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3816::DEBUG::2014-09-09 11:43:07,572::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:07,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:08,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895728 s, 11.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:43:08,357::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:43:08,359::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:08,359::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:43:08,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:08,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,360::__init__::225::IOProcess::(_processLogs) (8070) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:08,360::__init__::225::IOProcess::(_processLogs) (8070) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:08,360::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8070) Building response >Thread-19::DEBUG::2014-09-09 11:43:08,360::__init__::225::IOProcess::(_processLogs) (8070) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) (8071) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:08,361::__init__::225::IOProcess::(_processLogs) (8071) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) (8072) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) (8072) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:08,362::__init__::225::IOProcess::(_processLogs) (8071) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:08,363::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:43:08,363::__init__::225::IOProcess::(_processLogs) (8072) Building response >Thread-19::DEBUG::2014-09-09 11:43:08,363::__init__::225::IOProcess::(_processLogs) (8072) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:08,363::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 11:43:08,365::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:43:08,365::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:43:08,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,365::__init__::225::IOProcess::(_processLogs) (8073) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:43:08,366::__init__::225::IOProcess::(_processLogs) (8073) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:43:08,462::__init__::225::IOProcess::(_processLogs) (8073) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,462::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-23::DEBUG::2014-09-09 11:43:08,463::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:43:08,463::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:43:08,463::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,464::__init__::225::IOProcess::(_processLogs) (8074) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:43:08,464::__init__::225::IOProcess::(_processLogs) (8074) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:43:08,466::__init__::225::IOProcess::(_processLogs) (8074) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:43:08,466::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) (8075) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:08,467::__init__::225::IOProcess::(_processLogs) (8075) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) (8075) Building response >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) (8075) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) (8076) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:08,468::__init__::225::IOProcess::(_processLogs) (8076) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:08,469::__init__::225::IOProcess::(_processLogs) (8076) Queuing response >Thread-23::DEBUG::2014-09-09 11:43:08,470::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:43:08,470::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:43:08,470::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 11:43:08,471::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) (8077) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:08,471::__init__::225::IOProcess::(_processLogs) (8077) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:08,472::__init__::225::IOProcess::(_processLogs) (8077) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,472::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:43:08,472::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:43:08,479::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114402 s, 982 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) (8078) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) (8078) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) DEBUG|(8078) Building response >Thread-19::DEBUG::2014-09-09 11:43:08,480::__init__::225::IOProcess::(_processLogs) (8078) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:08,481::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:08,481::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:43:10,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:10,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897201 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:10,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:10,581::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3820::DEBUG::2014-09-09 11:43:10,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:12,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:12,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897199 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:12,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:12,868::__init__::225::IOProcess::(_processLogs) (8079) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:12,868::__init__::225::IOProcess::(_processLogs) (8079) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:12,868::__init__::225::IOProcess::(_processLogs) DEBUG|(8079) Building response >Thread-19::DEBUG::2014-09-09 11:43:12,868::__init__::225::IOProcess::(_processLogs) (8079) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:12,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:12,868::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:43:12,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:43:12,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000948136 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:12,876::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:12,876::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:12,876::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:12,876::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:12,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) (8080) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) (8080) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) DEBUG|(8080) Building response >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) (8080) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:12,877::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:12,878::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:43:13,502::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:43:13,504::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) (8081) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) (8081) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:13,505::__init__::225::IOProcess::(_processLogs) DEBUG|(8081) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) (8081) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) (8082) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) (8082) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,507::__init__::225::IOProcess::(_processLogs) (8083) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:13,508::__init__::225::IOProcess::(_processLogs) (8083) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:13,508::__init__::225::IOProcess::(_processLogs) DEBUG|(8082) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,508::__init__::225::IOProcess::(_processLogs) (8082) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,510::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:43:13,511::__init__::225::IOProcess::(_processLogs) DEBUG|(8083) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,512::__init__::225::IOProcess::(_processLogs) (8083) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,513::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-24::DEBUG::2014-09-09 11:43:13,514::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:43:13,514::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,514::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:43:13,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,514::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,515::__init__::225::IOProcess::(_processLogs) (8084) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:43:13,515::__init__::225::IOProcess::(_processLogs) (8084) Got request for method 'touch' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:13,589::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:13,589::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3824::DEBUG::2014-09-09 11:43:13,590::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:43:13,613::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8084) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,613::__init__::225::IOProcess::(_processLogs) (8084) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,613::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:43:13,613::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:43:13,613::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,615::__init__::225::IOProcess::(_processLogs) (8085) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:43:13,615::__init__::225::IOProcess::(_processLogs) (8085) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:43:13,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8085) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,618::__init__::225::IOProcess::(_processLogs) (8085) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:43:13,618::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:43:13,619::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) (8086) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) (8086) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:13,620::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8086) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) (8086) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,622::__init__::225::IOProcess::(_processLogs) (8087) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:13,622::__init__::225::IOProcess::(_processLogs) (8087) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:13,623::__init__::225::IOProcess::(_processLogs) (8087) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:43:13,623::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-24::INFO::2014-09-09 11:43:13,623::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-24::INFO::2014-09-09 11:43:13,623::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:43:13,623::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:13,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) (8088) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) (8088) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) (8088) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,624::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:43:13,625::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:43:13,632::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000951754 s, 576 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:13,632::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:13,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) (8089) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) (8089) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) (8089) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,633::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:13,634::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:43:13,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) (8090) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) (8090) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) (8090) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) (8090) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:13,635::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) (8091) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) (8091) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) (8091) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) (8091) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,637::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:13,637::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:13,637::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:43:13,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:13,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) (8092) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) (8092) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) (8092) Building response >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) (8092) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:13,638::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:43:14,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:14,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089662 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:43:16,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:16,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896125 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:16,597::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:16,598::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3825::DEBUG::2014-09-09 11:43:16,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfbadc0c-138c-4bbe-ad06-d7b61a33c61f`::moving from state init -> state preparing >Thread-3825::INFO::2014-09-09 11:43:16,600::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3825::INFO::2014-09-09 11:43:16,600::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114402', 'lastCheck': '8.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000951754', 'lastCheck': '3.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948136', 'lastCheck': '3.7', 'valid': True}} >Thread-3825::DEBUG::2014-09-09 11:43:16,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfbadc0c-138c-4bbe-ad06-d7b61a33c61f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114402', 'lastCheck': '8.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000951754', 'lastCheck': '3.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948136', 'lastCheck': '3.7', 'valid': True}} >Thread-3825::DEBUG::2014-09-09 11:43:16,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfbadc0c-138c-4bbe-ad06-d7b61a33c61f`::moving from state preparing -> state finished >Thread-3825::DEBUG::2014-09-09 11:43:16,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3825::DEBUG::2014-09-09 11:43:16,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3825::DEBUG::2014-09-09 11:43:16,602::task::993::Storage.TaskManager.Task::(_decref) Task=`bfbadc0c-138c-4bbe-ad06-d7b61a33c61f`::ref 0 aborting False >Thread-3825::DEBUG::2014-09-09 11:43:16,605::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:16,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:16,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3826::DEBUG::2014-09-09 11:43:16,613::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:17,709::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:17,710::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3827::DEBUG::2014-09-09 11:43:17,710::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3827::DEBUG::2014-09-09 11:43:17,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`e916d342-d2ff-46f8-ba1b-9363d7f91c21`::moving from state init -> state preparing >Thread-3827::INFO::2014-09-09 11:43:17,711::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3827::INFO::2014-09-09 11:43:17,712::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3827::DEBUG::2014-09-09 11:43:17,712::task::1191::Storage.TaskManager.Task::(prepare) Task=`e916d342-d2ff-46f8-ba1b-9363d7f91c21`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3827::DEBUG::2014-09-09 11:43:17,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`e916d342-d2ff-46f8-ba1b-9363d7f91c21`::moving from state preparing -> state finished >Thread-3827::DEBUG::2014-09-09 11:43:17,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3827::DEBUG::2014-09-09 11:43:17,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3827::DEBUG::2014-09-09 11:43:17,712::task::993::Storage.TaskManager.Task::(_decref) Task=`e916d342-d2ff-46f8-ba1b-9363d7f91c21`::ref 0 aborting False >Thread-3827::DEBUG::2014-09-09 11:43:17,712::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3827::DEBUG::2014-09-09 11:43:17,712::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:17,742::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:17,742::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3828::DEBUG::2014-09-09 11:43:17,742::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3828::DEBUG::2014-09-09 11:43:17,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7bff569-98eb-42f1-b8ad-a46f12511953`::moving from state init -> state preparing >Thread-3828::INFO::2014-09-09 11:43:17,743::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3828::DEBUG::2014-09-09 11:43:17,743::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1e9eea1b-f319-4827-8546-fdfe93746cb3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3828::DEBUG::2014-09-09 11:43:17,743::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3828::DEBUG::2014-09-09 11:43:17,744::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3828::DEBUG::2014-09-09 11:43:17,744::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1e9eea1b-f319-4827-8546-fdfe93746cb3`::Granted request >Thread-3828::DEBUG::2014-09-09 11:43:17,744::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7bff569-98eb-42f1-b8ad-a46f12511953`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3828::DEBUG::2014-09-09 11:43:17,744::task::993::Storage.TaskManager.Task::(_decref) Task=`a7bff569-98eb-42f1-b8ad-a46f12511953`::ref 1 aborting False >Thread-3828::INFO::2014-09-09 11:43:17,746::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3828::DEBUG::2014-09-09 11:43:17,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7bff569-98eb-42f1-b8ad-a46f12511953`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3828::DEBUG::2014-09-09 11:43:17,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7bff569-98eb-42f1-b8ad-a46f12511953`::moving from state preparing -> state finished >Thread-3828::DEBUG::2014-09-09 11:43:17,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3828::DEBUG::2014-09-09 11:43:17,746::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3828::DEBUG::2014-09-09 11:43:17,746::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3828::DEBUG::2014-09-09 11:43:17,746::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3828::DEBUG::2014-09-09 11:43:17,746::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3828::DEBUG::2014-09-09 11:43:17,746::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3828::DEBUG::2014-09-09 11:43:17,747::task::993::Storage.TaskManager.Task::(_decref) Task=`a7bff569-98eb-42f1-b8ad-a46f12511953`::ref 0 aborting False >Thread-3828::DEBUG::2014-09-09 11:43:17,747::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283922923520', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3828::DEBUG::2014-09-09 11:43:17,747::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:18,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:18,482::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:18,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:18,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:18,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:18,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:18,482::__init__::225::IOProcess::(_processLogs) (8093) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:18,483::__init__::225::IOProcess::(_processLogs) (8093) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:18,559::__init__::225::IOProcess::(_processLogs) (8093) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:18,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:18,560::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:43:18,561::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:18,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0966595 s, 10.6 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:43:18,568::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104593 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:18,569::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:18,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:18,570::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:18,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:18,571::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:18,571::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:18,572::__init__::225::IOProcess::(_processLogs) (8094) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:18,572::__init__::225::IOProcess::(_processLogs) (8094) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:18,573::__init__::225::IOProcess::(_processLogs) (8094) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:18,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:18,574::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:19,705::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:19,706::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3829::DEBUG::2014-09-09 11:43:19,710::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:20,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:20,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896398 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:43:22,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:22,726::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:22,727::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3830::DEBUG::2014-09-09 11:43:22,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:22,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895984 s, 11.4 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:43:22,878::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:43:22,880::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:43:22,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:22,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,881::__init__::225::IOProcess::(_processLogs) (8095) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:22,881::__init__::225::IOProcess::(_processLogs) (8095) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:22,881::__init__::225::IOProcess::(_processLogs) (8095) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:22,883::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:43:22,884::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:43:22,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:22,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-3443::DEBUG::2014-09-09 11:43:22,887::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:43:22,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,888::__init__::225::IOProcess::(_processLogs) (8096) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:22,888::__init__::225::IOProcess::(_processLogs) (8096) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:22,888::__init__::225::IOProcess::(_processLogs) (8096) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) (8097) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:22,889::__init__::225::IOProcess::(_processLogs) (8097) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) (8097) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,891::__init__::225::IOProcess::(_processLogs) (8098) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:43:22,891::__init__::225::IOProcess::(_processLogs) (8098) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:43:22,942::__init__::225::IOProcess::(_processLogs) (8098) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,942::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3443::DEBUG::2014-09-09 11:43:22,942::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) (8099) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:43:22,943::__init__::225::IOProcess::(_processLogs) (8099) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:43:22,945::__init__::225::IOProcess::(_processLogs) (8099) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,945::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-3443::DEBUG::2014-09-09 11:43:22,945::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:43:22,946::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:43:22,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) (8100) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) (8100) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) (8100) Building response >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) (8100) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,948::__init__::225::IOProcess::(_processLogs) (8101) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:43:22,948::__init__::225::IOProcess::(_processLogs) (8101) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:43:22,949::__init__::225::IOProcess::(_processLogs) (8101) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,949::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::DEBUG::2014-09-09 11:43:22,949::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-3443::INFO::2014-09-09 11:43:22,950::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 11:43:22,950::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) (8102) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:22,950::__init__::225::IOProcess::(_processLogs) (8102) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:22,951::__init__::225::IOProcess::(_processLogs) (8102) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,951::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:43:22,951::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:43:22,957::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000845412 s, 420 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:22,958::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:22,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:22,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:22,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:22,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:22,958::__init__::225::IOProcess::(_processLogs) (8103) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:22,959::__init__::225::IOProcess::(_processLogs) (8103) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:22,959::__init__::225::IOProcess::(_processLogs) (8103) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:22,959::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:23,638::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:23,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:23,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:23,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:23,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:23,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:23,639::__init__::225::IOProcess::(_processLogs) (8104) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:23,639::__init__::225::IOProcess::(_processLogs) (8104) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:23,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8104) Building response >Thread-19::DEBUG::2014-09-09 11:43:23,640::__init__::225::IOProcess::(_processLogs) (8104) Queuing response >Thread-24::DEBUG::2014-09-09 11:43:23,640::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:23,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:23,645::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:43:23,647::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00089249 s, 614 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) (8105) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:23,648::__init__::225::IOProcess::(_processLogs) (8105) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:23,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8105) Building response >Thread-19::DEBUG::2014-09-09 11:43:23,649::__init__::225::IOProcess::(_processLogs) (8105) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:23,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:23,649::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:23,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:23,649::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) (8106) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:23,650::__init__::225::IOProcess::(_processLogs) (8106) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) (8106) Building response >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) (8106) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:23,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) (8107) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) (8107) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) (8107) Building response >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) (8107) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:23,652::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:43:23,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:23,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:23,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:23,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:23,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:23,653::__init__::225::IOProcess::(_processLogs) (8108) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:23,654::__init__::225::IOProcess::(_processLogs) (8108) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:23,654::__init__::225::IOProcess::(_processLogs) (8108) Building response >Thread-19::DEBUG::2014-09-09 11:43:23,654::__init__::225::IOProcess::(_processLogs) (8108) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:23,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:23,654::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:43:24,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:24,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897974 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:25,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:25,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3834::DEBUG::2014-09-09 11:43:25,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:26,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:26,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08977 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:27,786::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3835::DEBUG::2014-09-09 11:43:27,786::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:43:27,787::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3835::DEBUG::2014-09-09 11:43:27,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`b079785f-dc9c-4d7f-993a-cbf086dd62f5`::moving from state init -> state preparing >Thread-3835::INFO::2014-09-09 11:43:27,788::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3835::INFO::2014-09-09 11:43:27,788::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3835::DEBUG::2014-09-09 11:43:27,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`b079785f-dc9c-4d7f-993a-cbf086dd62f5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3835::DEBUG::2014-09-09 11:43:27,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`b079785f-dc9c-4d7f-993a-cbf086dd62f5`::moving from state preparing -> state finished >Thread-3835::DEBUG::2014-09-09 11:43:27,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3835::DEBUG::2014-09-09 11:43:27,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3835::DEBUG::2014-09-09 11:43:27,789::task::993::Storage.TaskManager.Task::(_decref) Task=`b079785f-dc9c-4d7f-993a-cbf086dd62f5`::ref 0 aborting False >Thread-3835::DEBUG::2014-09-09 11:43:27,789::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3835::DEBUG::2014-09-09 11:43:27,789::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:27,868::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3836::DEBUG::2014-09-09 11:43:27,868::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:43:27,868::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3836::DEBUG::2014-09-09 11:43:27,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`90300681-7c3a-48d3-90b7-e07c208c3897`::moving from state init -> state preparing >Thread-3836::INFO::2014-09-09 11:43:27,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3836::DEBUG::2014-09-09 11:43:27,869::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3e9d955c-cdb7-466e-b999-b3f2b754df73`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3836::DEBUG::2014-09-09 11:43:27,870::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3836::DEBUG::2014-09-09 11:43:27,870::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3836::DEBUG::2014-09-09 11:43:27,870::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3e9d955c-cdb7-466e-b999-b3f2b754df73`::Granted request >Thread-3836::DEBUG::2014-09-09 11:43:27,870::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`90300681-7c3a-48d3-90b7-e07c208c3897`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3836::DEBUG::2014-09-09 11:43:27,870::task::993::Storage.TaskManager.Task::(_decref) Task=`90300681-7c3a-48d3-90b7-e07c208c3897`::ref 1 aborting False >Thread-3836::INFO::2014-09-09 11:43:27,872::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3836::DEBUG::2014-09-09 11:43:27,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`90300681-7c3a-48d3-90b7-e07c208c3897`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3836::DEBUG::2014-09-09 11:43:27,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`90300681-7c3a-48d3-90b7-e07c208c3897`::moving from state preparing -> state finished >Thread-3836::DEBUG::2014-09-09 11:43:27,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3836::DEBUG::2014-09-09 11:43:27,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3836::DEBUG::2014-09-09 11:43:27,872::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3836::DEBUG::2014-09-09 11:43:27,872::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3836::DEBUG::2014-09-09 11:43:27,872::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3836::DEBUG::2014-09-09 11:43:27,872::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3836::DEBUG::2014-09-09 11:43:27,873::task::993::Storage.TaskManager.Task::(_decref) Task=`90300681-7c3a-48d3-90b7-e07c208c3897`::ref 0 aborting False >Thread-3836::DEBUG::2014-09-09 11:43:27,873::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3836::DEBUG::2014-09-09 11:43:27,873::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:43:28,574::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:28,574::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:28,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:28,574::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:28,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:28,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:28,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:28,575::__init__::225::IOProcess::(_processLogs) (8109) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:28,575::__init__::225::IOProcess::(_processLogs) (8109) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:28,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8109) Building response >Thread-19::DEBUG::2014-09-09 11:43:28,576::__init__::225::IOProcess::(_processLogs) (8109) Queuing response >Thread-23::DEBUG::2014-09-09 11:43:28,576::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:28,576::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:28,581::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:43:28,583::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107638 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:28,583::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:28,583::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:28,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:28,583::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) (8110) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) (8110) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8110) Building response >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) (8110) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:28,584::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:28,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:28,745::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3837::DEBUG::2014-09-09 11:43:28,746::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:28,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:29,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896109 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:43:31,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:31,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897078 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:31,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:31,752::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3838::DEBUG::2014-09-09 11:43:31,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf6fa6e5-83d6-4f0b-9828-ef4c76c991f0`::moving from state init -> state preparing >Thread-3838::INFO::2014-09-09 11:43:31,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3838::INFO::2014-09-09 11:43:31,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107638', 'lastCheck': '3.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089249', 'lastCheck': '8.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000845412', 'lastCheck': '8.8', 'valid': True}} >Thread-3838::DEBUG::2014-09-09 11:43:31,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf6fa6e5-83d6-4f0b-9828-ef4c76c991f0`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107638', 'lastCheck': '3.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089249', 'lastCheck': '8.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000845412', 'lastCheck': '8.8', 'valid': True}} >Thread-3838::DEBUG::2014-09-09 11:43:31,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf6fa6e5-83d6-4f0b-9828-ef4c76c991f0`::moving from state preparing -> state finished >Thread-3838::DEBUG::2014-09-09 11:43:31,754::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3838::DEBUG::2014-09-09 11:43:31,754::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3838::DEBUG::2014-09-09 11:43:31,754::task::993::Storage.TaskManager.Task::(_decref) Task=`cf6fa6e5-83d6-4f0b-9828-ef4c76c991f0`::ref 0 aborting False >Thread-3838::DEBUG::2014-09-09 11:43:31,755::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:31,762::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:31,763::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3839::DEBUG::2014-09-09 11:43:31,764::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:43:32,960::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:32,960::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:32,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:32,960::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:32,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:32,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:32,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:32,961::__init__::225::IOProcess::(_processLogs) (8111) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:32,961::__init__::225::IOProcess::(_processLogs) (8111) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:32,962::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8111) Building response >Thread-19::DEBUG::2014-09-09 11:43:32,962::__init__::225::IOProcess::(_processLogs) (8111) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:32,963::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:32,963::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:43:32,963::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:43:32,970::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000907714 s, 391 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:32,971::__init__::225::IOProcess::(_processLogs) (8112) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:32,972::__init__::225::IOProcess::(_processLogs) (8112) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:32,972::__init__::225::IOProcess::(_processLogs) DEBUG|(8112) Building response >Thread-19::DEBUG::2014-09-09 11:43:32,972::__init__::225::IOProcess::(_processLogs) (8112) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:32,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:32,972::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:43:33,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:33,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896731 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) (8113) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:33,654::__init__::225::IOProcess::(_processLogs) (8113) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:33,655::__init__::225::IOProcess::(_processLogs) DEBUG|(8113) Building response >Thread-19::DEBUG::2014-09-09 11:43:33,655::__init__::225::IOProcess::(_processLogs) (8113) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:33,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:33,655::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:43:33,655::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:43:33,662::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00099615 s, 550 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) (8114) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) (8114) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) DEBUG|(8114) Building response >Thread-19::DEBUG::2014-09-09 11:43:33,663::__init__::225::IOProcess::(_processLogs) (8114) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:33,664::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:33,664::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:33,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) (8115) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:33,665::__init__::225::IOProcess::(_processLogs) (8115) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) (8115) Building response >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) (8115) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:33,666::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) (8116) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) (8116) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) (8116) Building response >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) (8116) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:33,667::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:33,668::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:43:33,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:33,668::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:33,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:33,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) (8117) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) (8117) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) (8117) Building response >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) (8117) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:33,669::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:34,857::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:34,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3840::DEBUG::2014-09-09 11:43:34,859::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:35,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:35,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898358 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:43:37,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:37,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900092 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:37,866::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:37,867::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3841::DEBUG::2014-09-09 11:43:37,868::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:37,971::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:37,972::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3842::DEBUG::2014-09-09 11:43:37,972::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3842::DEBUG::2014-09-09 11:43:37,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`74c8fde4-e70f-4087-8005-5113f96a5e6d`::moving from state init -> state preparing >Thread-3842::INFO::2014-09-09 11:43:37,973::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3842::INFO::2014-09-09 11:43:37,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3842::DEBUG::2014-09-09 11:43:37,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`74c8fde4-e70f-4087-8005-5113f96a5e6d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3842::DEBUG::2014-09-09 11:43:37,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`74c8fde4-e70f-4087-8005-5113f96a5e6d`::moving from state preparing -> state finished >Thread-3842::DEBUG::2014-09-09 11:43:37,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3842::DEBUG::2014-09-09 11:43:37,974::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3842::DEBUG::2014-09-09 11:43:37,974::task::993::Storage.TaskManager.Task::(_decref) Task=`74c8fde4-e70f-4087-8005-5113f96a5e6d`::ref 0 aborting False >Thread-3842::DEBUG::2014-09-09 11:43:37,974::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3842::DEBUG::2014-09-09 11:43:37,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:38,178::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:38,179::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3843::DEBUG::2014-09-09 11:43:38,179::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3843::DEBUG::2014-09-09 11:43:38,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`feadd291-b771-4d90-9b6a-0830a71b0bd5`::moving from state init -> state preparing >Thread-3843::INFO::2014-09-09 11:43:38,180::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3843::DEBUG::2014-09-09 11:43:38,180::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`17fd91e7-89ef-40ba-8f67-7fb76e293aa3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3843::DEBUG::2014-09-09 11:43:38,180::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3843::DEBUG::2014-09-09 11:43:38,181::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3843::DEBUG::2014-09-09 11:43:38,181::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`17fd91e7-89ef-40ba-8f67-7fb76e293aa3`::Granted request >Thread-3843::DEBUG::2014-09-09 11:43:38,181::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`feadd291-b771-4d90-9b6a-0830a71b0bd5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3843::DEBUG::2014-09-09 11:43:38,181::task::993::Storage.TaskManager.Task::(_decref) Task=`feadd291-b771-4d90-9b6a-0830a71b0bd5`::ref 1 aborting False >Thread-3843::INFO::2014-09-09 11:43:38,183::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3843::DEBUG::2014-09-09 11:43:38,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`feadd291-b771-4d90-9b6a-0830a71b0bd5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3843::DEBUG::2014-09-09 11:43:38,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`feadd291-b771-4d90-9b6a-0830a71b0bd5`::moving from state preparing -> state finished >Thread-3843::DEBUG::2014-09-09 11:43:38,183::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3843::DEBUG::2014-09-09 11:43:38,183::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3843::DEBUG::2014-09-09 11:43:38,183::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3843::DEBUG::2014-09-09 11:43:38,183::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3843::DEBUG::2014-09-09 11:43:38,183::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3843::DEBUG::2014-09-09 11:43:38,183::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3843::DEBUG::2014-09-09 11:43:38,184::task::993::Storage.TaskManager.Task::(_decref) Task=`feadd291-b771-4d90-9b6a-0830a71b0bd5`::ref 0 aborting False >Thread-3843::DEBUG::2014-09-09 11:43:38,184::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3843::DEBUG::2014-09-09 11:43:38,184::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:43:38,585::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) (8118) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:38,586::__init__::225::IOProcess::(_processLogs) (8118) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:38,587::__init__::225::IOProcess::(_processLogs) DEBUG|(8118) Building response >Thread-19::DEBUG::2014-09-09 11:43:38,587::__init__::225::IOProcess::(_processLogs) (8118) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:38,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:38,587::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:43:38,588::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:43:38,595::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104293 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) (8119) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) (8119) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) DEBUG|(8119) Building response >Thread-19::DEBUG::2014-09-09 11:43:38,596::__init__::225::IOProcess::(_processLogs) (8119) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:38,597::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:38,597::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:43:39,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:39,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089633 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:40,876::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:40,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3844::DEBUG::2014-09-09 11:43:40,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:41,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:41,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896529 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:42,973::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:42,973::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) (8120) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) (8120) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:42,974::__init__::225::IOProcess::(_processLogs) DEBUG|(8120) Building response >Thread-3443::DEBUG::2014-09-09 11:43:42,975::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:42,975::__init__::225::IOProcess::(_processLogs) (8120) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:42,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:42,980::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:43:42,981::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000931824 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) (8121) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:42,982::__init__::225::IOProcess::(_processLogs) (8121) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:42,983::__init__::225::IOProcess::(_processLogs) DEBUG|(8121) Building response >Thread-19::DEBUG::2014-09-09 11:43:42,983::__init__::225::IOProcess::(_processLogs) (8121) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:42,983::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:42,984::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:43,669::__init__::225::IOProcess::(_processLogs) (8122) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:43,670::__init__::225::IOProcess::(_processLogs) (8122) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:43,670::__init__::225::IOProcess::(_processLogs) DEBUG|(8122) Building response >Thread-19::DEBUG::2014-09-09 11:43:43,670::__init__::225::IOProcess::(_processLogs) (8122) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:43,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:43,671::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:43:43,671::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:43:43,678::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000940905 s, 582 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:43,679::__init__::225::IOProcess::(_processLogs) (8123) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:43,680::__init__::225::IOProcess::(_processLogs) (8123) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:43,680::__init__::225::IOProcess::(_processLogs) DEBUG|(8123) Building response >Thread-19::DEBUG::2014-09-09 11:43:43,680::__init__::225::IOProcess::(_processLogs) (8123) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:43,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:43,680::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:43,681::__init__::225::IOProcess::(_processLogs) (8124) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) (8124) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) DEBUG|(8124) Building response >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) (8124) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:43,682::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) (8125) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) (8125) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) DEBUG|(8125) Building response >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) (8125) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:43,683::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:43,684::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:43,684::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:43,684::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:43:43,684::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) (8126) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) (8126) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) (8126) Building response >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) (8126) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:43,685::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:43:43,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:43,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089656 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:43,886::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:43,887::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3845::DEBUG::2014-09-09 11:43:43,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:45,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:45,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898289 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:46,962::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:46,963::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3846::DEBUG::2014-09-09 11:43:46,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbfa61ae-57b5-497c-a1d2-1cc73274bf7b`::moving from state init -> state preparing >Thread-3846::INFO::2014-09-09 11:43:46,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3846::INFO::2014-09-09 11:43:46,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104293', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000940905', 'lastCheck': '3.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000931824', 'lastCheck': '4.0', 'valid': True}} >Thread-3846::DEBUG::2014-09-09 11:43:46,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbfa61ae-57b5-497c-a1d2-1cc73274bf7b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104293', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000940905', 'lastCheck': '3.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000931824', 'lastCheck': '4.0', 'valid': True}} >Thread-3846::DEBUG::2014-09-09 11:43:46,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbfa61ae-57b5-497c-a1d2-1cc73274bf7b`::moving from state preparing -> state finished >Thread-3846::DEBUG::2014-09-09 11:43:46,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3846::DEBUG::2014-09-09 11:43:46,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3846::DEBUG::2014-09-09 11:43:46,965::task::993::Storage.TaskManager.Task::(_decref) Task=`dbfa61ae-57b5-497c-a1d2-1cc73274bf7b`::ref 0 aborting False >Thread-3846::DEBUG::2014-09-09 11:43:46,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:46,975::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:46,976::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3847::DEBUG::2014-09-09 11:43:46,977::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:47,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:48,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896851 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:48,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3848::DEBUG::2014-09-09 11:43:48,581::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:43:48,581::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3848::DEBUG::2014-09-09 11:43:48,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b272a08-e872-4dd0-93dc-d741e82de112`::moving from state init -> state preparing >Thread-3848::INFO::2014-09-09 11:43:48,582::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3848::INFO::2014-09-09 11:43:48,583::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3848::DEBUG::2014-09-09 11:43:48,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b272a08-e872-4dd0-93dc-d741e82de112`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3848::DEBUG::2014-09-09 11:43:48,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b272a08-e872-4dd0-93dc-d741e82de112`::moving from state preparing -> state finished >Thread-3848::DEBUG::2014-09-09 11:43:48,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3848::DEBUG::2014-09-09 11:43:48,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3848::DEBUG::2014-09-09 11:43:48,583::task::993::Storage.TaskManager.Task::(_decref) Task=`1b272a08-e872-4dd0-93dc-d741e82de112`::ref 0 aborting False >Thread-3848::DEBUG::2014-09-09 11:43:48,583::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3848::DEBUG::2014-09-09 11:43:48,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) (8127) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:48,598::__init__::225::IOProcess::(_processLogs) (8127) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:48,599::__init__::225::IOProcess::(_processLogs) DEBUG|(8127) Building response >Thread-19::DEBUG::2014-09-09 11:43:48,599::__init__::225::IOProcess::(_processLogs) (8127) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:48,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:48,599::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:43:48,599::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:43:48,606::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109539 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:48,606::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) (8128) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) (8128) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) DEBUG|(8128) Building response >Thread-19::DEBUG::2014-09-09 11:43:48,607::__init__::225::IOProcess::(_processLogs) (8128) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:48,608::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:48,608::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:48,670::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:48,670::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3849::DEBUG::2014-09-09 11:43:48,670::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3849::DEBUG::2014-09-09 11:43:48,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`44b04f51-0b0d-40be-a082-b8c228c8d822`::moving from state init -> state preparing >Thread-3849::INFO::2014-09-09 11:43:48,671::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3849::DEBUG::2014-09-09 11:43:48,672::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0d4482cd-0781-4e8e-854d-4343342831c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3849::DEBUG::2014-09-09 11:43:48,672::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3849::DEBUG::2014-09-09 11:43:48,672::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3849::DEBUG::2014-09-09 11:43:48,672::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0d4482cd-0781-4e8e-854d-4343342831c8`::Granted request >Thread-3849::DEBUG::2014-09-09 11:43:48,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44b04f51-0b0d-40be-a082-b8c228c8d822`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3849::DEBUG::2014-09-09 11:43:48,674::task::993::Storage.TaskManager.Task::(_decref) Task=`44b04f51-0b0d-40be-a082-b8c228c8d822`::ref 1 aborting False >Thread-3849::INFO::2014-09-09 11:43:48,675::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3849::DEBUG::2014-09-09 11:43:48,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`44b04f51-0b0d-40be-a082-b8c228c8d822`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3849::DEBUG::2014-09-09 11:43:48,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`44b04f51-0b0d-40be-a082-b8c228c8d822`::moving from state preparing -> state finished >Thread-3849::DEBUG::2014-09-09 11:43:48,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3849::DEBUG::2014-09-09 11:43:48,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3849::DEBUG::2014-09-09 11:43:48,676::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3849::DEBUG::2014-09-09 11:43:48,676::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3849::DEBUG::2014-09-09 11:43:48,676::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3849::DEBUG::2014-09-09 11:43:48,676::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3849::DEBUG::2014-09-09 11:43:48,676::task::993::Storage.TaskManager.Task::(_decref) Task=`44b04f51-0b0d-40be-a082-b8c228c8d822`::ref 0 aborting False >Thread-3849::DEBUG::2014-09-09 11:43:48,676::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283921874944', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3849::DEBUG::2014-09-09 11:43:48,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:50,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:50,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0951144 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:50,344::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:50,344::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3850::DEBUG::2014-09-09 11:43:50,345::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:52,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:52,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089664 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:52,984::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:52,984::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:52,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:52,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:52,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:52,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:52,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:52,985::__init__::225::IOProcess::(_processLogs) (8129) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:52,985::__init__::225::IOProcess::(_processLogs) (8129) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:52,985::__init__::225::IOProcess::(_processLogs) DEBUG|(8129) Building response >Thread-19::DEBUG::2014-09-09 11:43:52,986::__init__::225::IOProcess::(_processLogs) (8129) Queuing response >Thread-3443::DEBUG::2014-09-09 11:43:52,986::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:52,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:52,991::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:43:52,992::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000907903 s, 391 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:52,993::__init__::225::IOProcess::(_processLogs) (8130) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:52,994::__init__::225::IOProcess::(_processLogs) (8130) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:52,994::__init__::225::IOProcess::(_processLogs) DEBUG|(8130) Building response >Thread-19::DEBUG::2014-09-09 11:43:52,994::__init__::225::IOProcess::(_processLogs) (8130) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:52,994::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:43:52,995::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:53,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:53,354::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3851::DEBUG::2014-09-09 11:43:53,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:43:53,685::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:53,685::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:53,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:53,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:53,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:53,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:53,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:53,686::__init__::225::IOProcess::(_processLogs) (8131) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:53,686::__init__::225::IOProcess::(_processLogs) (8131) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:53,686::__init__::225::IOProcess::(_processLogs) (8131) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:53,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:43:53,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:43:53,693::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00096886 s, 566 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:53,694::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:43:53,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:53,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:53,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:53,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:53,695::__init__::225::IOProcess::(_processLogs) (8132) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:53,695::__init__::225::IOProcess::(_processLogs) (8132) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:53,695::__init__::225::IOProcess::(_processLogs) (8132) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:53,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:53,695::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:43:53,695::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) (8133) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) (8133) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:53,696::__init__::225::IOProcess::(_processLogs) (8133) Building response >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) (8133) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:53,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) (8134) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) (8134) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) (8134) Building response >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) (8134) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:53,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:53,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:53,699::__init__::225::IOProcess::(_processLogs) (8135) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:43:53,699::__init__::225::IOProcess::(_processLogs) (8135) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:43:53,699::__init__::225::IOProcess::(_processLogs) (8135) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:53,699::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:43:54,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:54,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896914 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:56,363::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:56,364::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3852::DEBUG::2014-09-09 11:43:56,365::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:43:56,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:56,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903533 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:43:58,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:43:58,609::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:58,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:58,609::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:58,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:58,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:58,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:58,610::__init__::225::IOProcess::(_processLogs) (8136) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:58,610::__init__::225::IOProcess::(_processLogs) (8136) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:58,676::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8136) Building response >Thread-19::DEBUG::2014-09-09 11:43:58,677::__init__::225::IOProcess::(_processLogs) (8136) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:58,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:58,679::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:43:58,680::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:43:58,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.098071 s, 10.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:43:58,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108207 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:43:58,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:43:58,689::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:43:58,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:43:58,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:43:58,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:43:58,691::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:43:58,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:43:58,693::__init__::225::IOProcess::(_processLogs) (8137) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:43:58,693::__init__::225::IOProcess::(_processLogs) (8137) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:43:58,694::__init__::225::IOProcess::(_processLogs) (8137) Building response >Thread-19::DEBUG::2014-09-09 11:43:58,694::__init__::225::IOProcess::(_processLogs) (8137) Queuing response >Thread-19::DEBUG::2014-09-09 11:43:58,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:43:58,695::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:58,829::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3853::DEBUG::2014-09-09 11:43:58,830::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:43:58,830::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3853::DEBUG::2014-09-09 11:43:58,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`13216913-7a22-4671-827f-9a70ba784ac1`::moving from state init -> state preparing >Thread-3853::INFO::2014-09-09 11:43:58,832::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3853::INFO::2014-09-09 11:43:58,832::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3853::DEBUG::2014-09-09 11:43:58,832::task::1191::Storage.TaskManager.Task::(prepare) Task=`13216913-7a22-4671-827f-9a70ba784ac1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3853::DEBUG::2014-09-09 11:43:58,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`13216913-7a22-4671-827f-9a70ba784ac1`::moving from state preparing -> state finished >Thread-3853::DEBUG::2014-09-09 11:43:58,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3853::DEBUG::2014-09-09 11:43:58,832::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3853::DEBUG::2014-09-09 11:43:58,832::task::993::Storage.TaskManager.Task::(_decref) Task=`13216913-7a22-4671-827f-9a70ba784ac1`::ref 0 aborting False >Thread-3853::DEBUG::2014-09-09 11:43:58,832::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3853::DEBUG::2014-09-09 11:43:58,832::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:58,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:58,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3854::DEBUG::2014-09-09 11:43:58,946::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3854::DEBUG::2014-09-09 11:43:58,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d0377f2-2064-44cb-a3d0-b7a46ad82aff`::moving from state init -> state preparing >Thread-3854::INFO::2014-09-09 11:43:58,947::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3854::DEBUG::2014-09-09 11:43:58,948::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8156d853-f61a-41e3-97ab-ac49273678d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3854::DEBUG::2014-09-09 11:43:58,948::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3854::DEBUG::2014-09-09 11:43:58,948::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3854::DEBUG::2014-09-09 11:43:58,948::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8156d853-f61a-41e3-97ab-ac49273678d1`::Granted request >Thread-3854::DEBUG::2014-09-09 11:43:58,948::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d0377f2-2064-44cb-a3d0-b7a46ad82aff`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3854::DEBUG::2014-09-09 11:43:58,948::task::993::Storage.TaskManager.Task::(_decref) Task=`8d0377f2-2064-44cb-a3d0-b7a46ad82aff`::ref 1 aborting False >Thread-3854::INFO::2014-09-09 11:43:58,950::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3854::DEBUG::2014-09-09 11:43:58,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d0377f2-2064-44cb-a3d0-b7a46ad82aff`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3854::DEBUG::2014-09-09 11:43:58,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d0377f2-2064-44cb-a3d0-b7a46ad82aff`::moving from state preparing -> state finished >Thread-3854::DEBUG::2014-09-09 11:43:58,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3854::DEBUG::2014-09-09 11:43:58,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3854::DEBUG::2014-09-09 11:43:58,950::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3854::DEBUG::2014-09-09 11:43:58,950::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3854::DEBUG::2014-09-09 11:43:58,950::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3854::DEBUG::2014-09-09 11:43:58,951::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3854::DEBUG::2014-09-09 11:43:58,951::task::993::Storage.TaskManager.Task::(_decref) Task=`8d0377f2-2064-44cb-a3d0-b7a46ad82aff`::ref 0 aborting False >Thread-3854::DEBUG::2014-09-09 11:43:58,951::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3854::DEBUG::2014-09-09 11:43:58,951::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:43:59,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:43:59,370::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3855::DEBUG::2014-09-09 11:43:59,371::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:00,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:00,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899797 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:02,377::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:02,378::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3856::DEBUG::2014-09-09 11:44:02,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2426714-314a-42cb-817b-5abf43b044c4`::moving from state init -> state preparing >Thread-3856::INFO::2014-09-09 11:44:02,379::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3856::INFO::2014-09-09 11:44:02,379::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108207', 'lastCheck': '3.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096886', 'lastCheck': '8.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000907903', 'lastCheck': '9.4', 'valid': True}} >Thread-3856::DEBUG::2014-09-09 11:44:02,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2426714-314a-42cb-817b-5abf43b044c4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108207', 'lastCheck': '3.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096886', 'lastCheck': '8.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000907903', 'lastCheck': '9.4', 'valid': True}} >Thread-3856::DEBUG::2014-09-09 11:44:02,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2426714-314a-42cb-817b-5abf43b044c4`::moving from state preparing -> state finished >Thread-3856::DEBUG::2014-09-09 11:44:02,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3856::DEBUG::2014-09-09 11:44:02,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3856::DEBUG::2014-09-09 11:44:02,380::task::993::Storage.TaskManager.Task::(_decref) Task=`d2426714-314a-42cb-817b-5abf43b044c4`::ref 0 aborting False >Thread-3856::DEBUG::2014-09-09 11:44:02,381::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:02,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:02,387::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3857::DEBUG::2014-09-09 11:44:02,388::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:02,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:02,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896872 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:02,995::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:02,995::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:02,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:02,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) (8138) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) (8138) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8138) Building response >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) (8138) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:02,996::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:44:02,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:44:03,004::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000899831 s, 395 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:03,004::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) (8139) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) (8139) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:03,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8139) Building response >Thread-19::DEBUG::2014-09-09 11:44:03,006::__init__::225::IOProcess::(_processLogs) (8139) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:03,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:03,006::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:03,700::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:03,700::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) (8140) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) (8140) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:03,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8140) Building response >Thread-24::DEBUG::2014-09-09 11:44:03,702::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:03,702::__init__::225::IOProcess::(_processLogs) (8140) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:03,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:03,707::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:44:03,709::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000945734 s, 579 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) (8141) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:03,710::__init__::225::IOProcess::(_processLogs) (8141) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:03,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8141) Building response >Thread-19::DEBUG::2014-09-09 11:44:03,711::__init__::225::IOProcess::(_processLogs) (8141) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:03,711::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:03,711::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:03,712::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:03,712::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:44:03,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:03,712::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:03,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:03,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:03,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:03,713::__init__::225::IOProcess::(_processLogs) (8142) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:03,713::__init__::225::IOProcess::(_processLogs) (8142) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) (8142) Building response >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) (8142) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:03,714::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) (8143) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) (8143) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) (8143) Building response >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) (8143) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:03,715::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:03,716::__init__::225::IOProcess::(_processLogs) (8144) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:03,717::__init__::225::IOProcess::(_processLogs) (8144) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:03,717::__init__::225::IOProcess::(_processLogs) (8144) Building response >Thread-19::DEBUG::2014-09-09 11:44:03,717::__init__::225::IOProcess::(_processLogs) (8144) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:03,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:03,717::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:44:04,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:05,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899879 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:06,057::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:06,058::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3858::DEBUG::2014-09-09 11:44:06,059::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:07,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:07,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896524 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:08,693::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:08,694::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:08,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:08,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:08,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:08,695::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:44:08,696::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:08,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:08,702::__init__::225::IOProcess::(_processLogs) (8145) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:08,703::__init__::225::IOProcess::(_processLogs) (8145) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:08,704::__init__::225::IOProcess::(_processLogs) (8145) Building response >Thread-19::DEBUG::2014-09-09 11:44:08,704::__init__::225::IOProcess::(_processLogs) (8145) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:08,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:08,704::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:44:08,788::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.08484 s, 13.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) (8146) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:08,789::__init__::225::IOProcess::(_processLogs) (8146) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:08,790::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8146) Building response >Thread-19::DEBUG::2014-09-09 11:44:08,790::__init__::225::IOProcess::(_processLogs) (8146) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:08,790::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:08,791::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:09,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:09,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3859::DEBUG::2014-09-09 11:44:09,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:09,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:09,156::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:09,157::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3860::DEBUG::2014-09-09 11:44:09,157::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3860::DEBUG::2014-09-09 11:44:09,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`148c5632-840d-4890-9851-483a1c3edb50`::moving from state init -> state preparing >Thread-3860::INFO::2014-09-09 11:44:09,158::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3860::INFO::2014-09-09 11:44:09,159::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3860::DEBUG::2014-09-09 11:44:09,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`148c5632-840d-4890-9851-483a1c3edb50`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3860::DEBUG::2014-09-09 11:44:09,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`148c5632-840d-4890-9851-483a1c3edb50`::moving from state preparing -> state finished >Thread-3860::DEBUG::2014-09-09 11:44:09,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3860::DEBUG::2014-09-09 11:44:09,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3860::DEBUG::2014-09-09 11:44:09,159::task::993::Storage.TaskManager.Task::(_decref) Task=`148c5632-840d-4890-9851-483a1c3edb50`::ref 0 aborting False >Thread-3860::DEBUG::2014-09-09 11:44:09,159::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3860::DEBUG::2014-09-09 11:44:09,159::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:09,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896004 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:09,237::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:09,238::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3861::DEBUG::2014-09-09 11:44:09,238::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3861::DEBUG::2014-09-09 11:44:09,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`10b56b46-7cfe-4ae4-b223-0254ed6170fd`::moving from state init -> state preparing >Thread-3861::INFO::2014-09-09 11:44:09,239::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3861::DEBUG::2014-09-09 11:44:09,239::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`63d84265-20e1-4d03-82ad-b973ae3a27a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3861::DEBUG::2014-09-09 11:44:09,239::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3861::DEBUG::2014-09-09 11:44:09,239::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3861::DEBUG::2014-09-09 11:44:09,239::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`63d84265-20e1-4d03-82ad-b973ae3a27a7`::Granted request >Thread-3861::DEBUG::2014-09-09 11:44:09,240::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`10b56b46-7cfe-4ae4-b223-0254ed6170fd`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3861::DEBUG::2014-09-09 11:44:09,240::task::993::Storage.TaskManager.Task::(_decref) Task=`10b56b46-7cfe-4ae4-b223-0254ed6170fd`::ref 1 aborting False >Thread-3861::INFO::2014-09-09 11:44:09,241::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283914534912', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283920826368', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3861::DEBUG::2014-09-09 11:44:09,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`10b56b46-7cfe-4ae4-b223-0254ed6170fd`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283914534912', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283920826368', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3861::DEBUG::2014-09-09 11:44:09,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`10b56b46-7cfe-4ae4-b223-0254ed6170fd`::moving from state preparing -> state finished >Thread-3861::DEBUG::2014-09-09 11:44:09,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3861::DEBUG::2014-09-09 11:44:09,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3861::DEBUG::2014-09-09 11:44:09,242::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3861::DEBUG::2014-09-09 11:44:09,242::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3861::DEBUG::2014-09-09 11:44:09,242::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3861::DEBUG::2014-09-09 11:44:09,242::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3861::DEBUG::2014-09-09 11:44:09,242::task::993::Storage.TaskManager.Task::(_decref) Task=`10b56b46-7cfe-4ae4-b223-0254ed6170fd`::ref 0 aborting False >Thread-3861::DEBUG::2014-09-09 11:44:09,242::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283914534912', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283920826368', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283918729216', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3861::DEBUG::2014-09-09 11:44:09,243::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:11,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:11,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896645 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:12,074::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:12,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3862::DEBUG::2014-09-09 11:44:12,076::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) (8147) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:13,007::__init__::225::IOProcess::(_processLogs) (8147) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:13,008::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8147) Building response >Thread-3443::DEBUG::2014-09-09 11:44:13,008::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:13,008::__init__::225::IOProcess::(_processLogs) (8147) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,013::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,013::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:44:13,016::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000935833 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:13,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,016::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:13,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) (8148) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) (8148) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8148) Building response >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) (8148) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,017::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:44:13,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:13,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901944 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:13,717::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,717::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:13,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,717::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,718::__init__::225::IOProcess::(_processLogs) (8149) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:13,718::__init__::225::IOProcess::(_processLogs) (8149) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:13,718::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8149) Building response >Thread-24::DEBUG::2014-09-09 11:44:13,719::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:13,719::__init__::225::IOProcess::(_processLogs) (8149) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,724::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:44:13,727::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000900362 s, 609 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:13,727::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,727::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:13,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) (8150) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) (8150) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8150) Building response >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) (8150) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,728::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:13,729::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,729::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:44:13,729::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) (8151) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) (8151) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) (8151) Building response >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) (8151) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:13,730::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) (8152) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:13,731::__init__::225::IOProcess::(_processLogs) (8152) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) (8152) Building response >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) (8152) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:44:13,732::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) (8153) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) (8153) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) (8153) Building response >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) (8153) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:13,733::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:15,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:15,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3863::DEBUG::2014-09-09 11:44:15,086::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:15,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:15,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897685 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:44:17,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:17,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897236 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:18,090::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:18,091::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3864::DEBUG::2014-09-09 11:44:18,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`5af8dedd-97a9-4da8-a1a8-f94df173df75`::moving from state init -> state preparing >Thread-3864::INFO::2014-09-09 11:44:18,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3864::INFO::2014-09-09 11:44:18,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.08484', 'lastCheck': '9.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000900362', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000935833', 'lastCheck': '5.1', 'valid': True}} >Thread-3864::DEBUG::2014-09-09 11:44:18,092::task::1191::Storage.TaskManager.Task::(prepare) Task=`5af8dedd-97a9-4da8-a1a8-f94df173df75`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.08484', 'lastCheck': '9.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000900362', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000935833', 'lastCheck': '5.1', 'valid': True}} >Thread-3864::DEBUG::2014-09-09 11:44:18,092::task::595::Storage.TaskManager.Task::(_updateState) Task=`5af8dedd-97a9-4da8-a1a8-f94df173df75`::moving from state preparing -> state finished >Thread-3864::DEBUG::2014-09-09 11:44:18,092::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3864::DEBUG::2014-09-09 11:44:18,092::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3864::DEBUG::2014-09-09 11:44:18,093::task::993::Storage.TaskManager.Task::(_decref) Task=`5af8dedd-97a9-4da8-a1a8-f94df173df75`::ref 0 aborting False >Thread-3864::DEBUG::2014-09-09 11:44:18,093::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:18,104::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:18,105::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3865::DEBUG::2014-09-09 11:44:18,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:44:18,791::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:18,791::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:18,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:18,791::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:18,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:18,792::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:18,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:18,792::__init__::225::IOProcess::(_processLogs) (8154) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:18,792::__init__::225::IOProcess::(_processLogs) (8154) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:18,792::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8154) Building response >Thread-23::DEBUG::2014-09-09 11:44:18,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:18,793::__init__::225::IOProcess::(_processLogs) (8154) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:18,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:18,798::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:44:18,799::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010308 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:18,800::__init__::225::IOProcess::(_processLogs) (8155) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:18,801::__init__::225::IOProcess::(_processLogs) (8155) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:18,801::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8155) Building response >Thread-19::DEBUG::2014-09-09 11:44:18,802::__init__::225::IOProcess::(_processLogs) (8155) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:18,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:18,802::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:19,615::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:19,616::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3866::DEBUG::2014-09-09 11:44:19,616::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3866::DEBUG::2014-09-09 11:44:19,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`38d2b840-a9a8-46a8-8def-485f77d18cd4`::moving from state init -> state preparing >Thread-3866::INFO::2014-09-09 11:44:19,619::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3866::INFO::2014-09-09 11:44:19,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3866::DEBUG::2014-09-09 11:44:19,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`38d2b840-a9a8-46a8-8def-485f77d18cd4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3866::DEBUG::2014-09-09 11:44:19,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`38d2b840-a9a8-46a8-8def-485f77d18cd4`::moving from state preparing -> state finished >Thread-3866::DEBUG::2014-09-09 11:44:19,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3866::DEBUG::2014-09-09 11:44:19,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3866::DEBUG::2014-09-09 11:44:19,622::task::993::Storage.TaskManager.Task::(_decref) Task=`38d2b840-a9a8-46a8-8def-485f77d18cd4`::ref 0 aborting False >Thread-3866::DEBUG::2014-09-09 11:44:19,623::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3866::DEBUG::2014-09-09 11:44:19,623::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:19,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:19,722::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:19,724::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3867::DEBUG::2014-09-09 11:44:19,724::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3867::DEBUG::2014-09-09 11:44:19,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc9f244b-307f-4268-91c2-eeee7d6422ce`::moving from state init -> state preparing >Thread-3867::INFO::2014-09-09 11:44:19,727::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3867::DEBUG::2014-09-09 11:44:19,728::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`08e97f55-fb0a-431b-85da-f1dcb4d3a3c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3867::DEBUG::2014-09-09 11:44:19,728::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3867::DEBUG::2014-09-09 11:44:19,729::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3867::DEBUG::2014-09-09 11:44:19,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`08e97f55-fb0a-431b-85da-f1dcb4d3a3c2`::Granted request >Thread-3867::DEBUG::2014-09-09 11:44:19,731::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dc9f244b-307f-4268-91c2-eeee7d6422ce`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3867::DEBUG::2014-09-09 11:44:19,731::task::993::Storage.TaskManager.Task::(_decref) Task=`dc9f244b-307f-4268-91c2-eeee7d6422ce`::ref 1 aborting False >Thread-3867::INFO::2014-09-09 11:44:19,744::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283911389184', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283913486336', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283914534912', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3867::DEBUG::2014-09-09 11:44:19,745::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc9f244b-307f-4268-91c2-eeee7d6422ce`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283911389184', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283913486336', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283914534912', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3867::DEBUG::2014-09-09 11:44:19,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc9f244b-307f-4268-91c2-eeee7d6422ce`::moving from state preparing -> state finished >Thread-3867::DEBUG::2014-09-09 11:44:19,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3867::DEBUG::2014-09-09 11:44:19,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3867::DEBUG::2014-09-09 11:44:19,748::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Dummy-97::DEBUG::2014-09-09 11:44:19,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.102508 s, 10.0 MB/s\n'; <rc> = 0 >Thread-3867::DEBUG::2014-09-09 11:44:19,750::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3867::DEBUG::2014-09-09 11:44:19,750::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3867::DEBUG::2014-09-09 11:44:19,751::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3867::DEBUG::2014-09-09 11:44:19,752::task::993::Storage.TaskManager.Task::(_decref) Task=`dc9f244b-307f-4268-91c2-eeee7d6422ce`::ref 0 aborting False >Thread-3867::DEBUG::2014-09-09 11:44:19,754::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283911389184', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283913486336', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283914534912', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3867::DEBUG::2014-09-09 11:44:19,755::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:21,544::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:21,545::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3868::DEBUG::2014-09-09 11:44:21,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:21,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:21,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903419 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) (8156) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) (8156) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:23,019::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8156) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,020::__init__::225::IOProcess::(_processLogs) (8156) Queuing response >Thread-3443::DEBUG::2014-09-09 11:44:23,020::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:23,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:23,025::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:44:23,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000901138 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:23,027::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) (8157) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) (8157) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8157) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,028::__init__::225::IOProcess::(_processLogs) (8157) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:23,029::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:23,029::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,734::__init__::225::IOProcess::(_processLogs) (8158) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:23,734::__init__::225::IOProcess::(_processLogs) (8158) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:23,734::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8158) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,734::__init__::225::IOProcess::(_processLogs) (8158) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:23,734::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:44:23,735::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:23,735::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:44:23,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000905591 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) (8159) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) (8159) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8159) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,743::__init__::225::IOProcess::(_processLogs) (8159) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:23,744::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:23,744::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:23,744::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) (8160) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:23,745::__init__::225::IOProcess::(_processLogs) (8160) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) (8160) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) (8160) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,746::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) (8161) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) (8161) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) (8161) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) (8161) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:23,747::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:23,748::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:44:23,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:23,748::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:23,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:23,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:23,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:23,749::__init__::225::IOProcess::(_processLogs) (8162) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:23,749::__init__::225::IOProcess::(_processLogs) (8162) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:23,749::__init__::225::IOProcess::(_processLogs) (8162) Building response >Thread-19::DEBUG::2014-09-09 11:44:23,749::__init__::225::IOProcess::(_processLogs) (8162) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:23,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:23,749::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:44:23,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:24,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899466 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:24,555::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:24,555::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3869::DEBUG::2014-09-09 11:44:24,556::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:26,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:26,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898565 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:27,563::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:27,564::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3870::DEBUG::2014-09-09 11:44:27,565::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:28,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:28,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898023 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:28,802::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:28,802::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:28,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:28,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:28,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) (8163) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) (8163) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8163) Building response >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) (8163) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:28,803::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:28,804::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:44:28,804::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:44:28,811::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.001158 s, 970 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:28,811::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:28,811::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:28,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:28,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:28,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:28,812::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:28,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:28,812::__init__::225::IOProcess::(_processLogs) (8164) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:28,812::__init__::225::IOProcess::(_processLogs) (8164) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:28,812::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8164) Building response >Thread-19::DEBUG::2014-09-09 11:44:28,813::__init__::225::IOProcess::(_processLogs) (8164) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:28,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:28,813::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:30,091::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3871::DEBUG::2014-09-09 11:44:30,092::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:44:30,092::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3871::DEBUG::2014-09-09 11:44:30,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`d08093f1-6d41-4d6d-b4f8-af7716835056`::moving from state init -> state preparing >Thread-3871::INFO::2014-09-09 11:44:30,093::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3871::INFO::2014-09-09 11:44:30,093::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3871::DEBUG::2014-09-09 11:44:30,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`d08093f1-6d41-4d6d-b4f8-af7716835056`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3871::DEBUG::2014-09-09 11:44:30,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`d08093f1-6d41-4d6d-b4f8-af7716835056`::moving from state preparing -> state finished >Thread-3871::DEBUG::2014-09-09 11:44:30,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3871::DEBUG::2014-09-09 11:44:30,093::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3871::DEBUG::2014-09-09 11:44:30,093::task::993::Storage.TaskManager.Task::(_decref) Task=`d08093f1-6d41-4d6d-b4f8-af7716835056`::ref 0 aborting False >Thread-3871::DEBUG::2014-09-09 11:44:30,094::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3871::DEBUG::2014-09-09 11:44:30,094::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:30,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:30,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898372 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:30,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:30,574::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3872::DEBUG::2014-09-09 11:44:30,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:30,790::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3873::DEBUG::2014-09-09 11:44:30,790::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:44:30,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3873::DEBUG::2014-09-09 11:44:30,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca26957b-dd27-4be3-98a1-b70d0f74e0fb`::moving from state init -> state preparing >Thread-3873::INFO::2014-09-09 11:44:30,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3873::DEBUG::2014-09-09 11:44:30,792::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4e3f9702-ecc9-4331-bf64-f20a1007a925`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3873::DEBUG::2014-09-09 11:44:30,792::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3873::DEBUG::2014-09-09 11:44:30,792::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3873::DEBUG::2014-09-09 11:44:30,792::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4e3f9702-ecc9-4331-bf64-f20a1007a925`::Granted request >Thread-3873::DEBUG::2014-09-09 11:44:30,792::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca26957b-dd27-4be3-98a1-b70d0f74e0fb`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3873::DEBUG::2014-09-09 11:44:30,792::task::993::Storage.TaskManager.Task::(_decref) Task=`ca26957b-dd27-4be3-98a1-b70d0f74e0fb`::ref 1 aborting False >Thread-3873::INFO::2014-09-09 11:44:30,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283909292032', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283910340608', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283910340608', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3873::DEBUG::2014-09-09 11:44:30,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca26957b-dd27-4be3-98a1-b70d0f74e0fb`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283909292032', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283910340608', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283910340608', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3873::DEBUG::2014-09-09 11:44:30,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca26957b-dd27-4be3-98a1-b70d0f74e0fb`::moving from state preparing -> state finished >Thread-3873::DEBUG::2014-09-09 11:44:30,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3873::DEBUG::2014-09-09 11:44:30,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3873::DEBUG::2014-09-09 11:44:30,794::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3873::DEBUG::2014-09-09 11:44:30,795::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3873::DEBUG::2014-09-09 11:44:30,795::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3873::DEBUG::2014-09-09 11:44:30,795::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3873::DEBUG::2014-09-09 11:44:30,795::task::993::Storage.TaskManager.Task::(_decref) Task=`ca26957b-dd27-4be3-98a1-b70d0f74e0fb`::ref 0 aborting False >Thread-3873::DEBUG::2014-09-09 11:44:30,795::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283909292032', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283910340608', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283910340608', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3873::DEBUG::2014-09-09 11:44:30,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:32,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:32,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899542 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,030::__init__::225::IOProcess::(_processLogs) (8165) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:33,031::__init__::225::IOProcess::(_processLogs) (8165) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:33,032::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8165) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,032::__init__::225::IOProcess::(_processLogs) (8165) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:33,033::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:44:33,033::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:44:33,228::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.188816 s, 1.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) (8166) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:33,229::__init__::225::IOProcess::(_processLogs) (8166) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:33,230::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8166) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,230::__init__::225::IOProcess::(_processLogs) (8166) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:33,230::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:33,582::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:33,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3874::DEBUG::2014-09-09 11:44:33,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`a64c8862-bdfc-4ff7-8e15-309af46c7660`::moving from state init -> state preparing >Thread-3874::INFO::2014-09-09 11:44:33,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3874::INFO::2014-09-09 11:44:33,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001158', 'lastCheck': '4.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000905591', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.188816', 'lastCheck': '0.4', 'valid': True}} >Thread-3874::DEBUG::2014-09-09 11:44:33,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`a64c8862-bdfc-4ff7-8e15-309af46c7660`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001158', 'lastCheck': '4.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000905591', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.188816', 'lastCheck': '0.4', 'valid': True}} >Thread-3874::DEBUG::2014-09-09 11:44:33,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`a64c8862-bdfc-4ff7-8e15-309af46c7660`::moving from state preparing -> state finished >Thread-3874::DEBUG::2014-09-09 11:44:33,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3874::DEBUG::2014-09-09 11:44:33,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3874::DEBUG::2014-09-09 11:44:33,585::task::993::Storage.TaskManager.Task::(_decref) Task=`a64c8862-bdfc-4ff7-8e15-309af46c7660`::ref 0 aborting False >Thread-3874::DEBUG::2014-09-09 11:44:33,586::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:33,607::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:33,608::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3875::DEBUG::2014-09-09 11:44:33,608::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:44:33,748::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) (8167) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:33,749::__init__::225::IOProcess::(_processLogs) (8167) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:33,750::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8167) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,750::__init__::225::IOProcess::(_processLogs) (8167) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,750::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:44:33,750::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:33,751::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:44:33,887::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.129915 s, 4.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:33,887::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,887::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:33,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) (8168) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) (8168) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:33,888::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8168) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) (8168) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,889::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) (8169) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) (8169) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) (8169) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) (8169) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:33,890::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) (8170) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) (8170) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) (8170) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) (8170) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:33,892::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) (8171) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) (8171) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) (8171) Building response >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) (8171) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:33,893::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:33,894::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:44:34,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:34,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900337 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:44:36,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:36,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900267 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:37,781::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:37,782::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3876::DEBUG::2014-09-09 11:44:37,783::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:38,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:38,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900204 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:38,813::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:38,813::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:38,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:38,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:38,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:38,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:38,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:38,814::__init__::225::IOProcess::(_processLogs) (8172) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:38,814::__init__::225::IOProcess::(_processLogs) (8172) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:38,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8172) Building response >Thread-19::DEBUG::2014-09-09 11:44:38,815::__init__::225::IOProcess::(_processLogs) (8172) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:38,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:38,816::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:44:38,816::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:44:38,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116751 s, 962 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:38,824::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:38,824::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:38,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:38,824::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:38,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:38,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:38,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:38,825::__init__::225::IOProcess::(_processLogs) (8173) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:38,825::__init__::225::IOProcess::(_processLogs) (8173) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:38,825::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8173) Building response >Thread-19::DEBUG::2014-09-09 11:44:38,825::__init__::225::IOProcess::(_processLogs) (8173) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:38,825::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:38,826::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:44:40,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:40,802::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:40,803::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3877::DEBUG::2014-09-09 11:44:40,804::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:40,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898702 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:41,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3878::DEBUG::2014-09-09 11:44:41,518::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:44:41,518::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3878::DEBUG::2014-09-09 11:44:41,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`80f71b27-f978-4d2f-8022-66d19c8741c7`::moving from state init -> state preparing >Thread-3878::INFO::2014-09-09 11:44:41,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3878::INFO::2014-09-09 11:44:41,519::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3878::DEBUG::2014-09-09 11:44:41,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`80f71b27-f978-4d2f-8022-66d19c8741c7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3878::DEBUG::2014-09-09 11:44:41,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`80f71b27-f978-4d2f-8022-66d19c8741c7`::moving from state preparing -> state finished >Thread-3878::DEBUG::2014-09-09 11:44:41,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3878::DEBUG::2014-09-09 11:44:41,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3878::DEBUG::2014-09-09 11:44:41,520::task::993::Storage.TaskManager.Task::(_decref) Task=`80f71b27-f978-4d2f-8022-66d19c8741c7`::ref 0 aborting False >Thread-3878::DEBUG::2014-09-09 11:44:41,520::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3878::DEBUG::2014-09-09 11:44:41,520::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:41,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:41,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3879::DEBUG::2014-09-09 11:44:41,583::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3879::DEBUG::2014-09-09 11:44:41,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`25fb6c6e-bf27-4cb7-a4b2-2e2af4541e37`::moving from state init -> state preparing >Thread-3879::INFO::2014-09-09 11:44:41,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3879::DEBUG::2014-09-09 11:44:41,585::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3dc5960f-bb8a-4472-9499-50b57ba9a399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3879::DEBUG::2014-09-09 11:44:41,585::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3879::DEBUG::2014-09-09 11:44:41,585::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3879::DEBUG::2014-09-09 11:44:41,585::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3dc5960f-bb8a-4472-9499-50b57ba9a399`::Granted request >Thread-3879::DEBUG::2014-09-09 11:44:41,585::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`25fb6c6e-bf27-4cb7-a4b2-2e2af4541e37`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3879::DEBUG::2014-09-09 11:44:41,585::task::993::Storage.TaskManager.Task::(_decref) Task=`25fb6c6e-bf27-4cb7-a4b2-2e2af4541e37`::ref 1 aborting False >Thread-3879::INFO::2014-09-09 11:44:41,587::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283908243456', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3879::DEBUG::2014-09-09 11:44:41,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`25fb6c6e-bf27-4cb7-a4b2-2e2af4541e37`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283908243456', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3879::DEBUG::2014-09-09 11:44:41,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`25fb6c6e-bf27-4cb7-a4b2-2e2af4541e37`::moving from state preparing -> state finished >Thread-3879::DEBUG::2014-09-09 11:44:41,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3879::DEBUG::2014-09-09 11:44:41,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3879::DEBUG::2014-09-09 11:44:41,587::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3879::DEBUG::2014-09-09 11:44:41,587::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3879::DEBUG::2014-09-09 11:44:41,588::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3879::DEBUG::2014-09-09 11:44:41,588::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3879::DEBUG::2014-09-09 11:44:41,588::task::993::Storage.TaskManager.Task::(_decref) Task=`25fb6c6e-bf27-4cb7-a4b2-2e2af4541e37`::ref 0 aborting False >Thread-3879::DEBUG::2014-09-09 11:44:41,588::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283908243456', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3879::DEBUG::2014-09-09 11:44:41,588::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:42,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:42,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903666 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:43,231::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,231::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:43,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,231::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,232::__init__::225::IOProcess::(_processLogs) (8174) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:43,232::__init__::225::IOProcess::(_processLogs) (8174) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:43,232::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8174) Building response >Thread-3443::DEBUG::2014-09-09 11:44:43,233::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:43,233::__init__::225::IOProcess::(_processLogs) (8174) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,238::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:44:43,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000916042 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:43,240::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,240::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:43,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,240::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,241::__init__::225::IOProcess::(_processLogs) (8175) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:43,241::__init__::225::IOProcess::(_processLogs) (8175) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:43,241::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8175) Building response >Thread-19::DEBUG::2014-09-09 11:44:43,241::__init__::225::IOProcess::(_processLogs) (8175) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,242::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,242::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:43,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:43,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3880::DEBUG::2014-09-09 11:44:43,817::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:44:43,893::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,893::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:43,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,894::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,894::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,894::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,894::__init__::225::IOProcess::(_processLogs) (8176) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:43,894::__init__::225::IOProcess::(_processLogs) (8176) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:43,895::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8176) Building response >Thread-19::DEBUG::2014-09-09 11:44:43,895::__init__::225::IOProcess::(_processLogs) (8176) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,895::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,896::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:44:43,896::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:44:43,903::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000950026 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:43,904::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,904::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:43,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,904::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,905::__init__::225::IOProcess::(_processLogs) (8177) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:43,905::__init__::225::IOProcess::(_processLogs) (8177) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:43,905::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8177) Building response >Thread-19::DEBUG::2014-09-09 11:44:43,905::__init__::225::IOProcess::(_processLogs) (8177) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,905::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) (8178) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) (8178) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8178) Building response >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) (8178) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:43,907::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) (8179) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) (8179) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8179) Building response >Thread-19::DEBUG::2014-09-09 11:44:43,908::__init__::225::IOProcess::(_processLogs) (8179) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,909::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,909::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:43,909::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:43,909::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:44:43,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:43,909::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) (8180) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) (8180) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) (8180) Building response >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) (8180) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:43,910::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:44:44,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:45,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899756 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:46,828::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:46,829::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3881::DEBUG::2014-09-09 11:44:46,830::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:47,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:47,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898524 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:48,826::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:48,826::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) (8181) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) (8181) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:48,827::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8181) Building response >Thread-23::DEBUG::2014-09-09 11:44:48,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:48,828::__init__::225::IOProcess::(_processLogs) (8181) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:48,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:48,833::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:44:48,835::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109564 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:48,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) (8182) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) (8182) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:48,836::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8182) Building response >Thread-19::DEBUG::2014-09-09 11:44:48,837::__init__::225::IOProcess::(_processLogs) (8182) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:48,837::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:48,837::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:44:49,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:49,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896373 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:49,861::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:49,863::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3882::DEBUG::2014-09-09 11:44:49,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f6e973b-ef08-466b-ad5d-66be6fc03356`::moving from state init -> state preparing >Thread-3882::INFO::2014-09-09 11:44:49,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3882::INFO::2014-09-09 11:44:49,868::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109564', 'lastCheck': '1.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000950026', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916042', 'lastCheck': '6.6', 'valid': True}} >Thread-3882::DEBUG::2014-09-09 11:44:49,868::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f6e973b-ef08-466b-ad5d-66be6fc03356`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109564', 'lastCheck': '1.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000950026', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916042', 'lastCheck': '6.6', 'valid': True}} >Thread-3882::DEBUG::2014-09-09 11:44:49,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f6e973b-ef08-466b-ad5d-66be6fc03356`::moving from state preparing -> state finished >Thread-3882::DEBUG::2014-09-09 11:44:49,869::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3882::DEBUG::2014-09-09 11:44:49,869::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3882::DEBUG::2014-09-09 11:44:49,870::task::993::Storage.TaskManager.Task::(_decref) Task=`2f6e973b-ef08-466b-ad5d-66be6fc03356`::ref 0 aborting False >Thread-3882::DEBUG::2014-09-09 11:44:49,873::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:49,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:49,885::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3883::DEBUG::2014-09-09 11:44:49,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:51,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:51,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898284 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:51,843::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3884::DEBUG::2014-09-09 11:44:51,843::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:44:51,843::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3884::DEBUG::2014-09-09 11:44:51,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbc27298-41d2-4759-802d-3f61c659fd62`::moving from state init -> state preparing >Thread-3884::INFO::2014-09-09 11:44:51,845::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3884::INFO::2014-09-09 11:44:51,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3884::DEBUG::2014-09-09 11:44:51,845::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbc27298-41d2-4759-802d-3f61c659fd62`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3884::DEBUG::2014-09-09 11:44:51,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbc27298-41d2-4759-802d-3f61c659fd62`::moving from state preparing -> state finished >Thread-3884::DEBUG::2014-09-09 11:44:51,845::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3884::DEBUG::2014-09-09 11:44:51,845::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3884::DEBUG::2014-09-09 11:44:51,845::task::993::Storage.TaskManager.Task::(_decref) Task=`cbc27298-41d2-4759-802d-3f61c659fd62`::ref 0 aborting False >Thread-3884::DEBUG::2014-09-09 11:44:51,845::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3884::DEBUG::2014-09-09 11:44:51,846::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:51,908::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:51,909::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3885::DEBUG::2014-09-09 11:44:51,909::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3885::DEBUG::2014-09-09 11:44:51,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`d17736b1-87c8-4e1d-8a66-74d2ed0576bd`::moving from state init -> state preparing >Thread-3885::INFO::2014-09-09 11:44:51,910::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3885::DEBUG::2014-09-09 11:44:51,910::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ad172d94-ab41-4af9-9b0c-8a498e63dcc7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3885::DEBUG::2014-09-09 11:44:51,910::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3885::DEBUG::2014-09-09 11:44:51,910::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3885::DEBUG::2014-09-09 11:44:51,910::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ad172d94-ab41-4af9-9b0c-8a498e63dcc7`::Granted request >Thread-3885::DEBUG::2014-09-09 11:44:51,911::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d17736b1-87c8-4e1d-8a66-74d2ed0576bd`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3885::DEBUG::2014-09-09 11:44:51,911::task::993::Storage.TaskManager.Task::(_decref) Task=`d17736b1-87c8-4e1d-8a66-74d2ed0576bd`::ref 1 aborting False >Thread-3885::INFO::2014-09-09 11:44:51,912::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3885::DEBUG::2014-09-09 11:44:51,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`d17736b1-87c8-4e1d-8a66-74d2ed0576bd`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3885::DEBUG::2014-09-09 11:44:51,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`d17736b1-87c8-4e1d-8a66-74d2ed0576bd`::moving from state preparing -> state finished >Thread-3885::DEBUG::2014-09-09 11:44:51,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3885::DEBUG::2014-09-09 11:44:51,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3885::DEBUG::2014-09-09 11:44:51,913::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3885::DEBUG::2014-09-09 11:44:51,913::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3885::DEBUG::2014-09-09 11:44:51,913::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3885::DEBUG::2014-09-09 11:44:51,913::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3885::DEBUG::2014-09-09 11:44:51,913::task::993::Storage.TaskManager.Task::(_decref) Task=`d17736b1-87c8-4e1d-8a66-74d2ed0576bd`::ref 0 aborting False >Thread-3885::DEBUG::2014-09-09 11:44:51,913::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283897757696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3885::DEBUG::2014-09-09 11:44:51,913::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) (8183) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:53,243::__init__::225::IOProcess::(_processLogs) (8183) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:53,244::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8183) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,244::__init__::225::IOProcess::(_processLogs) (8183) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,244::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:53,245::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:44:53,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:44:53,251::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000939425 s, 378 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) (8184) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:53,252::__init__::225::IOProcess::(_processLogs) (8184) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:53,253::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8184) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,253::__init__::225::IOProcess::(_processLogs) (8184) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:53,254::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:44:53,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:53,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:53,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3886::DEBUG::2014-09-09 11:44:53,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:53,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.096711 s, 10.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:53,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,910::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:53,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) (8185) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) (8185) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8185) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) (8185) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,911::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:44:53,912::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:53,912::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:44:53,920::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000973665 s, 563 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:53,921::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,921::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:44:53,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,921::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) (8186) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) (8186) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8186) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) (8186) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,922::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:53,923::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:44:53,923::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,923::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:44:53,923::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) (8187) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) (8187) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) (8187) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) (8187) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:53,924::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,925::__init__::225::IOProcess::(_processLogs) (8188) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) (8188) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) (8188) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) (8188) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:53,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:53,927::__init__::225::IOProcess::(_processLogs) (8189) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:44:53,927::__init__::225::IOProcess::(_processLogs) (8189) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:44:53,927::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8189) Building response >Thread-19::DEBUG::2014-09-09 11:44:53,927::__init__::225::IOProcess::(_processLogs) (8189) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:53,927::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:53,928::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:44:55,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:55,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898256 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:56,506::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:56,507::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3887::DEBUG::2014-09-09 11:44:56,507::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:57,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:57,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897131 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:58,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:58,839::__init__::225::IOProcess::(_processLogs) (8190) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:58,839::__init__::225::IOProcess::(_processLogs) (8190) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:58,839::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8190) Building response >Thread-19::DEBUG::2014-09-09 11:44:58,839::__init__::225::IOProcess::(_processLogs) (8190) Queuing response >Thread-23::DEBUG::2014-09-09 11:44:58,840::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:44:58,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:44:58,845::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:44:58,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111697 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:44:58,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:44:58,849::__init__::225::IOProcess::(_processLogs) (8191) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:44:58,849::__init__::225::IOProcess::(_processLogs) (8191) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:44:58,849::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8191) Building response >Thread-19::DEBUG::2014-09-09 11:44:58,849::__init__::225::IOProcess::(_processLogs) (8191) Queuing response >Thread-19::DEBUG::2014-09-09 11:44:58,849::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:44:58,850::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:44:59,513::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:44:59,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3888::DEBUG::2014-09-09 11:44:59,514::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:44:59,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:44:59,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897975 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:45:01,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:01,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896552 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:02,189::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:02,190::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3889::DEBUG::2014-09-09 11:45:02,190::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3889::DEBUG::2014-09-09 11:45:02,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`d10af2fb-8a3a-4245-97dc-b95e596ebf5c`::moving from state init -> state preparing >Thread-3889::INFO::2014-09-09 11:45:02,191::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3889::INFO::2014-09-09 11:45:02,191::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3889::DEBUG::2014-09-09 11:45:02,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`d10af2fb-8a3a-4245-97dc-b95e596ebf5c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3889::DEBUG::2014-09-09 11:45:02,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`d10af2fb-8a3a-4245-97dc-b95e596ebf5c`::moving from state preparing -> state finished >Thread-3889::DEBUG::2014-09-09 11:45:02,192::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3889::DEBUG::2014-09-09 11:45:02,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3889::DEBUG::2014-09-09 11:45:02,192::task::993::Storage.TaskManager.Task::(_decref) Task=`d10af2fb-8a3a-4245-97dc-b95e596ebf5c`::ref 0 aborting False >Thread-3889::DEBUG::2014-09-09 11:45:02,192::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3889::DEBUG::2014-09-09 11:45:02,192::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:02,419::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3890::DEBUG::2014-09-09 11:45:02,420::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:45:02,420::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3890::DEBUG::2014-09-09 11:45:02,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cdda9c6-5519-4f92-be09-69953c882a6c`::moving from state init -> state preparing >Thread-3890::INFO::2014-09-09 11:45:02,421::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3890::DEBUG::2014-09-09 11:45:02,421::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7c90d9d9-5ad8-4c44-ac3c-42ff2f5cd46d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3890::DEBUG::2014-09-09 11:45:02,421::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3890::DEBUG::2014-09-09 11:45:02,421::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3890::DEBUG::2014-09-09 11:45:02,421::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7c90d9d9-5ad8-4c44-ac3c-42ff2f5cd46d`::Granted request >Thread-3890::DEBUG::2014-09-09 11:45:02,422::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9cdda9c6-5519-4f92-be09-69953c882a6c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3890::DEBUG::2014-09-09 11:45:02,422::task::993::Storage.TaskManager.Task::(_decref) Task=`9cdda9c6-5519-4f92-be09-69953c882a6c`::ref 1 aborting False >Thread-3890::INFO::2014-09-09 11:45:02,424::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3890::DEBUG::2014-09-09 11:45:02,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cdda9c6-5519-4f92-be09-69953c882a6c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3890::DEBUG::2014-09-09 11:45:02,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cdda9c6-5519-4f92-be09-69953c882a6c`::moving from state preparing -> state finished >Thread-3890::DEBUG::2014-09-09 11:45:02,424::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3890::DEBUG::2014-09-09 11:45:02,424::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3890::DEBUG::2014-09-09 11:45:02,425::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3890::DEBUG::2014-09-09 11:45:02,425::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3890::DEBUG::2014-09-09 11:45:02,425::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3890::DEBUG::2014-09-09 11:45:02,425::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3890::DEBUG::2014-09-09 11:45:02,425::task::993::Storage.TaskManager.Task::(_decref) Task=`9cdda9c6-5519-4f92-be09-69953c882a6c`::ref 0 aborting False >Thread-3890::DEBUG::2014-09-09 11:45:02,425::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3890::DEBUG::2014-09-09 11:45:02,425::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:02,525::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:02,526::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3891::DEBUG::2014-09-09 11:45:02,527::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:03,254::__init__::225::IOProcess::(_processLogs) (8192) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:03,255::__init__::225::IOProcess::(_processLogs) (8192) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:03,255::__init__::225::IOProcess::(_processLogs) (8192) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:03,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:45:03,255::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:45:03,263::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000954528 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:03,263::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:03,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:03,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:03,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:03,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:03,264::__init__::225::IOProcess::(_processLogs) (8193) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:03,264::__init__::225::IOProcess::(_processLogs) (8193) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:03,264::__init__::225::IOProcess::(_processLogs) (8193) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:03,264::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:45:03,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:03,928::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:03,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:03,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:03,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:03,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:03,929::__init__::225::IOProcess::(_processLogs) (8194) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:03,929::__init__::225::IOProcess::(_processLogs) (8194) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:03,929::__init__::225::IOProcess::(_processLogs) (8194) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:03,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:45:03,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:04,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901712 s, 11.4 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:45:04,019::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000911802 s, 601 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:04,020::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:04,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:04,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:04,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:04,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:04,023::__init__::225::IOProcess::(_processLogs) (8195) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:04,024::__init__::225::IOProcess::(_processLogs) (8195) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:04,024::__init__::225::IOProcess::(_processLogs) (8195) Building response >Thread-19::DEBUG::2014-09-09 11:45:04,025::__init__::225::IOProcess::(_processLogs) (8195) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:04,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:04,025::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:04,026::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:45:04,027::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:04,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:04,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:04,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:04,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:04,029::__init__::225::IOProcess::(_processLogs) (8196) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:04,030::__init__::225::IOProcess::(_processLogs) (8196) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:04,030::__init__::225::IOProcess::(_processLogs) (8196) Building response >Thread-19::DEBUG::2014-09-09 11:45:04,031::__init__::225::IOProcess::(_processLogs) (8196) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:04,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:04,032::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:04,032::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:04,032::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:45:04,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:04,033::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:04,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:04,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:04,034::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:04,035::__init__::225::IOProcess::(_processLogs) (8197) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:04,035::__init__::225::IOProcess::(_processLogs) (8197) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:04,036::__init__::225::IOProcess::(_processLogs) (8197) Building response >Thread-19::DEBUG::2014-09-09 11:45:04,036::__init__::225::IOProcess::(_processLogs) (8197) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:04,036::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:04,037::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:04,037::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:04,038::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:45:04,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:04,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:04,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:04,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:04,040::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:04,040::__init__::225::IOProcess::(_processLogs) (8198) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:04,041::__init__::225::IOProcess::(_processLogs) (8198) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:04,041::__init__::225::IOProcess::(_processLogs) (8198) Building response >Thread-19::DEBUG::2014-09-09 11:45:04,041::__init__::225::IOProcess::(_processLogs) (8198) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:04,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:04,042::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:05,533::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:05,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3892::DEBUG::2014-09-09 11:45:05,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`8303d89f-1c4c-410c-b72e-6d7affb71687`::moving from state init -> state preparing >Thread-3892::INFO::2014-09-09 11:45:05,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3892::INFO::2014-09-09 11:45:05,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111697', 'lastCheck': '6.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911802', 'lastCheck': '1.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954528', 'lastCheck': '2.3', 'valid': True}} >Thread-3892::DEBUG::2014-09-09 11:45:05,536::task::1191::Storage.TaskManager.Task::(prepare) Task=`8303d89f-1c4c-410c-b72e-6d7affb71687`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111697', 'lastCheck': '6.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911802', 'lastCheck': '1.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954528', 'lastCheck': '2.3', 'valid': True}} >Thread-3892::DEBUG::2014-09-09 11:45:05,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`8303d89f-1c4c-410c-b72e-6d7affb71687`::moving from state preparing -> state finished >Thread-3892::DEBUG::2014-09-09 11:45:05,536::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3892::DEBUG::2014-09-09 11:45:05,536::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3892::DEBUG::2014-09-09 11:45:05,536::task::993::Storage.TaskManager.Task::(_decref) Task=`8303d89f-1c4c-410c-b72e-6d7affb71687`::ref 0 aborting False >Thread-3892::DEBUG::2014-09-09 11:45:05,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:05,549::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:05,550::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3893::DEBUG::2014-09-09 11:45:05,551::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:06,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:06,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902655 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:45:08,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:08,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900114 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:08,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) (8199) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:08,851::__init__::225::IOProcess::(_processLogs) (8199) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:08,852::__init__::225::IOProcess::(_processLogs) DEBUG|(8199) Building response >Thread-19::DEBUG::2014-09-09 11:45:08,852::__init__::225::IOProcess::(_processLogs) (8199) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:08,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:08,852::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:45:08,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:45:08,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00122366 s, 918 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:08,861::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:08,861::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) (8200) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:08,862::__init__::225::IOProcess::(_processLogs) (8200) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:08,863::__init__::225::IOProcess::(_processLogs) DEBUG|(8200) Building response >Thread-19::DEBUG::2014-09-09 11:45:08,863::__init__::225::IOProcess::(_processLogs) (8200) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:08,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:08,863::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:09,790::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:09,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3894::DEBUG::2014-09-09 11:45:09,791::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:10,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:10,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901024 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:45:12,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:12,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897132 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:12,804::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:12,804::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3895::DEBUG::2014-09-09 11:45:12,805::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:12,938::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:12,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3896::DEBUG::2014-09-09 11:45:12,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3896::DEBUG::2014-09-09 11:45:12,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aea8c32-2b8c-42a4-8635-349500d2c715`::moving from state init -> state preparing >Thread-3896::INFO::2014-09-09 11:45:12,940::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3896::INFO::2014-09-09 11:45:12,940::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3896::DEBUG::2014-09-09 11:45:12,940::task::1191::Storage.TaskManager.Task::(prepare) Task=`3aea8c32-2b8c-42a4-8635-349500d2c715`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3896::DEBUG::2014-09-09 11:45:12,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aea8c32-2b8c-42a4-8635-349500d2c715`::moving from state preparing -> state finished >Thread-3896::DEBUG::2014-09-09 11:45:12,940::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3896::DEBUG::2014-09-09 11:45:12,940::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3896::DEBUG::2014-09-09 11:45:12,940::task::993::Storage.TaskManager.Task::(_decref) Task=`3aea8c32-2b8c-42a4-8635-349500d2c715`::ref 0 aborting False >Thread-3896::DEBUG::2014-09-09 11:45:12,941::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3896::DEBUG::2014-09-09 11:45:12,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:13,020::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3897::DEBUG::2014-09-09 11:45:13,020::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:45:13,020::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3897::DEBUG::2014-09-09 11:45:13,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`d24872c3-3f15-4eae-84a8-7dfdefa5697a`::moving from state init -> state preparing >Thread-3897::INFO::2014-09-09 11:45:13,021::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3897::DEBUG::2014-09-09 11:45:13,021::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b49262ec-08ef-4024-93c7-bed51ebd86ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3897::DEBUG::2014-09-09 11:45:13,021::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3897::DEBUG::2014-09-09 11:45:13,022::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3897::DEBUG::2014-09-09 11:45:13,022::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b49262ec-08ef-4024-93c7-bed51ebd86ad`::Granted request >Thread-3897::DEBUG::2014-09-09 11:45:13,022::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d24872c3-3f15-4eae-84a8-7dfdefa5697a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3897::DEBUG::2014-09-09 11:45:13,022::task::993::Storage.TaskManager.Task::(_decref) Task=`d24872c3-3f15-4eae-84a8-7dfdefa5697a`::ref 1 aborting False >Thread-3897::INFO::2014-09-09 11:45:13,024::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3897::DEBUG::2014-09-09 11:45:13,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`d24872c3-3f15-4eae-84a8-7dfdefa5697a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3897::DEBUG::2014-09-09 11:45:13,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`d24872c3-3f15-4eae-84a8-7dfdefa5697a`::moving from state preparing -> state finished >Thread-3897::DEBUG::2014-09-09 11:45:13,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3897::DEBUG::2014-09-09 11:45:13,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3897::DEBUG::2014-09-09 11:45:13,024::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3897::DEBUG::2014-09-09 11:45:13,024::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3897::DEBUG::2014-09-09 11:45:13,024::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3897::DEBUG::2014-09-09 11:45:13,024::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3897::DEBUG::2014-09-09 11:45:13,024::task::993::Storage.TaskManager.Task::(_decref) Task=`d24872c3-3f15-4eae-84a8-7dfdefa5697a`::ref 0 aborting False >Thread-3897::DEBUG::2014-09-09 11:45:13,025::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3897::DEBUG::2014-09-09 11:45:13,025::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:13,265::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:13,266::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:13,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:13,266::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:13,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:13,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:13,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:13,267::__init__::225::IOProcess::(_processLogs) (8201) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:13,267::__init__::225::IOProcess::(_processLogs) (8201) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:13,267::__init__::225::IOProcess::(_processLogs) DEBUG|(8201) Building response >Thread-3443::DEBUG::2014-09-09 11:45:13,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:13,268::__init__::225::IOProcess::(_processLogs) (8201) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:13,272::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:13,273::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:45:13,275::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000894322 s, 397 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:13,275::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:13,275::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:13,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) (8202) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) (8202) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) DEBUG|(8202) Building response >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) (8202) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:13,276::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:13,277::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:14,040::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:14,040::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:14,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:14,041::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:14,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:14,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:14,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:14,041::__init__::225::IOProcess::(_processLogs) (8203) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:14,041::__init__::225::IOProcess::(_processLogs) (8203) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:14,042::__init__::225::IOProcess::(_processLogs) DEBUG|(8203) Building response >Thread-19::DEBUG::2014-09-09 11:45:14,042::__init__::225::IOProcess::(_processLogs) (8203) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:14,042::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:45:14,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:14,043::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:45:14,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000926198 s, 592 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:14,052::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:14,052::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:14,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:14,052::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:14,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:14,052::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:14,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:14,053::__init__::225::IOProcess::(_processLogs) (8204) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:14,053::__init__::225::IOProcess::(_processLogs) (8204) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:14,053::__init__::225::IOProcess::(_processLogs) DEBUG|(8204) Building response >Thread-19::DEBUG::2014-09-09 11:45:14,053::__init__::225::IOProcess::(_processLogs) (8204) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:14,053::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:14,054::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:14,054::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:14,054::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:45:14,054::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:14,054::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:14,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) (8205) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) (8205) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) (8205) Building response >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) (8205) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:14,055::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) (8206) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) (8206) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) (8206) Building response >Thread-19::DEBUG::2014-09-09 11:45:14,056::__init__::225::IOProcess::(_processLogs) (8206) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:14,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:14,057::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:14,057::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:14,057::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:45:14,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) (8207) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) (8207) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) (8207) Building response >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) (8207) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:14,058::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:45:14,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:14,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0910473 s, 11.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:15,811::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:15,812::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3898::DEBUG::2014-09-09 11:45:15,813::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:16,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:16,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896503 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:45:18,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:18,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898085 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:18,824::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:18,825::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3899::DEBUG::2014-09-09 11:45:18,826::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:18,863::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:18,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:18,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:18,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:18,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:18,864::__init__::225::IOProcess::(_processLogs) (8208) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:18,864::__init__::225::IOProcess::(_processLogs) (8208) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:18,864::__init__::225::IOProcess::(_processLogs) (8208) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:18,865::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:45:18,865::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:45:18,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106699 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:18,872::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:18,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:18,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:18,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:18,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:18,873::__init__::225::IOProcess::(_processLogs) (8209) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:18,873::__init__::225::IOProcess::(_processLogs) (8209) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:18,873::__init__::225::IOProcess::(_processLogs) (8209) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:18,874::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:45:20,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:20,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896433 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:21,835::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:21,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3900::DEBUG::2014-09-09 11:45:21,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`1396717c-1b51-49d1-93a5-d37f5510cef9`::moving from state init -> state preparing >Thread-3900::INFO::2014-09-09 11:45:21,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3900::INFO::2014-09-09 11:45:21,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106699', 'lastCheck': '3.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926198', 'lastCheck': '7.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000894322', 'lastCheck': '8.6', 'valid': True}} >Thread-3900::DEBUG::2014-09-09 11:45:21,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`1396717c-1b51-49d1-93a5-d37f5510cef9`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106699', 'lastCheck': '3.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926198', 'lastCheck': '7.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000894322', 'lastCheck': '8.6', 'valid': True}} >Thread-3900::DEBUG::2014-09-09 11:45:21,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`1396717c-1b51-49d1-93a5-d37f5510cef9`::moving from state preparing -> state finished >Thread-3900::DEBUG::2014-09-09 11:45:21,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3900::DEBUG::2014-09-09 11:45:21,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3900::DEBUG::2014-09-09 11:45:21,837::task::993::Storage.TaskManager.Task::(_decref) Task=`1396717c-1b51-49d1-93a5-d37f5510cef9`::ref 0 aborting False >Thread-3900::DEBUG::2014-09-09 11:45:21,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:21,849::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:21,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3901::DEBUG::2014-09-09 11:45:21,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:22,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:22,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089755 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:23,277::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) (8210) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) (8210) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:23,278::__init__::225::IOProcess::(_processLogs) (8210) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:23,279::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:45:23,279::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:45:23,286::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00100453 s, 353 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:23,286::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:23,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:23,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:23,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:23,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:23,287::__init__::225::IOProcess::(_processLogs) (8211) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:23,287::__init__::225::IOProcess::(_processLogs) (8211) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:23,287::__init__::225::IOProcess::(_processLogs) (8211) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:23,287::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:23,288::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:23,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3902::DEBUG::2014-09-09 11:45:23,289::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3902::DEBUG::2014-09-09 11:45:23,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`587fea64-6df8-46db-81d8-0394ef8f56ca`::moving from state init -> state preparing >Thread-3902::INFO::2014-09-09 11:45:23,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3902::INFO::2014-09-09 11:45:23,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3902::DEBUG::2014-09-09 11:45:23,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`587fea64-6df8-46db-81d8-0394ef8f56ca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3902::DEBUG::2014-09-09 11:45:23,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`587fea64-6df8-46db-81d8-0394ef8f56ca`::moving from state preparing -> state finished >Thread-3902::DEBUG::2014-09-09 11:45:23,291::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3902::DEBUG::2014-09-09 11:45:23,291::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3902::DEBUG::2014-09-09 11:45:23,291::task::993::Storage.TaskManager.Task::(_decref) Task=`587fea64-6df8-46db-81d8-0394ef8f56ca`::ref 0 aborting False >Thread-3902::DEBUG::2014-09-09 11:45:23,291::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3902::DEBUG::2014-09-09 11:45:23,291::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:23,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:23,379::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3903::DEBUG::2014-09-09 11:45:23,379::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3903::DEBUG::2014-09-09 11:45:23,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cab9ad4-a3b2-40f2-bab7-5b734e60f6d7`::moving from state init -> state preparing >Thread-3903::INFO::2014-09-09 11:45:23,380::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3903::DEBUG::2014-09-09 11:45:23,380::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1d743e86-aa2f-4f06-837c-f72528387f9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3903::DEBUG::2014-09-09 11:45:23,380::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3903::DEBUG::2014-09-09 11:45:23,381::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3903::DEBUG::2014-09-09 11:45:23,381::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1d743e86-aa2f-4f06-837c-f72528387f9c`::Granted request >Thread-3903::DEBUG::2014-09-09 11:45:23,381::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0cab9ad4-a3b2-40f2-bab7-5b734e60f6d7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3903::DEBUG::2014-09-09 11:45:23,381::task::993::Storage.TaskManager.Task::(_decref) Task=`0cab9ad4-a3b2-40f2-bab7-5b734e60f6d7`::ref 1 aborting False >Thread-3903::INFO::2014-09-09 11:45:23,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3903::DEBUG::2014-09-09 11:45:23,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cab9ad4-a3b2-40f2-bab7-5b734e60f6d7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3903::DEBUG::2014-09-09 11:45:23,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cab9ad4-a3b2-40f2-bab7-5b734e60f6d7`::moving from state preparing -> state finished >Thread-3903::DEBUG::2014-09-09 11:45:23,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3903::DEBUG::2014-09-09 11:45:23,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3903::DEBUG::2014-09-09 11:45:23,383::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3903::DEBUG::2014-09-09 11:45:23,383::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3903::DEBUG::2014-09-09 11:45:23,383::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3903::DEBUG::2014-09-09 11:45:23,383::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3903::DEBUG::2014-09-09 11:45:23,384::task::993::Storage.TaskManager.Task::(_decref) Task=`0cab9ad4-a3b2-40f2-bab7-5b734e60f6d7`::ref 0 aborting False >Thread-3903::DEBUG::2014-09-09 11:45:23,384::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3903::DEBUG::2014-09-09 11:45:23,384::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:24,058::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:24,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:24,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:24,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:24,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:24,059::__init__::225::IOProcess::(_processLogs) (8212) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:24,059::__init__::225::IOProcess::(_processLogs) (8212) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:24,059::__init__::225::IOProcess::(_processLogs) (8212) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:24,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:45:24,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:24,060::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:45:24,067::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000997401 s, 549 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) (8213) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:24,068::__init__::225::IOProcess::(_processLogs) (8213) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:24,069::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8213) Building response >Thread-19::DEBUG::2014-09-09 11:45:24,069::__init__::225::IOProcess::(_processLogs) (8213) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:24,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:24,069::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:24,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) (8214) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) (8214) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) (8214) Building response >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) (8214) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:45:24,071::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) (8215) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) (8215) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) (8215) Building response >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) (8215) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:24,072::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:24,073::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:24,073::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:45:24,073::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:24,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:24,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:24,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) (8216) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) (8216) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) (8216) Building response >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) (8216) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:24,074::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:45:24,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:25,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895455 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:25,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:25,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3904::DEBUG::2014-09-09 11:45:25,187::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:25,335::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:25,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3905::DEBUG::2014-09-09 11:45:25,336::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.create' in bridge with {u'preallocate': 1, u'volFormat': 5, u'srcImgUUID': u'00000000-0000-0000-0000-000000000000', u'volumeID': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', u'imageID': u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f', u'desc': u'OVF_STORE', u'diskType': 2, u'srcVolUUID': u'00000000-0000-0000-0000-000000000000', u'size': u'134217728'} >Thread-3905::DEBUG::2014-09-09 11:45:25,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::moving from state init -> state preparing >Thread-3905::INFO::2014-09-09 11:45:25,337::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', size=u'134217728', volFormat=5, preallocate=1, diskType=2, volUUID=u'7a8d5544-0400-4021-bab0-deb0c0958ca6', desc=u'OVF_STORE', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000') >Thread-3905::DEBUG::2014-09-09 11:45:25,337::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`6354009d-5436-4f73-9da1-5d5a2a7e4aaa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-3905::DEBUG::2014-09-09 11:45:25,337::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3905::DEBUG::2014-09-09 11:45:25,337::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3905::DEBUG::2014-09-09 11:45:25,338::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`6354009d-5436-4f73-9da1-5d5a2a7e4aaa`::Granted request >Thread-3905::DEBUG::2014-09-09 11:45:25,338::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3905::DEBUG::2014-09-09 11:45:25,339::task::993::Storage.TaskManager.Task::(_decref) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:45:25,339::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,339::__init__::225::IOProcess::(_processLogs) Message size is 71 >Thread-19::DEBUG::2014-09-09 11:45:25,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,339::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) (8217) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) (8217) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) (8217) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) (8217) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,340::__init__::225::IOProcess::(_processLogs) Message size is 75 >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) (8218) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) (8218) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) (8218) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) (8218) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Message size is 87 >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) (8219) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) (8219) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) (8219) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) (8219) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) Message size is 124 >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,343::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) (8220) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) (8220) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) (8220) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) (8220) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,344::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) Message size is 133 >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) (8221) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,345::__init__::225::IOProcess::(_processLogs) (8221) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) (8221) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) (8221) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Message size is 140 >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,347::__init__::225::IOProcess::(_processLogs) (8222) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,347::__init__::225::IOProcess::(_processLogs) (8222) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,347::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8222) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,347::__init__::225::IOProcess::(_processLogs) (8222) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,347::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) (8223) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,348::__init__::225::IOProcess::(_processLogs) (8223) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8223) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) (8223) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 11:45:25,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,350::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,350::__init__::225::IOProcess::(_processLogs) (8224) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,350::__init__::225::IOProcess::(_processLogs) (8224) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,432::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8224) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,432::__init__::225::IOProcess::(_processLogs) (8224) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,432::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,433::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,433::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,433::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:25,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,433::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,434::__init__::225::IOProcess::(_processLogs) (8225) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:25,434::__init__::225::IOProcess::(_processLogs) (8225) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:25,435::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8225) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,435::__init__::225::IOProcess::(_processLogs) (8225) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,435::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-3905::DEBUG::2014-09-09 11:45:25,435::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,436::__init__::225::IOProcess::(_processLogs) (8226) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:25,437::__init__::225::IOProcess::(_processLogs) (8226) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:25,437::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8226) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,437::__init__::225::IOProcess::(_processLogs) (8226) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,437::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:25,437::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) (8227) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) (8227) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) (8227) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) (8227) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,438::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) (8228) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,439::__init__::225::IOProcess::(_processLogs) (8228) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,440::__init__::225::IOProcess::(_processLogs) (8228) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,440::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) (8229) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:25,441::__init__::225::IOProcess::(_processLogs) (8229) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:25,822::__init__::225::IOProcess::(_processLogs) DEBUG|(8229) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,822::__init__::225::IOProcess::(_processLogs) (8229) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,822::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) (8230) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) (8230) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:25,823::__init__::225::IOProcess::(_processLogs) DEBUG|(8230) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,824::__init__::225::IOProcess::(_processLogs) (8230) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,824::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 72 >Thread-3905::WARNING::2014-09-09 11:45:25,824::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,825::__init__::225::IOProcess::(_processLogs) (8231) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:25,826::__init__::225::IOProcess::(_processLogs) (8231) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:25,826::__init__::225::IOProcess::(_processLogs) DEBUG|(8231) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,826::__init__::225::IOProcess::(_processLogs) (8231) Queuing response >Thread-3905::WARNING::2014-09-09 11:45:25,826::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:25,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,827::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,827::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,827::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:25,827::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,827::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,828::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,828::__init__::225::IOProcess::(_processLogs) (8232) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:25,828::__init__::225::IOProcess::(_processLogs) (8232) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:25,830::__init__::225::IOProcess::(_processLogs) DEBUG|(8232) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,830::__init__::225::IOProcess::(_processLogs) (8232) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,830::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) (8233) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,831::__init__::225::IOProcess::(_processLogs) (8233) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:25,834::__init__::225::IOProcess::(_processLogs) DEBUG|(8233) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,834::__init__::225::IOProcess::(_processLogs) (8233) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,834::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,834::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) (8234) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,835::__init__::225::IOProcess::(_processLogs) (8234) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:25,836::__init__::225::IOProcess::(_processLogs) DEBUG|(8234) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,836::__init__::225::IOProcess::(_processLogs) (8234) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,836::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) (8235) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) (8235) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:25,837::__init__::225::IOProcess::(_processLogs) DEBUG|(8235) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,838::__init__::225::IOProcess::(_processLogs) (8235) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,838::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3905::DEBUG::2014-09-09 11:45:25,838::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-19::DEBUG::2014-09-09 11:45:25,838::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3905::INFO::2014-09-09 11:45:25,838::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-3905::DEBUG::2014-09-09 11:45:25,839::task::1183::Storage.TaskManager.Task::(prepare) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::Prepare: 1 jobs exist, move to acquiring >Thread-3905::DEBUG::2014-09-09 11:45:25,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-09-09 11:45:25,839::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,839::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:25,839::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,839::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,839::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) (8236) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) (8236) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) DEBUG|(8236) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) (8236) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,840::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3905::DEBUG::2014-09-09 11:45:25,840::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,842::__init__::225::IOProcess::(_processLogs) (8237) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:25,842::__init__::225::IOProcess::(_processLogs) (8237) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:25,842::__init__::225::IOProcess::(_processLogs) DEBUG|(8237) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,842::__init__::225::IOProcess::(_processLogs) (8237) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,842::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,842::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,843::__init__::225::IOProcess::(_processLogs) (8238) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) (8238) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) (8238) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) (8238) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,845::__init__::225::IOProcess::(_processLogs) (8239) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:25,845::__init__::225::IOProcess::(_processLogs) (8239) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:25,846::__init__::225::IOProcess::(_processLogs) DEBUG|(8239) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,846::__init__::225::IOProcess::(_processLogs) (8239) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,846::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) (8240) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:25,847::__init__::225::IOProcess::(_processLogs) (8240) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:25,989::__init__::225::IOProcess::(_processLogs) DEBUG|(8240) Building response >Thread-19::DEBUG::2014-09-09 11:45:25,989::__init__::225::IOProcess::(_processLogs) (8240) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:25,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:25,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:25,991::__init__::225::IOProcess::(_processLogs) (8241) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:25,991::__init__::225::IOProcess::(_processLogs) (8241) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:26,056::__init__::225::IOProcess::(_processLogs) DEBUG|(8241) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,056::__init__::225::IOProcess::(_processLogs) (8241) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,056::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,057::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:26,057::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,057::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:26,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,057::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-3905::WARNING::2014-09-09 11:45:26,057::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:26,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,058::__init__::225::IOProcess::(_processLogs) (8242) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) (8242) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) (8242) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) (8242) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,060::__init__::225::IOProcess::(_processLogs) (8243) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:26,060::__init__::225::IOProcess::(_processLogs) (8243) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:26,060::__init__::225::IOProcess::(_processLogs) DEBUG|(8243) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,060::__init__::225::IOProcess::(_processLogs) (8243) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,060::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3905::WARNING::2014-09-09 11:45:26,060::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:26,061::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,061::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,061::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:26,061::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,062::__init__::225::IOProcess::(_processLogs) (8244) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:26,062::__init__::225::IOProcess::(_processLogs) (8244) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:26,064::__init__::225::IOProcess::(_processLogs) DEBUG|(8244) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,064::__init__::225::IOProcess::(_processLogs) (8244) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,064::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,064::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) (8245) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,065::__init__::225::IOProcess::(_processLogs) (8245) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:26,068::__init__::225::IOProcess::(_processLogs) DEBUG|(8245) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,068::__init__::225::IOProcess::(_processLogs) (8245) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,068::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,069::__init__::225::IOProcess::(_processLogs) Sending response sized 97 >Thread-19::DEBUG::2014-09-09 11:45:26,069::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,069::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:26,069::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) (8246) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) (8246) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) (8246) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) (8246) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,070::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,071::__init__::225::IOProcess::(_processLogs) (8247) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:26,071::__init__::225::IOProcess::(_processLogs) (8247) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:26,140::__init__::225::IOProcess::(_processLogs) DEBUG|(8247) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,140::__init__::225::IOProcess::(_processLogs) (8247) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,140::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,140::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,140::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,140::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) (8248) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) (8248) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) DEBUG|(8248) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) (8248) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,141::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,142::__init__::225::IOProcess::(_processLogs) (8249) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:26,143::__init__::225::IOProcess::(_processLogs) (8249) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:26,143::__init__::225::IOProcess::(_processLogs) DEBUG|(8249) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,143::__init__::225::IOProcess::(_processLogs) (8249) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,143::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3905::DEBUG::2014-09-09 11:45:26,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-09-09 11:45:26,143::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,144::__init__::225::IOProcess::(_processLogs) (8250) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:26,145::__init__::225::IOProcess::(_processLogs) (8250) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:26,145::__init__::225::IOProcess::(_processLogs) DEBUG|(8250) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,145::__init__::225::IOProcess::(_processLogs) (8250) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,145::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3905::DEBUG::2014-09-09 11:45:26,145::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:26,145::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) (8251) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:26,146::__init__::225::IOProcess::(_processLogs) (8251) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:26,147::__init__::225::IOProcess::(_processLogs) DEBUG|(8251) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,147::__init__::225::IOProcess::(_processLogs) (8251) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,147::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,147::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,148::__init__::225::IOProcess::(_processLogs) (8252) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) (8252) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) (8252) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) (8252) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,150::__init__::225::IOProcess::(_processLogs) (8253) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,150::__init__::225::IOProcess::(_processLogs) (8253) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:26,151::__init__::225::IOProcess::(_processLogs) DEBUG|(8253) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,151::__init__::225::IOProcess::(_processLogs) (8253) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,151::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) Message size is 646 >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) (8254) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:26,152::__init__::225::IOProcess::(_processLogs) (8254) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:26,274::__init__::225::IOProcess::(_processLogs) DEBUG|(8254) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,274::__init__::225::IOProcess::(_processLogs) (8254) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,274::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,274::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:26,274::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,274::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) (8255) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:26,275::__init__::225::IOProcess::(_processLogs) (8255) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:26,340::__init__::225::IOProcess::(_processLogs) DEBUG|(8255) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,341::__init__::225::IOProcess::(_processLogs) (8255) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,341::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,341::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:26,341::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,341::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:26,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,342::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-3905::WARNING::2014-09-09 11:45:26,342::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:26,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) (8256) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) (8256) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) (8256) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) (8256) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,343::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) (8257) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) (8257) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) DEBUG|(8257) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) (8257) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,344::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3905::WARNING::2014-09-09 11:45:26,344::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:26,345::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,345::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) (8258) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:26,346::__init__::225::IOProcess::(_processLogs) (8258) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:26,348::__init__::225::IOProcess::(_processLogs) DEBUG|(8258) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) (8258) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,350::__init__::225::IOProcess::(_processLogs) (8259) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,350::__init__::225::IOProcess::(_processLogs) (8259) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:26,353::__init__::225::IOProcess::(_processLogs) (8259) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,353::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-19::DEBUG::2014-09-09 11:45:26,353::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:26,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) (8260) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) (8260) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) (8260) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) (8260) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:26,354::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:26,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,355::__init__::225::IOProcess::(_processLogs) (8261) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:26,355::__init__::225::IOProcess::(_processLogs) (8261) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:26,399::__init__::225::IOProcess::(_processLogs) (8261) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,400::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,400::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:26,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) (8262) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) (8262) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) (8262) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) (8262) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:26,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,402::__init__::225::IOProcess::(_processLogs) (8263) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:26,402::__init__::225::IOProcess::(_processLogs) (8263) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:26,403::__init__::225::IOProcess::(_processLogs) (8263) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,403::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,403::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) (8264) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) (8264) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:26,404::__init__::225::IOProcess::(_processLogs) (8264) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) (8265) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:26,405::__init__::225::IOProcess::(_processLogs) (8265) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:26,406::__init__::225::IOProcess::(_processLogs) (8265) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,406::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3905::DEBUG::2014-09-09 11:45:26,406::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3905::DEBUG::2014-09-09 11:45:26,406::taskManager::64::Storage.TaskManager::(_queueTask) task queued: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-7::DEBUG::2014-09-09 11:45:26,407::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-3905::DEBUG::2014-09-09 11:45:26,407::task::1188::Storage.TaskManager.Task::(prepare) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::returning >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:26,407::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 running: <bound method Task.commit of <storage.task.Task instance at 0x7f6b38392248>> with: None >Thread-3905::DEBUG::2014-09-09 11:45:26,407::task::993::Storage.TaskManager.Task::(_decref) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::ref 0 aborting False >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:26,408::task::1200::Storage.TaskManager.Task::(commit) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::committing task: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3905::DEBUG::2014-09-09 11:45:26,408::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.create' in bridge with ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:26,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::moving from state queued -> state running >Thread-3905::DEBUG::2014-09-09 11:45:26,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:26,409::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:26,410::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) (8266) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) (8266) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:26,411::__init__::225::IOProcess::(_processLogs) (8266) Queuing response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:26,411::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:26,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,412::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,412::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:26,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,413::__init__::225::IOProcess::(_processLogs) (8267) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:26,413::__init__::225::IOProcess::(_processLogs) (8267) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:26,413::__init__::225::IOProcess::(_processLogs) (8267) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,414::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:26,414::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:26,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) (8268) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) (8268) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) (8268) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) (8268) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,416::__init__::225::IOProcess::(_processLogs) (8269) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:26,416::__init__::225::IOProcess::(_processLogs) (8269) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:26,416::__init__::225::IOProcess::(_processLogs) (8269) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,417::__init__::225::IOProcess::(_processLogs) (8269) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,417::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:26,417::__init__::225::IOProcess::(_processLogs) (8269) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,417::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) (8269) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) (8270) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:26,418::__init__::225::IOProcess::(_processLogs) (8270) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:26,808::__init__::225::IOProcess::(_processLogs) (8269) Queuing responseDEBUG|(8270) Building response >Thread-19::DEBUG::2014-09-09 11:45:26,809::__init__::225::IOProcess::(_processLogs) (8270) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:26,809::__init__::225::IOProcess::(_processLogs) (8269) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:26,809::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:26,809::__init__::225::IOProcess::(_processLogs) (8269) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:26,809::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) (8271) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:26,810::__init__::225::IOProcess::(_processLogs) (8271) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8271) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) (8271) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:27,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,027::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:27,027::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:27,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) (8272) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) (8272) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) (8272) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) (8272) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:27,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) (8273) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) (8273) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8273) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,029::__init__::225::IOProcess::(_processLogs) (8273) Queuing response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:27,029::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:27,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,030::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) (8274) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:27,031::__init__::225::IOProcess::(_processLogs) (8274) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:27,033::__init__::225::IOProcess::(_processLogs) DEBUG|(8274) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,033::__init__::225::IOProcess::(_processLogs) (8274) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,033::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) (8275) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,034::__init__::225::IOProcess::(_processLogs) (8275) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:27,037::__init__::225::IOProcess::(_processLogs) (8275) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,037::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 142 >Thread-19::DEBUG::2014-09-09 11:45:27,038::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,038::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:27,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,038::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) (8276) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) (8276) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) (8276) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) (8276) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,039::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,040::__init__::225::IOProcess::(_processLogs) (8277) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:27,040::__init__::225::IOProcess::(_processLogs) (8277) Got request for method 'unlink' >Dummy-97::DEBUG::2014-09-09 11:45:27,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:27,188::__init__::225::IOProcess::(_processLogs) DEBUG|(8277) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,188::__init__::225::IOProcess::(_processLogs) (8277) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,189::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,191::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,191::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:27,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,194::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,194::__init__::225::IOProcess::(_processLogs) (8278) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:27,195::__init__::225::IOProcess::(_processLogs) (8278) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:27,195::__init__::225::IOProcess::(_processLogs) (8278) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,196::__init__::225::IOProcess::(_processLogs) (8278) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,197::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Dummy-97::DEBUG::2014-09-09 11:45:27,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097036 s, 10.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:27,198::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,198::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:27,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,201::__init__::225::IOProcess::(_processLogs) (8279) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:27,201::__init__::225::IOProcess::(_processLogs) (8279) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:27,202::__init__::225::IOProcess::(_processLogs) DEBUG|(8279) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,203::__init__::225::IOProcess::(_processLogs) (8279) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,203::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,204::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,205::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:27,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,207::__init__::225::IOProcess::(_processLogs) (8280) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,208::__init__::225::IOProcess::(_processLogs) DEBUG|(8280) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:27,208::__init__::225::IOProcess::(_processLogs) (8280) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,209::__init__::225::IOProcess::(_processLogs) (8280) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,210::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,210::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,210::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:27,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,211::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,213::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,213::task::905::Storage.TaskManager.Task::(_runJobs) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f6bb424df50>> (args: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f', u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', 262144, 5, 1, 2, u'7a8d5544-0400-4021-bab0-deb0c0958ca6', u'OVF_STORE', u'00000000-0000-0000-0000-000000000000', u'00000000-0000-0000-0000-000000000000') kwargs: {}) >Thread-19::DEBUG::2014-09-09 11:45:27,213::__init__::225::IOProcess::(_processLogs) (8281) Finding callback 'lexists'... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,214::task::331::Storage.TaskManager.Task::(run) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f6bb424df50>> (args: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f', u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', 262144, 5, 1, 2, u'7a8d5544-0400-4021-bab0-deb0c0958ca6', u'OVF_STORE', u'00000000-0000-0000-0000-000000000000', u'00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >Thread-19::DEBUG::2014-09-09 11:45:27,214::__init__::225::IOProcess::(_processLogs) (8281) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:27,215::__init__::225::IOProcess::(_processLogs) (8281) Building response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,216::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008`ReqID=`48fda471-7fb9-421e-93d0-941d036d2dc9`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1817' at 'createVolume' >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,216::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' for lock type 'exclusive' >Thread-19::DEBUG::2014-09-09 11:45:27,216::__init__::225::IOProcess::(_processLogs) (8281) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,219::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,219::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,220::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-19::DEBUG::2014-09-09 11:45:27,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,222::__init__::225::IOProcess::(_processLogs) (8282) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:45:27,222::__init__::225::IOProcess::(_processLogs) (8282) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:45:27,223::__init__::225::IOProcess::(_processLogs) DEBUG|(8282) Building response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,223::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image f3610f26-4317-4ca8-8c1a-ffe5f2fad008 does not exist in domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:45:27,224::__init__::225::IOProcess::(_processLogs) (8282) Queuing response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,224::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' is free. Now locking as 'exclusive' (1 active user) >Thread-19::DEBUG::2014-09-09 11:45:27,225::__init__::225::IOProcess::(_processLogs) Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,225::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008`ReqID=`48fda471-7fb9-421e-93d0-941d036d2dc9`::Granted request >Thread-19::DEBUG::2014-09-09 11:45:27,225::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::INFO::2014-09-09 11:45:27,227::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f/images/f3610f26-4317-4ca8-8c1a-ffe5f2fad008 for image's volumes >Thread-19::DEBUG::2014-09-09 11:45:27,228::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,228::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:27,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,230::__init__::225::IOProcess::(_processLogs) (8283) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,231::__init__::225::IOProcess::(_processLogs) DEBUG|(8283) Got request for method 'access' >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,231::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:27,232::__init__::225::IOProcess::(_processLogs) (8283) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,232::__init__::225::IOProcess::(_processLogs) (8283) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,233::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,233::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,234::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:27,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,236::__init__::225::IOProcess::(_processLogs) (8284) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,236::__init__::225::IOProcess::(_processLogs) (8284) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,237::__init__::225::IOProcess::(_processLogs) DEBUG|(8284) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,237::__init__::225::IOProcess::(_processLogs) (8284) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,238::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:27,239::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,239::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:27,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,241::__init__::225::IOProcess::(_processLogs) (8285) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,242::__init__::225::IOProcess::(_processLogs) (8285) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,242::__init__::225::IOProcess::(_processLogs) DEBUG|(8285) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,243::__init__::225::IOProcess::(_processLogs) (8285) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,243::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:27,244::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,244::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:27,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,245::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,247::__init__::225::IOProcess::(_processLogs) (8286) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,247::__init__::225::IOProcess::(_processLogs) (8286) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,247::__init__::225::IOProcess::(_processLogs) DEBUG|(8286) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,248::__init__::225::IOProcess::(_processLogs) (8286) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,249::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,250::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,250::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:27,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,251::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,252::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,252::__init__::225::IOProcess::(_processLogs) (8287) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:27,252::__init__::225::IOProcess::(_processLogs) (8287) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:27,652::__init__::225::IOProcess::(_processLogs) DEBUG|(8287) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,652::__init__::225::IOProcess::(_processLogs) (8287) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,652::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) (8288) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:27,653::__init__::225::IOProcess::(_processLogs) (8288) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:27,789::__init__::225::IOProcess::(_processLogs) DEBUG|(8288) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,789::__init__::225::IOProcess::(_processLogs) DEBUG|(8288) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,790::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,790::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:27,790::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,790::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:45:27,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,790::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,791::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,791::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,791::__init__::225::IOProcess::(_processLogs) (8289) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:27,791::__init__::225::IOProcess::(_processLogs) (8289) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:27,896::__init__::225::IOProcess::(_processLogs) DEBUG|(8289) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,896::__init__::225::IOProcess::(_processLogs) (8289) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,896::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,897::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:27,897::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,897::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:27,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,897::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:27,897::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:27,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,898::__init__::225::IOProcess::(_processLogs) (8290) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,898::__init__::225::IOProcess::(_processLogs) (8290) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) (8290) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) (8290) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,899::__init__::225::IOProcess::(_processLogs) (8291) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:27,900::__init__::225::IOProcess::(_processLogs) (8291) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:27,900::__init__::225::IOProcess::(_processLogs) DEBUG|(8291) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,900::__init__::225::IOProcess::(_processLogs) (8291) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,901::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:27,901::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:27,901::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) (8292) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:27,902::__init__::225::IOProcess::(_processLogs) (8292) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:27,904::__init__::225::IOProcess::(_processLogs) DEBUG|(8292) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,904::__init__::225::IOProcess::(_processLogs) (8292) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,904::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) (8293) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,905::__init__::225::IOProcess::(_processLogs) (8293) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:27,908::__init__::225::IOProcess::(_processLogs) DEBUG|(8293) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,908::__init__::225::IOProcess::(_processLogs) (8293) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,909::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,909::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-19::DEBUG::2014-09-09 11:45:27,909::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,909::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:27,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,909::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) (8294) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) (8294) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) (8294) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) (8294) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:27,910::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) (8295) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:27,911::__init__::225::IOProcess::(_processLogs) (8295) Got request for method 'unlink' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:27,929::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3906::DEBUG::2014-09-09 11:45:27,929::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.create' in bridge with {u'preallocate': 1, u'volFormat': 5, u'srcImgUUID': u'00000000-0000-0000-0000-000000000000', u'volumeID': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', u'imageID': u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f', u'desc': u'OVF_STORE', u'diskType': 2, u'srcVolUUID': u'00000000-0000-0000-0000-000000000000', u'size': u'134217728'} >JsonRpcServer::DEBUG::2014-09-09 11:45:27,929::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3906::DEBUG::2014-09-09 11:45:27,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::moving from state init -> state preparing >Thread-3906::INFO::2014-09-09 11:45:27,931::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', size=u'134217728', volFormat=5, preallocate=1, diskType=2, volUUID=u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', desc=u'OVF_STORE', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000') >Thread-3906::DEBUG::2014-09-09 11:45:27,931::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`c7803de6-d9dd-4b4c-a19e-84445c2e3317`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-3906::DEBUG::2014-09-09 11:45:27,931::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3906::DEBUG::2014-09-09 11:45:27,931::resourceManager::566::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-3906::DEBUG::2014-09-09 11:45:27,931::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`c7803de6-d9dd-4b4c-a19e-84445c2e3317`::Granted request >Thread-3906::DEBUG::2014-09-09 11:45:27,931::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3906::DEBUG::2014-09-09 11:45:27,932::task::993::Storage.TaskManager.Task::(_decref) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:45:27,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,932::__init__::225::IOProcess::(_processLogs) Message size is 71 >Thread-19::DEBUG::2014-09-09 11:45:27,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,932::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) (8296) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) (8296) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) (8296) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) (8296) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,933::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) Message size is 75 >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,934::__init__::225::IOProcess::(_processLogs) (8297) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) (8297) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) (8297) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) (8297) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) Message size is 87 >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,935::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) (8298) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) (8298) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) (8298) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) (8298) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,936::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) Message size is 124 >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,937::__init__::225::IOProcess::(_processLogs) (8299) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) (8299) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) (8299) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) (8299) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) Message size is 133 >Thread-19::DEBUG::2014-09-09 11:45:27,938::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) (8300) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) (8300) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) (8300) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) (8300) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,939::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) Message size is 140 >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) (8301) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) (8301) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,940::__init__::225::IOProcess::(_processLogs) DEBUG|(8301) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) (8301) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) Message size is 146 >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,941::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,942::__init__::225::IOProcess::(_processLogs) (8302) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,942::__init__::225::IOProcess::(_processLogs) (8302) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,942::__init__::225::IOProcess::(_processLogs) DEBUG|(8302) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) DEBUG|(8302) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) Sending response sized 62 >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,944::__init__::225::IOProcess::(_processLogs) (8303) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,944::__init__::225::IOProcess::(_processLogs) (8303) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,945::__init__::225::IOProcess::(_processLogs) DEBUG|(8303) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,945::__init__::225::IOProcess::(_processLogs) (8303) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,945::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,945::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) (8304) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) (8304) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,946::__init__::225::IOProcess::(_processLogs) DEBUG|(8304) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,947::__init__::225::IOProcess::(_processLogs) (8304) Queuing response >Thread-3906::DEBUG::2014-09-09 11:45:27,947::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:27,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) (8305) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,948::__init__::225::IOProcess::(_processLogs) (8305) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,949::__init__::225::IOProcess::(_processLogs) DEBUG|(8305) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,949::__init__::225::IOProcess::(_processLogs) (8305) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,950::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:27,950::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,950::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:27,950::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) (8306) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) (8306) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) (8306) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) (8306) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,951::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) (8307) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) (8307) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,952::__init__::225::IOProcess::(_processLogs) DEBUG|(8307) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,953::__init__::225::IOProcess::(_processLogs) (8307) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) (8308) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:27,954::__init__::225::IOProcess::(_processLogs) (8308) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) DEBUG|(8295) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) (8295) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:27,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) (8309) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) (8309) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) (8309) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) (8309) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) (8310) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:27,957::__init__::225::IOProcess::(_processLogs) (8310) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:27,958::__init__::225::IOProcess::(_processLogs) DEBUG|(8310) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,958::__init__::225::IOProcess::(_processLogs) (8310) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,958::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,958::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) (8311) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,959::__init__::225::IOProcess::(_processLogs) (8311) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:27,960::__init__::225::IOProcess::(_processLogs) DEBUG|(8311) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,960::__init__::225::IOProcess::(_processLogs) (8311) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,960::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,960::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,960::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,960::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) (8312) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) (8312) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) DEBUG|(8312) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,961::__init__::225::IOProcess::(_processLogs) (8312) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,962::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,962::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::INFO::2014-09-09 11:45:27,964::volume::415::Storage.Volume::(create) Creating volume 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:45:27,964::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,964::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:27,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) (8313) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) (8313) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) DEBUG|(8313) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) (8313) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,965::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:27,965::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:27,966::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,966::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,966::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:27,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,966::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) (8314) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) (8314) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) DEBUG|(8314) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) (8314) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,967::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,968::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:27,968::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,968::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:27,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,968::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) (8315) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) (8315) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) (8315) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) (8315) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,969::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) (8316) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) (8316) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) DEBUG|(8316) Building response >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) (8316) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:27,970::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:27,971::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:27,971::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:27,971::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:27,971::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:27,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:27,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:27,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:27,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:27,972::__init__::225::IOProcess::(_processLogs) (8317) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:27,972::__init__::225::IOProcess::(_processLogs) (8317) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:28,072::__init__::225::IOProcess::(_processLogs) DEBUG|(8308) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,072::__init__::225::IOProcess::(_processLogs) (8308) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,072::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,072::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) (8318) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,073::__init__::225::IOProcess::(_processLogs) (8318) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:28,074::__init__::225::IOProcess::(_processLogs) DEBUG|(8318) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,074::__init__::225::IOProcess::(_processLogs) (8318) Queuing response >Thread-3906::WARNING::2014-09-09 11:45:28,074::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:28,075::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,075::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:28,075::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:28,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,076::__init__::225::IOProcess::(_processLogs) (8319) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:28,076::__init__::225::IOProcess::(_processLogs) (8319) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:28,077::__init__::225::IOProcess::(_processLogs) (8319) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,077::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-3906::WARNING::2014-09-09 11:45:28,077::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:28,078::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,078::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:28,078::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,079::__init__::225::IOProcess::(_processLogs) (8320) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:28,079::__init__::225::IOProcess::(_processLogs) (8320) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:28,081::__init__::225::IOProcess::(_processLogs) DEBUG|(8320) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,081::__init__::225::IOProcess::(_processLogs) (8320) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) (8321) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,082::__init__::225::IOProcess::(_processLogs) (8321) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:28,085::__init__::225::IOProcess::(_processLogs) DEBUG|(8321) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,085::__init__::225::IOProcess::(_processLogs) (8321) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) (8322) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,086::__init__::225::IOProcess::(_processLogs) (8322) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:28,087::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|(8322) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,087::__init__::225::IOProcess::(_processLogs) (8322) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,087::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,087::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,087::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,087::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) (8323) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) (8323) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|(8323) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,088::__init__::225::IOProcess::(_processLogs) (8323) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,089::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Generating json... >Thread-3906::DEBUG::2014-09-09 11:45:28,089::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-19::DEBUG::2014-09-09 11:45:28,089::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3906::INFO::2014-09-09 11:45:28,089::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-3906::DEBUG::2014-09-09 11:45:28,090::task::1183::Storage.TaskManager.Task::(prepare) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::Prepare: 1 jobs exist, move to acquiring >Thread-3906::DEBUG::2014-09-09 11:45:28,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-09-09 11:45:28,090::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,090::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:28,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,090::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) (8324) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) (8324) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|(8324) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) (8324) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,091::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Generating json... >Thread-3906::DEBUG::2014-09-09 11:45:28,091::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:28,092::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,092::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) (8325) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) (8325) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|(8325) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,093::__init__::225::IOProcess::(_processLogs) (8325) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,094::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,094::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:28,094::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,094::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:28,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) (8326) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) (8326) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) (8326) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) (8326) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,095::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) (8327) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,096::__init__::225::IOProcess::(_processLogs) (8327) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:28,097::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|(8327) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,097::__init__::225::IOProcess::(_processLogs) (8327) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,097::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,099::__init__::225::IOProcess::(_processLogs) (8328) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:28,099::__init__::225::IOProcess::(_processLogs) (8328) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:28,173::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|(8317) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,173::__init__::225::IOProcess::(_processLogs) (8317) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,173::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,173::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,173::__init__::225::IOProcess::(_processLogs) (8321) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,173::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) (8329) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:28,174::__init__::225::IOProcess::(_processLogs) (8329) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:28,199::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:28,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3907::DEBUG::2014-09-09 11:45:28,201::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:28,599::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|DEBUG|(8329) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,599::__init__::225::IOProcess::(_processLogs) (8329) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,599::__init__::225::IOProcess::(_processLogs) (8328) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,599::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,600::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,600::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,601::__init__::225::IOProcess::(_processLogs) (8330) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) (8330) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) (8331) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:28,602::__init__::225::IOProcess::(_processLogs) (8331) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:28,726::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8330) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,726::__init__::225::IOProcess::(_processLogs) (8330) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,726::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,727::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,727::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,727::__init__::225::IOProcess::(_processLogs) Message size is 559 >Thread-19::DEBUG::2014-09-09 11:45:28,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,727::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,728::__init__::225::IOProcess::(_processLogs) (8332) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:28,728::__init__::225::IOProcess::(_processLogs) (8332) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:28,835::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8331) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,835::__init__::225::IOProcess::(_processLogs) (8331) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,836::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,837::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,838::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:28,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,839::__init__::225::IOProcess::(_processLogs) (8333) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,839::__init__::225::IOProcess::(_processLogs) (8333) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:28,839::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8333) Building response >Thread-3906::WARNING::2014-09-09 11:45:28,839::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) (8333) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,840::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,841::__init__::225::IOProcess::(_processLogs) (8334) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:28,841::__init__::225::IOProcess::(_processLogs) (8334) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:28,849::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8334) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,849::__init__::225::IOProcess::(_processLogs) (8334) Queuing response >Thread-3906::WARNING::2014-09-09 11:45:28,850::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:28,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,850::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) (8335) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:28,851::__init__::225::IOProcess::(_processLogs) (8335) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:28,854::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|(8335) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,854::__init__::225::IOProcess::(_processLogs) (8335) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,854::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,854::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,854::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) (8336) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,855::__init__::225::IOProcess::(_processLogs) (8336) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:28,858::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|(8336) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,858::__init__::225::IOProcess::(_processLogs) (8336) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,858::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,858::__init__::225::IOProcess::(_processLogs) Sending response sized 97 >Thread-19::DEBUG::2014-09-09 11:45:28,858::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) (8337) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) (8337) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:28,859::__init__::225::IOProcess::(_processLogs) (8337) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) (8337) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,860::__init__::225::IOProcess::(_processLogs) (8338) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:28,861::__init__::225::IOProcess::(_processLogs) (8338) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:28,874::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) (8339) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) (8339) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:28,875::__init__::225::IOProcess::(_processLogs) (8334) Queuing responseDEBUG|(8339) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,876::__init__::225::IOProcess::(_processLogs) (8339) Queuing response >Thread-23::DEBUG::2014-09-09 11:45:28,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:28,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,881::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:45:28,883::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00124989 s, 898 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) (8340) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:28,884::__init__::225::IOProcess::(_processLogs) (8340) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:28,885::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8340) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,885::__init__::225::IOProcess::(_processLogs) (8340) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,885::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,886::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:28,941::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8332) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,941::__init__::225::IOProcess::(_processLogs) (8332) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,941::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,941::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:28,941::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,942::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:28,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,942::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:28,942::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:28,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) (8341) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) (8341) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) (8341) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) (8341) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,943::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) (8342) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:28,944::__init__::225::IOProcess::(_processLogs) (8342) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:28,955::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8342) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,955::__init__::225::IOProcess::(_processLogs) (8342) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,955::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:28,955::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:28,956::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,956::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) (8343) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:28,957::__init__::225::IOProcess::(_processLogs) (8343) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:28,959::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8343) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,959::__init__::225::IOProcess::(_processLogs) (8343) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,959::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,959::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:28,959::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) (8344) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:28,960::__init__::225::IOProcess::(_processLogs) (8344) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:28,963::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8344) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,963::__init__::225::IOProcess::(_processLogs) (8344) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,963::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,963::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,964::__init__::225::IOProcess::(_processLogs) (8345) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) (8345) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) (8345) Building response >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) (8345) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:28,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:28,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:28,966::__init__::225::IOProcess::(_processLogs) (8346) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:28,966::__init__::225::IOProcess::(_processLogs) (8346) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:29,099::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8338) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) (8338) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,100::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,101::__init__::225::IOProcess::(_processLogs) (8347) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:29,101::__init__::225::IOProcess::(_processLogs) (8347) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:29,117::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8347) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,117::__init__::225::IOProcess::(_processLogs) (8347) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,117::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) (8348) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:29,118::__init__::225::IOProcess::(_processLogs) (8348) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:29,119::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8348) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,119::__init__::225::IOProcess::(_processLogs) (8348) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,119::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-3906::DEBUG::2014-09-09 11:45:29,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-09-09 11:45:29,120::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,120::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,120::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:29,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,120::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) (8349) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) (8349) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|(8349) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) (8349) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,121::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Generating json... >Thread-3906::DEBUG::2014-09-09 11:45:29,121::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:29,122::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,122::__init__::225::IOProcess::(_processLogs) (8339) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,122::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:29,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) (8350) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) (8350) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:29,123::__init__::225::IOProcess::(_processLogs) (8350) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,124::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:29,124::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:29,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) (8351) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) (8351) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) (8351) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) (8351) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,126::__init__::225::IOProcess::(_processLogs) (8352) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:29,126::__init__::225::IOProcess::(_processLogs) (8352) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:29,126::__init__::225::IOProcess::(_processLogs) (8352) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,126::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,127::__init__::225::IOProcess::(_processLogs) Message size is 646 >Thread-19::DEBUG::2014-09-09 11:45:29,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,128::__init__::225::IOProcess::(_processLogs) (8353) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:29,128::__init__::225::IOProcess::(_processLogs) (8353) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:29,242::__init__::225::IOProcess::(_processLogs) (8346) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,242::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,242::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:45:29,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) (8354) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) (8354) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) (8354) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) (8354) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:45:29,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) (8355) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) (8355) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) (8355) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,244::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,245::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:29,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,245::__init__::225::IOProcess::(_processLogs) (8356) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) (8356) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) (8356) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) (8356) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) (8357) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:29,246::__init__::225::IOProcess::(_processLogs) (8357) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:29,247::__init__::225::IOProcess::(_processLogs) (8357) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,247::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) (8358) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) (8358) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:29,248::__init__::225::IOProcess::(_processLogs) (8358) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) (8359) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:29,249::__init__::225::IOProcess::(_processLogs) (8359) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:29,250::__init__::225::IOProcess::(_processLogs) (8359) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,250::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,250::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:29,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,251::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,251::__init__::225::IOProcess::(_processLogs) (8360) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:29,251::__init__::225::IOProcess::(_processLogs) (8360) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:29,252::__init__::225::IOProcess::(_processLogs) (8360) Queuing response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:29,252::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:45:29,252::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,252::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) (8361) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) (8361) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:29,253::__init__::225::IOProcess::(_processLogs) (8361) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,254::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:29,254::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:29,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) (8362) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) (8362) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) (8362) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) (8362) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,256::__init__::225::IOProcess::(_processLogs) (8363) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:29,256::__init__::225::IOProcess::(_processLogs) (8363) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:29,257::__init__::225::IOProcess::(_processLogs) (8363) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,257::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:45:29,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:29,258::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:29,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,263::__init__::225::IOProcess::(_processLogs) (8364) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:29,263::__init__::225::IOProcess::(_processLogs) (8364) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:45:29,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903553 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:29,654::__init__::225::IOProcess::(_processLogs) DEBUG|(8353) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,654::__init__::225::IOProcess::(_processLogs) (8353) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,655::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:29,655::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) (8365) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:29,656::__init__::225::IOProcess::(_processLogs) (8365) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:29,770::__init__::225::IOProcess::(_processLogs) DEBUG|(8364) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,770::__init__::225::IOProcess::(_processLogs) (8364) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,771::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,771::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:29,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,771::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:29,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,772::__init__::225::IOProcess::(_processLogs) (8366) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:29,772::__init__::225::IOProcess::(_processLogs) (8366) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:29,935::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8365) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,935::__init__::225::IOProcess::(_processLogs) (8365) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,935::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:29,935::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,936::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:29,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,936::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-3906::WARNING::2014-09-09 11:45:29,936::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:29,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) (8367) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) (8367) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) (8367) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) (8367) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,937::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) (8368) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:29,938::__init__::225::IOProcess::(_processLogs) (8368) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:29,939::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8368) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,939::__init__::225::IOProcess::(_processLogs) (8368) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,939::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Generating json... >Thread-3906::WARNING::2014-09-09 11:45:29,939::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:29,940::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,940::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,940::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:29,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,940::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,941::__init__::225::IOProcess::(_processLogs) (8369) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:29,941::__init__::225::IOProcess::(_processLogs) (8369) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:29,943::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8369) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,943::__init__::225::IOProcess::(_processLogs) (8369) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,943::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) (8370) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:29,944::__init__::225::IOProcess::(_processLogs) (8370) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:29,947::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8370) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,947::__init__::225::IOProcess::(_processLogs) (8370) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,947::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,947::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,948::__init__::225::IOProcess::(_processLogs) (8371) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) (8371) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) (8371) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) (8371) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,950::__init__::225::IOProcess::(_processLogs) (8372) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:29,950::__init__::225::IOProcess::(_processLogs) (8372) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:29,976::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|(8366) Building response >Thread-19::DEBUG::2014-09-09 11:45:29,977::__init__::225::IOProcess::(_processLogs) (8366) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:29,977::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:29,977::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:29,977::__init__::225::IOProcess::(_processLogs) Message size is 755DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:29,977::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) (8373) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:29,978::__init__::225::IOProcess::(_processLogs) (8373) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8372) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) (8372) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:30,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) (8374) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) (8374) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) (8374) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) (8374) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,105::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) (8375) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) (8375) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:30,106::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8375) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) (8375) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,108::__init__::225::IOProcess::(_processLogs) (8376) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:30,108::__init__::225::IOProcess::(_processLogs) (8376) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:30,108::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8376) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,108::__init__::225::IOProcess::(_processLogs) (8376) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,108::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) (8377) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:30,109::__init__::225::IOProcess::(_processLogs) (8377) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:30,110::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8377) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,110::__init__::225::IOProcess::(_processLogs) (8377) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,110::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3906::DEBUG::2014-09-09 11:45:30,110::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-19::DEBUG::2014-09-09 11:45:30,110::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3906::DEBUG::2014-09-09 11:45:30,111::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >0f7e9c2a-031b-45af-8672-1df8436a12e2::DEBUG::2014-09-09 11:45:30,111::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-3906::DEBUG::2014-09-09 11:45:30,111::task::1188::Storage.TaskManager.Task::(prepare) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::returning >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:30,112::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 running: <bound method Task.commit of <storage.task.Task instance at 0x7f6b808efc20>> with: None >Thread-3906::DEBUG::2014-09-09 11:45:30,112::task::993::Storage.TaskManager.Task::(_decref) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::ref 0 aborting False >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:30,112::task::1200::Storage.TaskManager.Task::(commit) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::committing task: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3906::DEBUG::2014-09-09 11:45:30,113::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.create' in bridge with 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:30,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::moving from state queued -> state running >Thread-3906::DEBUG::2014-09-09 11:45:30,113::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:30,114::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,115::__init__::225::IOProcess::(_processLogs) (8378) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,116::__init__::225::IOProcess::(_processLogs) (8378) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,116::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8378) Building response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:30,116::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:30,116::__init__::225::IOProcess::(_processLogs) (8378) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) (8379) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,117::__init__::225::IOProcess::(_processLogs) (8379) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,118::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8379) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,118::__init__::225::IOProcess::(_processLogs) (8379) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,118::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:30,118::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:30,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) (8380) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) (8380) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) (8380) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) (8380) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,119::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) (8381) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:30,120::__init__::225::IOProcess::(_processLogs) (8381) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:30,121::__init__::225::IOProcess::(_processLogs) (8381) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,121::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) (8382) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:30,122::__init__::225::IOProcess::(_processLogs) (8382) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:30,169::__init__::225::IOProcess::(_processLogs) (8373) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,169::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) Message size is 559 >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) (8383) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:30,170::__init__::225::IOProcess::(_processLogs) (8383) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:30,420::__init__::225::IOProcess::(_processLogs) (8383) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,420::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:30,420::__init__::225::IOProcess::(_processLogs) Message size is 747 >Thread-19::DEBUG::2014-09-09 11:45:30,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,421::__init__::225::IOProcess::(_processLogs) (8384) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:30,421::__init__::225::IOProcess::(_processLogs) (8384) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:30,587::__init__::225::IOProcess::(_processLogs) (8382) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,587::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) (8385) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:30,588::__init__::225::IOProcess::(_processLogs) (8385) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:30,720::__init__::225::IOProcess::(_processLogs) (8384) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,720::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:30,720::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:30,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,721::__init__::225::IOProcess::(_processLogs) Queuing request... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:30,721::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) (8386) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) (8386) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) (8386) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) (8386) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,722::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) (8387) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) (8387) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:30,723::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8387) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,724::__init__::225::IOProcess::(_processLogs) (8387) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,724::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:45:30,724::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:30,724::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) (8388) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:30,725::__init__::225::IOProcess::(_processLogs) (8388) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:30,727::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8388) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,727::__init__::225::IOProcess::(_processLogs) (8388) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,728::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,729::__init__::225::IOProcess::(_processLogs) (8389) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:30,729::__init__::225::IOProcess::(_processLogs) (8389) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:30,732::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8389) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,732::__init__::225::IOProcess::(_processLogs) (8389) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,732::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,732::__init__::225::IOProcess::(_processLogs) Sending response sized 240 >Thread-19::DEBUG::2014-09-09 11:45:30,732::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,732::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) (8390) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) (8390) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,733::__init__::225::IOProcess::(_processLogs) (8390) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) (8390) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) (8391) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:30,734::__init__::225::IOProcess::(_processLogs) (8391) Got request for method 'unlink' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:30,791::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:30,792::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3908::DEBUG::2014-09-09 11:45:30,792::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.setDescription' in bridge with {u'imageID': u'86f26f6e-82cb-4abe-94fa-3df1ef43debb', u'description': u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"caf02237-e8a4-49fe-ab6d-4d23843f0edf"}],"Last Updated":null}', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'volumeID': u'7d243f90-f6ce-42c5-9b53-ea8cecbfe14c', u'storagedomainID': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf'} >Thread-3908::DEBUG::2014-09-09 11:45:30,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6cae5b8-153f-49ed-8a01-68aca89bad9a`::moving from state init -> state preparing >Thread-3908::INFO::2014-09-09 11:45:30,793::logUtils::44::dispatcher::(wrapper) Run and protect: setVolumeDescription(sdUUID=u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'86f26f6e-82cb-4abe-94fa-3df1ef43debb', volUUID=u'7d243f90-f6ce-42c5-9b53-ea8cecbfe14c', description=u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"caf02237-e8a4-49fe-ab6d-4d23843f0edf"}],"Last Updated":null}', options=None) >Thread-3908::DEBUG::2014-09-09 11:45:30,793::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf`ReqID=`ca8c56df-fc3e-40dd-a31a-649b59c17fcc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1292' at 'setVolumeDescription' >Thread-3908::DEBUG::2014-09-09 11:45:30,793::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' for lock type 'shared' >Thread-3908::DEBUG::2014-09-09 11:45:30,793::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' is free. Now locking as 'shared' (1 active user) >Thread-3908::DEBUG::2014-09-09 11:45:30,793::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf`ReqID=`ca8c56df-fc3e-40dd-a31a-649b59c17fcc`::Granted request >Thread-3908::DEBUG::2014-09-09 11:45:30,794::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a6cae5b8-153f-49ed-8a01-68aca89bad9a`::_resourcesAcquired: Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf (shared) >Thread-3908::DEBUG::2014-09-09 11:45:30,794::task::993::Storage.TaskManager.Task::(_decref) Task=`a6cae5b8-153f-49ed-8a01-68aca89bad9a`::ref 1 aborting False >Thread-3908::DEBUG::2014-09-09 11:45:30,794::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb`ReqID=`7df153b0-91ff-47f6-b948-fa4dd1160ac4`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1884' at 'setVolumeDescription' >Thread-3908::DEBUG::2014-09-09 11:45:30,794::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb' for lock type 'exclusive' >Thread-19::DEBUG::2014-09-09 11:45:30,794::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) (8392) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) (8392) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8385) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,795::__init__::225::IOProcess::(_processLogs) (8385) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,797::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,797::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8393) Finding callback 'listdir'... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:30,797::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:30,797::__init__::225::IOProcess::(_processLogs) (8393) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:30,798::__init__::225::IOProcess::(_processLogs) (8393) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,798::__init__::225::IOProcess::(_processLogs) (8393) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,798::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:30,798::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8392) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,799::__init__::225::IOProcess::(_processLogs) (8392) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,799::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,799::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-09-09 11:45:30,799::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,799::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) (8394) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:30,800::__init__::225::IOProcess::(_processLogs) (8394) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) (8395) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) (8395) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) (8395) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) (8395) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,801::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:30,802::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8394) Building response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:30,802::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:30,802::__init__::225::IOProcess::(_processLogs) (8394) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3908::DEBUG::2014-09-09 11:45:30,803::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7d243f90-f6ce-42c5-9b53-ea8cecbfe14c >Thread-19::DEBUG::2014-09-09 11:45:30,803::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) (8396) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,804::__init__::225::IOProcess::(_processLogs) (8396) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) (8396) Building responseDEBUG|(8397) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) (8397) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) (8396) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Message size is 239 >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) (8398) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) (8398) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8397) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) (8397) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,806::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,807::__init__::225::IOProcess::(_processLogs) (8398) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,807::__init__::225::IOProcess::(_processLogs) (8398) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,807::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,807::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,807::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) (8399) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) (8399) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,808::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) (8400) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) (8400) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8400) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,809::__init__::225::IOProcess::(_processLogs) (8400) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Message size is 251 >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) (8401) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:30,810::__init__::225::IOProcess::(_processLogs) (8401) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8399) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) (8399) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:30,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) (8402) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) (8402) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) (8402) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) (8402) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) (8403) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:30,813::__init__::225::IOProcess::(_processLogs) (8403) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:30,848::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(8401) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,849::__init__::225::IOProcess::(_processLogs) (8401) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,849::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:30,850::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,850::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:45:30,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,850::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) (8404) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) (8404) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) (8404) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) (8404) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:45:30,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,852::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-3908::DEBUG::2014-09-09 11:45:30,852::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7d243f90-f6ce-42c5-9b53-ea8cecbfe14c >Thread-19::DEBUG::2014-09-09 11:45:30,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,852::__init__::225::IOProcess::(_processLogs) (8405) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) (8405) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) (8405) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) (8405) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,853::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) (8406) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) (8406) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) (8406) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,854::__init__::225::IOProcess::(_processLogs) (8406) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) (8407) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) (8407) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) (8407) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) (8407) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,856::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,857::__init__::225::IOProcess::(_processLogs) (8408) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:30,857::__init__::225::IOProcess::(_processLogs) (8408) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:30,859::__init__::225::IOProcess::(_processLogs) DEBUG|(8408) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,859::__init__::225::IOProcess::(_processLogs) (8408) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,859::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,860::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:30,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,860::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:45:30,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,860::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) (8409) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) (8409) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) (8409) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) (8409) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:30,861::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,862::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:45:30,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,862::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-3908::DEBUG::2014-09-09 11:45:30,862::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7d243f90-f6ce-42c5-9b53-ea8cecbfe14c >Thread-19::DEBUG::2014-09-09 11:45:30,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) (8410) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) (8410) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) (8410) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) (8410) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:45:30,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) (8411) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) (8411) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,864::__init__::225::IOProcess::(_processLogs) (8411) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) (8411) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) (8412) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) (8412) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) (8412) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) (8412) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:30,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,867::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,867::__init__::225::IOProcess::(_processLogs) (8413) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:30,867::__init__::225::IOProcess::(_processLogs) (8413) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:30,869::__init__::225::IOProcess::(_processLogs) DEBUG|(8413) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,869::__init__::225::IOProcess::(_processLogs) (8413) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) (8414) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:30,870::__init__::225::IOProcess::(_processLogs) (8414) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:30,872::__init__::225::IOProcess::(_processLogs) (8414) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,873::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 586 >Thread-3908::INFO::2014-09-09 11:45:30,873::image::224::Storage.Image::(getChain) sdUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf imgUUID=86f26f6e-82cb-4abe-94fa-3df1ef43debb chain=[<storage.fileVolume.FileVolume object at 0x7f6bcc018ed0>] >Thread-19::DEBUG::2014-09-09 11:45:30,873::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) (8415) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:30,874::__init__::225::IOProcess::(_processLogs) (8415) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:30,876::__init__::225::IOProcess::(_processLogs) DEBUG|(8415) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,876::__init__::225::IOProcess::(_processLogs) (8415) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3908::DEBUG::2014-09-09 11:45:30,878::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c`ReqID=`03161977-e123-4cda-a1e8-dc3bc526baa5`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-19::DEBUG::2014-09-09 11:45:30,878::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-3908::DEBUG::2014-09-09 11:45:30,878::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c' for lock type 'exclusive' >Thread-3908::DEBUG::2014-09-09 11:45:30,878::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c' is free. Now locking as 'exclusive' (1 active user) >Thread-3908::DEBUG::2014-09-09 11:45:30,878::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c`ReqID=`03161977-e123-4cda-a1e8-dc3bc526baa5`::Granted request >Thread-3908::DEBUG::2014-09-09 11:45:30,879::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb' is free. Now locking as 'exclusive' (1 active user) >Thread-3908::DEBUG::2014-09-09 11:45:30,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb`ReqID=`7df153b0-91ff-47f6-b948-fa4dd1160ac4`::Granted request >Thread-19::DEBUG::2014-09-09 11:45:30,879::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-09-09 11:45:30,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) (8416) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) (8416) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) (8416) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) (8416) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:30,880::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,881::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-09-09 11:45:30,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3908::DEBUG::2014-09-09 11:45:30,881::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7d243f90-f6ce-42c5-9b53-ea8cecbfe14c >Thread-19::DEBUG::2014-09-09 11:45:30,881::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) (8417) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) (8417) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) (8417) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) (8417) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) Message size is 239 >Thread-19::DEBUG::2014-09-09 11:45:30,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) (8418) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) (8418) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) (8418) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) (8418) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,884::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,884::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,884::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-09-09 11:45:30,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,884::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-3908::INFO::2014-09-09 11:45:30,884::volume::593::Storage.Volume::(setDescription) volUUID = 7d243f90-f6ce-42c5-9b53-ea8cecbfe14c descr = {"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"caf02237-e8a4-49fe-ab6d-4d23843f0edf"}],"Last Updated":null} >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) (8419) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) (8419) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) (8419) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) (8419) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,885::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Message size is 251 >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) (8420) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:30,886::__init__::225::IOProcess::(_processLogs) (8420) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:30,888::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8420) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,888::__init__::225::IOProcess::(_processLogs) (8420) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,889::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:30,931::__init__::225::IOProcess::(_processLogs) (8391) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,931::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,931::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:30,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) (8421) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) (8421) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) (8421) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) (8421) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,932::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) (8422) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:30,933::__init__::225::IOProcess::(_processLogs) (8422) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:30,954::__init__::225::IOProcess::(_processLogs) (8422) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,954::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,954::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:45:30,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) (8423) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) (8423) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) (8423) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) (8423) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,955::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) (8424) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:30,956::__init__::225::IOProcess::(_processLogs) (8424) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:30,957::__init__::225::IOProcess::(_processLogs) (8424) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,957::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,957::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:30,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) (8425) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) (8425) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) (8425) Building response >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) (8425) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:30,958::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:30,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,959::__init__::225::IOProcess::(_processLogs) (8426) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:30,959::__init__::225::IOProcess::(_processLogs) (8426) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:30,960::__init__::225::IOProcess::(_processLogs) (8426) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,960::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,960::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:30,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,961::__init__::225::IOProcess::(_processLogs) (8427) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:30,961::__init__::225::IOProcess::(_processLogs) (8427) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:30,961::__init__::225::IOProcess::(_processLogs) (8427) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) (8428) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:30,962::__init__::225::IOProcess::(_processLogs) (8428) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:30,963::__init__::225::IOProcess::(_processLogs) (8428) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:30,963::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:30,963::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-09-09 11:45:30,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:30,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:30,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:30,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:30,964::__init__::225::IOProcess::(_processLogs) (8429) Finding callback 'truncate'... >Thread-19::DEBUG::2014-09-09 11:45:30,964::__init__::225::IOProcess::(_processLogs) (8429) Got request for method 'truncate' >Thread-19::DEBUG::2014-09-09 11:45:31,123::__init__::225::IOProcess::(_processLogs) (8403) Queuing response >Thread-3908::WARNING::2014-09-09 11:45:31,123::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) Message size is 430 >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,124::__init__::225::IOProcess::(_processLogs) (8430) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) (8430) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,125::__init__::225::IOProcess::(_processLogs) (8431) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:31,126::__init__::225::IOProcess::(_processLogs) (8431) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:31,126::__init__::225::IOProcess::(_processLogs) (8431) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,126::__init__::225::IOProcess::(_processLogs) (8431) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,126::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:31,126::__init__::225::IOProcess::(_processLogs) (8430) Queuing response >Thread-3908::DEBUG::2014-09-09 11:45:31,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb' >Thread-19::DEBUG::2014-09-09 11:45:31,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3908::DEBUG::2014-09-09 11:45:31,127::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb' (0 active users) >Thread-19::DEBUG::2014-09-09 11:45:31,128::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3908::DEBUG::2014-09-09 11:45:31,128::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-09-09 11:45:31,128::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-3908::DEBUG::2014-09-09 11:45:31,128::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c' >Thread-19::DEBUG::2014-09-09 11:45:31,129::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-3908::DEBUG::2014-09-09 11:45:31,129::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c' (0 active users) >Thread-19::DEBUG::2014-09-09 11:45:31,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3908::DEBUG::2014-09-09 11:45:31,129::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-09-09 11:45:31,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3908::DEBUG::2014-09-09 11:45:31,130::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.7d243f90-f6ce-42c5-9b53-ea8cecbfe14c', Clearing records. >Thread-19::DEBUG::2014-09-09 11:45:31,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3908::DEBUG::2014-09-09 11:45:31,130::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.86f26f6e-82cb-4abe-94fa-3df1ef43debb', Clearing records. >Thread-19::DEBUG::2014-09-09 11:45:31,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-3908::INFO::2014-09-09 11:45:31,131::logUtils::47::dispatcher::(wrapper) Run and protect: setVolumeDescription, Return response: None >Thread-19::DEBUG::2014-09-09 11:45:31,132::__init__::225::IOProcess::(_processLogs) (8432) Finding callback 'unlink'... >Thread-3908::DEBUG::2014-09-09 11:45:31,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6cae5b8-153f-49ed-8a01-68aca89bad9a`::finished: None >Thread-19::DEBUG::2014-09-09 11:45:31,132::__init__::225::IOProcess::(_processLogs) (8432) Got request for method 'unlink' >Thread-3908::DEBUG::2014-09-09 11:45:31,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6cae5b8-153f-49ed-8a01-68aca89bad9a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-09-09 11:45:31,133::__init__::225::IOProcess::(_processLogs) (8432) Building response >Thread-3908::DEBUG::2014-09-09 11:45:31,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf': < ResourceRef 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-09-09 11:45:31,133::__init__::225::IOProcess::(_processLogs) (8432) Queuing response >Thread-3908::DEBUG::2014-09-09 11:45:31,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 11:45:31,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3908::DEBUG::2014-09-09 11:45:31,134::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' >Thread-19::DEBUG::2014-09-09 11:45:31,134::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3908::DEBUG::2014-09-09 11:45:31,135::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' (0 active users) >Thread-3908::DEBUG::2014-09-09 11:45:31,135::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-09-09 11:45:31,135::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-3908::DEBUG::2014-09-09 11:45:31,136::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf', Clearing records. >Thread-19::DEBUG::2014-09-09 11:45:31,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3908::DEBUG::2014-09-09 11:45:31,136::task::993::Storage.TaskManager.Task::(_decref) Task=`a6cae5b8-153f-49ed-8a01-68aca89bad9a`::ref 0 aborting False >Thread-19::DEBUG::2014-09-09 11:45:31,137::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3908::DEBUG::2014-09-09 11:45:31,137::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.setDescription' in bridge with True >Thread-19::DEBUG::2014-09-09 11:45:31,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3908::DEBUG::2014-09-09 11:45:31,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:31,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,139::__init__::225::IOProcess::(_processLogs) (8433) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:31,139::__init__::225::IOProcess::(_processLogs) (8433) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:31,139::__init__::225::IOProcess::(_processLogs) (8433) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) (8434) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:31,140::__init__::225::IOProcess::(_processLogs) (8434) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:31,141::__init__::225::IOProcess::(_processLogs) (8434) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,141::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,141::task::905::Storage.TaskManager.Task::(_runJobs) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f6bb424df50>> (args: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f', u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', 262144, 5, 1, 2, u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', u'OVF_STORE', u'00000000-0000-0000-0000-000000000000', u'00000000-0000-0000-0000-000000000000') kwargs: {}) >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,141::task::331::Storage.TaskManager.Task::(run) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f6bb424df50>> (args: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f', u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', 262144, 5, 1, 2, u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', u'OVF_STORE', u'00000000-0000-0000-0000-000000000000', u'00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,142::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8`ReqID=`aeb3122b-17d8-40dc-b1ea-5368ae515a5d`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1817' at 'createVolume' >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,142::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' for lock type 'exclusive' >Thread-19::DEBUG::2014-09-09 11:45:31,142::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-19::DEBUG::2014-09-09 11:45:31,142::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,142::__init__::225::IOProcess::(_processLogs) (8435) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:45:31,143::__init__::225::IOProcess::(_processLogs) (8435) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:45:31,143::__init__::225::IOProcess::(_processLogs) (8435) Queuing response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,143::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 9b58299d-0e4c-4799-ba1d-57760aad1bd8 does not exist in domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:45:31,143::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,144::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' is free. Now locking as 'exclusive' (1 active user) >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,144::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8`ReqID=`aeb3122b-17d8-40dc-b1ea-5368ae515a5d`::Granted request >94ac3a4e-5e52-478a-9fba-6b5d490488c5::INFO::2014-09-09 11:45:31,144::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f/images/9b58299d-0e4c-4799-ba1d-57760aad1bd8 for image's volumes >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) (8436) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,145::__init__::225::IOProcess::(_processLogs) (8436) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,146::__init__::225::IOProcess::(_processLogs) (8436) Queuing response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:31,146::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:31,146::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,146::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:31,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,147::__init__::225::IOProcess::(_processLogs) (8437) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,147::__init__::225::IOProcess::(_processLogs) (8437) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,147::__init__::225::IOProcess::(_processLogs) (8437) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,148::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:31,148::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:31,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) (8438) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) (8438) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) (8438) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) (8438) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,150::__init__::225::IOProcess::(_processLogs) (8439) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:31,150::__init__::225::IOProcess::(_processLogs) (8439) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:31,150::__init__::225::IOProcess::(_processLogs) (8439) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,151::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,151::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:31,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,152::__init__::225::IOProcess::(_processLogs) (8440) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:31,152::__init__::225::IOProcess::(_processLogs) (8440) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:31,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:31,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3909::DEBUG::2014-09-09 11:45:31,208::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:31,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:31,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901624 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:31,657::__init__::225::IOProcess::(_processLogs) (8440) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,657::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,657::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,659::__init__::225::IOProcess::(_processLogs) (8441) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:31,659::__init__::225::IOProcess::(_processLogs) (8441) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:31,769::__init__::225::IOProcess::(_processLogs) (8429) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,769::__init__::225::IOProcess::(_processLogs) Message size is 242 >Thread-19::DEBUG::2014-09-09 11:45:31,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,770::__init__::225::IOProcess::(_processLogs) (8442) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:45:31,770::__init__::225::IOProcess::(_processLogs) (8442) Got request for method 'chmod' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:31,774::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:31,775::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3910::DEBUG::2014-09-09 11:45:31,775::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.setDescription' in bridge with {u'imageID': u'10ff6d19-de99-45fd-9fe1-48f146fa9380', u'description': u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"caf02237-e8a4-49fe-ab6d-4d23843f0edf"}],"Last Updated":null}', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'volumeID': u'60d04df6-702a-45f0-b789-3c360d72098f', u'storagedomainID': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf'} >Thread-3910::DEBUG::2014-09-09 11:45:31,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4ef5a1d-0ef3-4d32-a638-a69f5a54e084`::moving from state init -> state preparing >Thread-3910::INFO::2014-09-09 11:45:31,776::logUtils::44::dispatcher::(wrapper) Run and protect: setVolumeDescription(sdUUID=u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'10ff6d19-de99-45fd-9fe1-48f146fa9380', volUUID=u'60d04df6-702a-45f0-b789-3c360d72098f', description=u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"caf02237-e8a4-49fe-ab6d-4d23843f0edf"}],"Last Updated":null}', options=None) >Thread-3910::DEBUG::2014-09-09 11:45:31,776::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf`ReqID=`d23caf44-98aa-4111-8ee5-6a620ceebd6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1292' at 'setVolumeDescription' >Thread-3910::DEBUG::2014-09-09 11:45:31,776::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' for lock type 'shared' >Thread-3910::DEBUG::2014-09-09 11:45:31,776::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' is free. Now locking as 'shared' (1 active user) >Thread-3910::DEBUG::2014-09-09 11:45:31,776::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf`ReqID=`d23caf44-98aa-4111-8ee5-6a620ceebd6f`::Granted request >Thread-3910::DEBUG::2014-09-09 11:45:31,777::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e4ef5a1d-0ef3-4d32-a638-a69f5a54e084`::_resourcesAcquired: Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf (shared) >Thread-3910::DEBUG::2014-09-09 11:45:31,777::task::993::Storage.TaskManager.Task::(_decref) Task=`e4ef5a1d-0ef3-4d32-a638-a69f5a54e084`::ref 1 aborting False >Thread-3910::DEBUG::2014-09-09 11:45:31,777::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380`ReqID=`b1f4a0d5-e2da-486f-94d0-4e8bd4d870d4`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1884' at 'setVolumeDescription' >Thread-3910::DEBUG::2014-09-09 11:45:31,777::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380' for lock type 'exclusive' >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) (8443) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:45:31,778::__init__::225::IOProcess::(_processLogs) (8443) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:45:31,779::__init__::225::IOProcess::(_processLogs) (8443) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,780::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-09-09 11:45:31,780::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,780::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-09-09 11:45:31,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) (8444) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) (8444) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) (8444) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,781::__init__::225::IOProcess::(_processLogs) (8444) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,782::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:31,782::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,782::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-09-09 11:45:31,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,782::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-3910::DEBUG::2014-09-09 11:45:31,782::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 60d04df6-702a-45f0-b789-3c360d72098f >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) (8445) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) (8445) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) (8445) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) (8445) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,783::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) Message size is 239 >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) (8446) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,784::__init__::225::IOProcess::(_processLogs) (8446) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,785::__init__::225::IOProcess::(_processLogs) DEBUG|(8446) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,785::__init__::225::IOProcess::(_processLogs) (8446) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,785::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,785::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,785::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) (8447) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) (8447) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) DEBUG|(8447) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,786::__init__::225::IOProcess::(_processLogs) (8447) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) Message size is 251 >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,788::__init__::225::IOProcess::(_processLogs) (8448) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:31,788::__init__::225::IOProcess::(_processLogs) (8448) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:31,843::__init__::225::IOProcess::(_processLogs) DEBUG|(8448) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,843::__init__::225::IOProcess::(_processLogs) (8448) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,843::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,843::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,844::__init__::225::IOProcess::(_processLogs) (8449) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) (8449) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) (8449) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) (8449) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,845::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-3910::DEBUG::2014-09-09 11:45:31,845::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 60d04df6-702a-45f0-b789-3c360d72098f >Thread-19::DEBUG::2014-09-09 11:45:31,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,846::__init__::225::IOProcess::(_processLogs) (8450) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,846::__init__::225::IOProcess::(_processLogs) (8450) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,846::__init__::225::IOProcess::(_processLogs) (8450) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,847::__init__::225::IOProcess::(_processLogs) (8450) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,847::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,847::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,847::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:45:31,847::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) (8451) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) (8451) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) (8451) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) (8451) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,848::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) (8452) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) (8452) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) (8452) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,849::__init__::225::IOProcess::(_processLogs) (8452) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) (8453) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:31,850::__init__::225::IOProcess::(_processLogs) (8453) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:31,852::__init__::225::IOProcess::(_processLogs) DEBUG|(8453) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,852::__init__::225::IOProcess::(_processLogs) (8453) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,853::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,853::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:31,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,853::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) (8454) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) (8454) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) (8454) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,854::__init__::225::IOProcess::(_processLogs) (8454) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,855::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:31,855::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,855::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:45:31,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3910::DEBUG::2014-09-09 11:45:31,855::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 60d04df6-702a-45f0-b789-3c360d72098f >Thread-19::DEBUG::2014-09-09 11:45:31,855::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) (8455) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) (8455) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) (8455) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) (8455) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,856::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,857::__init__::225::IOProcess::(_processLogs) (8456) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) (8456) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) (8456) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) (8456) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,858::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) (8457) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) (8457) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) (8457) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) (8457) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,859::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) (8458) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:31,860::__init__::225::IOProcess::(_processLogs) (8458) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:31,862::__init__::225::IOProcess::(_processLogs) DEBUG|(8458) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,862::__init__::225::IOProcess::(_processLogs) (8458) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,864::__init__::225::IOProcess::(_processLogs) (8459) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:31,864::__init__::225::IOProcess::(_processLogs) (8459) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:31,866::__init__::225::IOProcess::(_processLogs) DEBUG|(8459) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,866::__init__::225::IOProcess::(_processLogs) (8459) Queuing response >Thread-3910::INFO::2014-09-09 11:45:31,866::image::224::Storage.Image::(getChain) sdUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf imgUUID=10ff6d19-de99-45fd-9fe1-48f146fa9380 chain=[<storage.fileVolume.FileVolume object at 0x7f6bcc02b610>] >Thread-19::DEBUG::2014-09-09 11:45:31,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,867::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:31,867::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:45:31,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,868::__init__::225::IOProcess::(_processLogs) (8460) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:31,868::__init__::225::IOProcess::(_processLogs) (8460) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:31,870::__init__::225::IOProcess::(_processLogs) (8460) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,870::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-3910::DEBUG::2014-09-09 11:45:31,871::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f`ReqID=`74915919-ca05-4c72-ba17-0434ad0e076b`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-3910::DEBUG::2014-09-09 11:45:31,871::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f' for lock type 'exclusive' >Thread-3910::DEBUG::2014-09-09 11:45:31,871::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f' is free. Now locking as 'exclusive' (1 active user) >Thread-3910::DEBUG::2014-09-09 11:45:31,871::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f`ReqID=`74915919-ca05-4c72-ba17-0434ad0e076b`::Granted request >Thread-3910::DEBUG::2014-09-09 11:45:31,871::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380' is free. Now locking as 'exclusive' (1 active user) >Thread-3910::DEBUG::2014-09-09 11:45:31,872::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380`ReqID=`b1f4a0d5-e2da-486f-94d0-4e8bd4d870d4`::Granted request >Thread-19::DEBUG::2014-09-09 11:45:31,872::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-09-09 11:45:31,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,872::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) (8461) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) (8461) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) (8461) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) (8461) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,873::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3910::DEBUG::2014-09-09 11:45:31,874::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 60d04df6-702a-45f0-b789-3c360d72098f >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) (8462) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) (8462) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) (8462) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,874::__init__::225::IOProcess::(_processLogs) (8462) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,875::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,875::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:31,875::__init__::225::IOProcess::(_processLogs) Message size is 239 >Thread-19::DEBUG::2014-09-09 11:45:31,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) (8463) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) (8463) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) (8463) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) (8463) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,876::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-3910::INFO::2014-09-09 11:45:31,877::volume::593::Storage.Volume::(setDescription) volUUID = 60d04df6-702a-45f0-b789-3c360d72098f descr = {"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"caf02237-e8a4-49fe-ab6d-4d23843f0edf"}],"Last Updated":null} >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) (8464) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) (8464) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:31,877::__init__::225::IOProcess::(_processLogs) (8464) Building response >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) (8464) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Message size is 251 >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) (8465) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:45:31,878::__init__::225::IOProcess::(_processLogs) (8465) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:45:31,881::__init__::225::IOProcess::(_processLogs) (8465) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,881::__init__::225::IOProcess::(_processLogs) Sending response sized 586 >Thread-19::DEBUG::2014-09-09 11:45:31,891::__init__::225::IOProcess::(_processLogs) (8441) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:31,892::__init__::225::IOProcess::(_processLogs) (8466) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:31,893::__init__::225::IOProcess::(_processLogs) (8466) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:32,019::__init__::225::IOProcess::(_processLogs) (8442) Queuing response >Thread-3910::WARNING::2014-09-09 11:45:32,019::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:32,020::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:45:32,021::utils::778::Storage.Misc.excCmd::(watchCmd) /usr/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/dd if=/dev/zero of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f/images/f3610f26-4317-4ca8-8c1a-ffe5f2fad008/7a8d5544-0400-4021-bab0-deb0c0958ca6 bs=1048576 seek=0 skip=0 conv=notrunc count=128 oflag=direct (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:32,021::__init__::225::IOProcess::(_processLogs) Message size is 430 >Thread-19::DEBUG::2014-09-09 11:45:32,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,027::__init__::225::IOProcess::(_processLogs) (8467) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:32,027::__init__::225::IOProcess::(_processLogs) (8467) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:32,031::__init__::225::IOProcess::(_processLogs) (8467) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,031::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3910::DEBUG::2014-09-09 11:45:32,032::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380' >Thread-3910::DEBUG::2014-09-09 11:45:32,032::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380' (0 active users) >Thread-3910::DEBUG::2014-09-09 11:45:32,032::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380' is free, finding out if anyone is waiting for it. >Thread-3910::DEBUG::2014-09-09 11:45:32,032::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f' >Thread-3910::DEBUG::2014-09-09 11:45:32,032::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f' (0 active users) >Thread-3910::DEBUG::2014-09-09 11:45:32,033::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f' is free, finding out if anyone is waiting for it. >Thread-3910::DEBUG::2014-09-09 11:45:32,033::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS.60d04df6-702a-45f0-b789-3c360d72098f', Clearing records. >Thread-3910::DEBUG::2014-09-09 11:45:32,033::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS.10ff6d19-de99-45fd-9fe1-48f146fa9380', Clearing records. >Thread-3910::INFO::2014-09-09 11:45:32,033::logUtils::47::dispatcher::(wrapper) Run and protect: setVolumeDescription, Return response: None >Thread-3910::DEBUG::2014-09-09 11:45:32,033::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4ef5a1d-0ef3-4d32-a638-a69f5a54e084`::finished: None >Thread-3910::DEBUG::2014-09-09 11:45:32,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4ef5a1d-0ef3-4d32-a638-a69f5a54e084`::moving from state preparing -> state finished >Thread-3910::DEBUG::2014-09-09 11:45:32,033::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf': < ResourceRef 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf', isValid: 'True' obj: 'None'>} >Thread-3910::DEBUG::2014-09-09 11:45:32,033::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3910::DEBUG::2014-09-09 11:45:32,033::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' >Thread-3910::DEBUG::2014-09-09 11:45:32,034::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' (0 active users) >Thread-3910::DEBUG::2014-09-09 11:45:32,034::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf' is free, finding out if anyone is waiting for it. >Thread-3910::DEBUG::2014-09-09 11:45:32,034::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.caf02237-e8a4-49fe-ab6d-4d23843f0edf', Clearing records. >Thread-3910::DEBUG::2014-09-09 11:45:32,034::task::993::Storage.TaskManager.Task::(_decref) Task=`e4ef5a1d-0ef3-4d32-a638-a69f5a54e084`::ref 0 aborting False >Thread-3910::DEBUG::2014-09-09 11:45:32,034::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.setDescription' in bridge with True >Thread-3910::DEBUG::2014-09-09 11:45:32,034::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:32,151::__init__::225::IOProcess::(_processLogs) (8466) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,151::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:32,151::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:32,151::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) (8468) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) (8468) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) (8468) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) (8468) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,152::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:32,152::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:32,153::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:32,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,153::__init__::225::IOProcess::(_processLogs) Message size is 309DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,153::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,154::__init__::225::IOProcess::(_processLogs) (8469) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:32,154::__init__::225::IOProcess::(_processLogs) (8469) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:32,154::__init__::225::IOProcess::(_processLogs) Message size is 309DEBUG|(8469) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,154::__init__::225::IOProcess::(_processLogs) (8469) Queuing response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:32,154::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:32,155::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,155::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,155::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,155::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) (8470) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:32,156::__init__::225::IOProcess::(_processLogs) (8470) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:32,158::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|(8470) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,158::__init__::225::IOProcess::(_processLogs) (8470) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,158::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,159::__init__::225::IOProcess::(_processLogs) (8471) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:32,160::__init__::225::IOProcess::(_processLogs) (8471) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:32,162::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|(8471) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,162::__init__::225::IOProcess::(_processLogs) (8471) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,162::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,163::__init__::225::IOProcess::(_processLogs) Sending response sized 142 >Thread-19::DEBUG::2014-09-09 11:45:32,163::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,163::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:32,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,163::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) (8472) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) (8472) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) (8472) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) (8472) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:32,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,165::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,165::__init__::225::IOProcess::(_processLogs) (8473) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:32,165::__init__::225::IOProcess::(_processLogs) (8473) Got request for method 'unlink' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:32,358::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3911::DEBUG::2014-09-09 11:45:32,359::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >JsonRpcServer::DEBUG::2014-09-09 11:45:32,359::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3911::DEBUG::2014-09-09 11:45:32,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a227d38-ae46-4b2a-8e23-5b3dcd9f12d8`::moving from state init -> state preparing >Thread-3911::INFO::2014-09-09 11:45:32,360::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3911::DEBUG::2014-09-09 11:45:32,361::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3911::DEBUG::2014-09-09 11:45:32,361::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3911::DEBUG::2014-09-09 11:45:32,361::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3911::DEBUG::2014-09-09 11:45:32,361::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3911::DEBUG::2014-09-09 11:45:32,361::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3911::DEBUG::2014-09-09 11:45:32,361::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3911::INFO::2014-09-09 11:45:32,361::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3911::DEBUG::2014-09-09 11:45:32,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a227d38-ae46-4b2a-8e23-5b3dcd9f12d8`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3911::DEBUG::2014-09-09 11:45:32,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a227d38-ae46-4b2a-8e23-5b3dcd9f12d8`::moving from state preparing -> state finished >Thread-3911::DEBUG::2014-09-09 11:45:32,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3911::DEBUG::2014-09-09 11:45:32,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3911::DEBUG::2014-09-09 11:45:32,361::task::993::Storage.TaskManager.Task::(_decref) Task=`0a227d38-ae46-4b2a-8e23-5b3dcd9f12d8`::ref 0 aborting False >Thread-3911::DEBUG::2014-09-09 11:45:32,362::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3911::DEBUG::2014-09-09 11:45:32,362::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:32,535::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|(8473) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,535::__init__::225::IOProcess::(_processLogs) (8473) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,535::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) (8474) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) (8474) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) (8474) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) (8474) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,538::__init__::225::IOProcess::(_processLogs) (8475) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:32,538::__init__::225::IOProcess::(_processLogs) (8475) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:32,538::__init__::225::IOProcess::(_processLogs) (8469) Queuing responseDEBUG|(8475) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) (8475) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,540::__init__::225::IOProcess::(_processLogs) (8476) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:32,540::__init__::225::IOProcess::(_processLogs) (8476) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) (8476) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) (8476) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) (8476) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) (8476) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) (8477) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) (8477) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) (8476) Queuing responseDEBUG|(8477) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) (8477) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,542::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::INFO::2014-09-09 11:45:32,543::volume::415::Storage.Volume::(create) Creating volume 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:45:32,543::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) (8478) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) (8478) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:32,544::__init__::225::IOProcess::(_processLogs) DEBUG|(8478) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,545::__init__::225::IOProcess::(_processLogs) (8478) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,545::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:32,545::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:32,545::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) (8479) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) (8479) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) DEBUG|(8479) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,546::__init__::225::IOProcess::(_processLogs) (8479) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,547::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,547::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:32,547::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,547::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:32,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,547::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) (8480) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) (8480) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) (8480) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) (8480) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:32,548::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) (8481) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) (8481) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:32,549::__init__::225::IOProcess::(_processLogs) DEBUG|(8481) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,550::__init__::225::IOProcess::(_processLogs) (8481) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,550::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,550::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:32,550::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) (8482) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:32,551::__init__::225::IOProcess::(_processLogs) (8482) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:32,993::__init__::225::IOProcess::(_processLogs) DEBUG|(8482) Building response >Thread-19::DEBUG::2014-09-09 11:45:32,993::__init__::225::IOProcess::(_processLogs) (8482) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:32,993::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:32,993::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) (8483) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:32,994::__init__::225::IOProcess::(_processLogs) (8483) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:33,262::__init__::225::IOProcess::(_processLogs) DEBUG|(8483) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,262::__init__::225::IOProcess::(_processLogs) (8483) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,262::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,262::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:33,262::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) (8484) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:33,263::__init__::225::IOProcess::(_processLogs) (8484) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:33,288::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) (8485) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:33,289::__init__::225::IOProcess::(_processLogs) (8485) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:33,353::__init__::225::IOProcess::(_processLogs) DEBUG|(8485) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,353::__init__::225::IOProcess::(_processLogs) (8485) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,353::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:45:33,354::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:33,354::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:45:33,361::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000960591 s, 370 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) (8486) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:33,362::__init__::225::IOProcess::(_processLogs) (8486) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:33,363::__init__::225::IOProcess::(_processLogs) DEBUG|(8486) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,364::__init__::225::IOProcess::(_processLogs) (8486) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,364::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:33,454::__init__::225::IOProcess::(_processLogs) DEBUG|(8484) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,454::__init__::225::IOProcess::(_processLogs) (8484) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,454::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,455::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:33,455::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,455::__init__::225::IOProcess::(_processLogs) Message size is 559 >Thread-19::DEBUG::2014-09-09 11:45:33,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,456::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,456::__init__::225::IOProcess::(_processLogs) (8487) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:33,456::__init__::225::IOProcess::(_processLogs) (8487) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:45:33,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:33,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896677 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:33,689::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:33,690::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3912::DEBUG::2014-09-09 11:45:33,690::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3912::DEBUG::2014-09-09 11:45:33,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`9407598d-40e8-4830-a0d8-e97a5fcf7b08`::moving from state init -> state preparing >Thread-3912::INFO::2014-09-09 11:45:33,691::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3912::INFO::2014-09-09 11:45:33,691::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3912::DEBUG::2014-09-09 11:45:33,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`9407598d-40e8-4830-a0d8-e97a5fcf7b08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3912::DEBUG::2014-09-09 11:45:33,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`9407598d-40e8-4830-a0d8-e97a5fcf7b08`::moving from state preparing -> state finished >Thread-3912::DEBUG::2014-09-09 11:45:33,691::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3912::DEBUG::2014-09-09 11:45:33,691::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3912::DEBUG::2014-09-09 11:45:33,691::task::993::Storage.TaskManager.Task::(_decref) Task=`9407598d-40e8-4830-a0d8-e97a5fcf7b08`::ref 0 aborting False >Thread-3912::DEBUG::2014-09-09 11:45:33,691::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3912::DEBUG::2014-09-09 11:45:33,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:33,712::__init__::225::IOProcess::(_processLogs) DEBUG|(8487) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,712::__init__::225::IOProcess::(_processLogs) (8487) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,713::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:33,713::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,713::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:33,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,714::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:33,714::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:33,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,715::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,715::__init__::225::IOProcess::(_processLogs) (8488) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:33,715::__init__::225::IOProcess::(_processLogs) (8488) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) (8488) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) (8488) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,717::__init__::225::IOProcess::(_processLogs) (8489) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:33,717::__init__::225::IOProcess::(_processLogs) (8489) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:33,803::__init__::225::IOProcess::(_processLogs) DEBUG|(8489) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,803::__init__::225::IOProcess::(_processLogs) (8489) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,803::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:33,803::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:33,804::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:33,804::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,804::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:33,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,804::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,805::__init__::225::IOProcess::(_processLogs) (8490) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:33,805::__init__::225::IOProcess::(_processLogs) (8490) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) DEBUG|(8490) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) (8490) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:33,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,808::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,808::__init__::225::IOProcess::(_processLogs) (8491) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:33,808::__init__::225::IOProcess::(_processLogs) (8491) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:33,811::__init__::225::IOProcess::(_processLogs) DEBUG|(8491) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,811::__init__::225::IOProcess::(_processLogs) (8491) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,811::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,811::__init__::225::IOProcess::(_processLogs) Sending response sized 191 >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) (8492) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) (8492) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) (8492) Building response >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) (8492) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:33,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:33,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:33,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:33,814::__init__::225::IOProcess::(_processLogs) (8493) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:33,814::__init__::225::IOProcess::(_processLogs) (8493) Got request for method 'unlink' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:33,937::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:33,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3913::DEBUG::2014-09-09 11:45:33,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3913::DEBUG::2014-09-09 11:45:33,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8ceeea2-5acd-4677-b578-77b56e338b4b`::moving from state init -> state preparing >Thread-3913::INFO::2014-09-09 11:45:33,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3913::DEBUG::2014-09-09 11:45:33,940::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`13d799d3-3f8e-4090-9169-9e0310d0b877`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3913::DEBUG::2014-09-09 11:45:33,940::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3913::DEBUG::2014-09-09 11:45:33,940::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3913::DEBUG::2014-09-09 11:45:33,940::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`13d799d3-3f8e-4090-9169-9e0310d0b877`::Granted request >Thread-3913::DEBUG::2014-09-09 11:45:33,941::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f8ceeea2-5acd-4677-b578-77b56e338b4b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3913::DEBUG::2014-09-09 11:45:33,941::task::993::Storage.TaskManager.Task::(_decref) Task=`f8ceeea2-5acd-4677-b578-77b56e338b4b`::ref 1 aborting False >Thread-3913::INFO::2014-09-09 11:45:33,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283891466240', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3913::DEBUG::2014-09-09 11:45:33,942::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8ceeea2-5acd-4677-b578-77b56e338b4b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283891466240', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3913::DEBUG::2014-09-09 11:45:33,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8ceeea2-5acd-4677-b578-77b56e338b4b`::moving from state preparing -> state finished >Thread-3913::DEBUG::2014-09-09 11:45:33,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3913::DEBUG::2014-09-09 11:45:33,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3913::DEBUG::2014-09-09 11:45:33,943::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3913::DEBUG::2014-09-09 11:45:33,943::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3913::DEBUG::2014-09-09 11:45:33,943::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3913::DEBUG::2014-09-09 11:45:33,943::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3913::DEBUG::2014-09-09 11:45:33,943::task::993::Storage.TaskManager.Task::(_decref) Task=`f8ceeea2-5acd-4677-b578-77b56e338b4b`::ref 0 aborting False >Thread-3913::DEBUG::2014-09-09 11:45:33,943::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283896709120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283891466240', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3913::DEBUG::2014-09-09 11:45:33,944::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) (8494) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) (8494) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) DEBUG|(8494) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) (8494) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,075::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:45:34,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:34,080::__init__::225::IOProcess::(_processLogs) DEBUG|(8493) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,080::__init__::225::IOProcess::(_processLogs) (8493) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,080::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,081::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,081::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:34,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,081::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) (8495) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) (8495) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) (8495) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) (8495) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,082::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) (8496) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:34,083::__init__::225::IOProcess::(_processLogs) (8496) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:34,170::__init__::225::IOProcess::(_processLogs) DEBUG|(8496) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,170::__init__::225::IOProcess::(_processLogs) (8496) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,170::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,170::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,171::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,171::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:45:34,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,171::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-24::DEBUG::2014-09-09 11:45:34,172::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000887056 s, 618 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:34,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) (8497) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) (8497) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) (8497) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) (8497) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:34,173::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,175::__init__::225::IOProcess::(_processLogs) (8499) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:34,175::__init__::225::IOProcess::(_processLogs) (8499) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:34,175::__init__::225::IOProcess::(_processLogs) (8499) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,175::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,175::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:34,176::__init__::225::IOProcess::(_processLogs) (8498) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,176::__init__::225::IOProcess::(_processLogs) (8498) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,176::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,176::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,176::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) (8500) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) (8500) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) (8500) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) (8500) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,177::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,178::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 169 >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) (8501) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) (8502) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) (8502) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) (8502) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) (8502) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,179::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) (8501) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,181::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) (8503) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) (8504) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) (8503) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) (8504) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) (8503) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,182::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(8504) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) (8504) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,184::__init__::225::IOProcess::(_processLogs) (8505) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:34,184::__init__::225::IOProcess::(_processLogs) (8505) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:34,184::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(8505) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,184::__init__::225::IOProcess::(_processLogs) (8505) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,185::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:34,185::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:45:34,185::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) (8506) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:34,186::__init__::225::IOProcess::(_processLogs) (8506) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:34,187::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(8506) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,187::__init__::225::IOProcess::(_processLogs) (8506) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,187::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,187::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:34,187::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,188::__init__::225::IOProcess::(_processLogs) (8507) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) (8507) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) (8507) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) (8507) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,190::__init__::225::IOProcess::(_processLogs) (8508) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:45:34,190::__init__::225::IOProcess::(_processLogs) (8508) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:45:34,190::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(8508) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,190::__init__::225::IOProcess::(_processLogs) (8508) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,190::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,191::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:34,191::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) (8509) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:34,192::__init__::225::IOProcess::(_processLogs) (8509) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:34,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:34,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3914::DEBUG::2014-09-09 11:45:34,223::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:34,716::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(8509) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,717::__init__::225::IOProcess::(_processLogs) (8509) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,717::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,717::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) (8510) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:34,718::__init__::225::IOProcess::(_processLogs) (8510) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:34,889::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8510) Building response >Thread-19::DEBUG::2014-09-09 11:45:34,889::__init__::225::IOProcess::(_processLogs) (8510) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:34,889::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:34,890::__init__::225::IOProcess::(_processLogs) (8511) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:34,891::__init__::225::IOProcess::(_processLogs) (8511) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:35,066::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8511) Building response >Thread-19::DEBUG::2014-09-09 11:45:35,066::__init__::225::IOProcess::(_processLogs) (8511) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:35,066::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Message size is 559 >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:35,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:35,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:35,068::__init__::225::IOProcess::(_processLogs) (8512) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:35,068::__init__::225::IOProcess::(_processLogs) (8512) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:45:35,308::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8512) Building response >Thread-19::DEBUG::2014-09-09 11:45:35,308::__init__::225::IOProcess::(_processLogs) (8512) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:35,308::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Message size is 747 >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:35,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:35,310::__init__::225::IOProcess::(_processLogs) (8513) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:45:35,310::__init__::225::IOProcess::(_processLogs) (8513) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:45:35,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:35,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901214 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:35,942::__init__::225::IOProcess::(_processLogs) (8513) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:35,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:35,943::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:45:35,943::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:35,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:35,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:35,944::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:35,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) (8514) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) (8514) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) (8514) Building response >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) (8514) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:35,945::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) (8515) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:35,946::__init__::225::IOProcess::(_processLogs) (8515) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:36,033::__init__::225::IOProcess::(_processLogs) (8515) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,033::__init__::225::IOProcess::(_processLogs) Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:45:36,033::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) (8516) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:45:36,034::__init__::225::IOProcess::(_processLogs) (8516) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:45:36,036::__init__::225::IOProcess::(_processLogs) (8516) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,036::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,036::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:45:36,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,037::__init__::225::IOProcess::(_processLogs) (8517) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:45:36,037::__init__::225::IOProcess::(_processLogs) (8517) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:45:36,040::__init__::225::IOProcess::(_processLogs) (8517) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,040::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:45:36,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) (8518) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) (8518) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) (8518) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) (8518) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) (8519) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:36,042::__init__::225::IOProcess::(_processLogs) (8519) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:36,353::__init__::225::IOProcess::(_processLogs) (8519) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,353::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,353::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:36,353::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,353::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) (8520) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) (8520) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) (8520) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,354::__init__::225::IOProcess::(_processLogs) (8520) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) (8521) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:36,355::__init__::225::IOProcess::(_processLogs) (8521) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:36,443::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8521) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,443::__init__::225::IOProcess::(_processLogs) (8521) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,444::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:36,444::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,444::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:45:36,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,444::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) (8522) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) (8522) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) (8522) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) (8522) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:36,445::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) (8523) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:36,446::__init__::225::IOProcess::(_processLogs) (8523) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:36,447::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8523) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,447::__init__::225::IOProcess::(_processLogs) (8523) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,447::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,447::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:36,447::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,447::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) (8524) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) (8524) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) (8524) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,448::__init__::225::IOProcess::(_processLogs) (8524) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) (8525) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:45:36,449::__init__::225::IOProcess::(_processLogs) (8525) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:45:36,450::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8525) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,450::__init__::225::IOProcess::(_processLogs) (8525) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,450::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,450::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:36,450::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,450::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) (8526) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) (8526) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8526) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,451::__init__::225::IOProcess::(_processLogs) (8526) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,453::__init__::225::IOProcess::(_processLogs) (8527) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:45:36,453::__init__::225::IOProcess::(_processLogs) (8527) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:45:36,453::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8527) Building response >Thread-19::DEBUG::2014-09-09 11:45:36,453::__init__::225::IOProcess::(_processLogs) (8527) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:36,453::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) (8528) Finding callback 'truncate'... >Thread-19::DEBUG::2014-09-09 11:45:36,454::__init__::225::IOProcess::(_processLogs) (8528) Got request for method 'truncate' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:37,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:37,238::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3915::DEBUG::2014-09-09 11:45:37,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`f683063b-75ec-4843-9f6a-2c9ec70292a3`::moving from state init -> state preparing >Thread-3915::INFO::2014-09-09 11:45:37,240::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3915::INFO::2014-09-09 11:45:37,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00124989', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000887056', 'lastCheck': '3.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000960591', 'lastCheck': '3.9', 'valid': True}} >Thread-3915::DEBUG::2014-09-09 11:45:37,240::task::1191::Storage.TaskManager.Task::(prepare) Task=`f683063b-75ec-4843-9f6a-2c9ec70292a3`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00124989', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000887056', 'lastCheck': '3.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000960591', 'lastCheck': '3.9', 'valid': True}} >Thread-3915::DEBUG::2014-09-09 11:45:37,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`f683063b-75ec-4843-9f6a-2c9ec70292a3`::moving from state preparing -> state finished >Thread-3915::DEBUG::2014-09-09 11:45:37,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3915::DEBUG::2014-09-09 11:45:37,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3915::DEBUG::2014-09-09 11:45:37,240::task::993::Storage.TaskManager.Task::(_decref) Task=`f683063b-75ec-4843-9f6a-2c9ec70292a3`::ref 0 aborting False >Thread-3915::DEBUG::2014-09-09 11:45:37,241::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:37,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:37,253::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3916::DEBUG::2014-09-09 11:45:37,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:37,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:37,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897567 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:38,886::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:38,886::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:38,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:38,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:38,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:38,887::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:38,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:38,887::__init__::225::IOProcess::(_processLogs) (8529) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:38,887::__init__::225::IOProcess::(_processLogs) (8529) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:38,888::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8529) Building response >Thread-19::DEBUG::2014-09-09 11:45:38,888::__init__::225::IOProcess::(_processLogs) (8529) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:38,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:38,888::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:45:38,889::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:45:38,896::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114453 s, 981 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:38,897::__init__::225::IOProcess::(_processLogs) (8530) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:38,898::__init__::225::IOProcess::(_processLogs) (8530) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:38,898::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8530) Building response >Thread-19::DEBUG::2014-09-09 11:45:38,898::__init__::225::IOProcess::(_processLogs) (8530) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:38,898::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:38,899::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:45:39,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:39,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903912 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:40,880::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:40,881::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3917::DEBUG::2014-09-09 11:45:40,882::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:41,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:42,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900916 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:42,371::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3918::DEBUG::2014-09-09 11:45:42,372::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >JsonRpcServer::DEBUG::2014-09-09 11:45:42,372::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3918::DEBUG::2014-09-09 11:45:42,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a5cb627-472c-476e-b9c0-3778d5070a96`::moving from state init -> state preparing >Thread-3918::INFO::2014-09-09 11:45:42,373::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3918::DEBUG::2014-09-09 11:45:42,374::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3918::DEBUG::2014-09-09 11:45:42,374::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3918::DEBUG::2014-09-09 11:45:42,374::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3918::DEBUG::2014-09-09 11:45:42,374::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3918::DEBUG::2014-09-09 11:45:42,374::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3918::DEBUG::2014-09-09 11:45:42,374::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3918::INFO::2014-09-09 11:45:42,374::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3918::DEBUG::2014-09-09 11:45:42,374::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a5cb627-472c-476e-b9c0-3778d5070a96`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3918::DEBUG::2014-09-09 11:45:42,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a5cb627-472c-476e-b9c0-3778d5070a96`::moving from state preparing -> state finished >Thread-3918::DEBUG::2014-09-09 11:45:42,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3918::DEBUG::2014-09-09 11:45:42,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3918::DEBUG::2014-09-09 11:45:42,374::task::993::Storage.TaskManager.Task::(_decref) Task=`3a5cb627-472c-476e-b9c0-3778d5070a96`::ref 0 aborting False >Thread-3918::DEBUG::2014-09-09 11:45:42,375::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3918::DEBUG::2014-09-09 11:45:42,375::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:43,296::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8528) Building response >Thread-19::DEBUG::2014-09-09 11:45:43,296::__init__::225::IOProcess::(_processLogs) (8528) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:43,296::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:43,296::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:43,296::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) Message size is 242 >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) (8531) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:45:43,297::__init__::225::IOProcess::(_processLogs) (8531) Got request for method 'chmod' >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) (8532) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:43,364::__init__::225::IOProcess::(_processLogs) (8532) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:43,386::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8532) Building response >Thread-19::DEBUG::2014-09-09 11:45:43,386::__init__::225::IOProcess::(_processLogs) (8532) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:43,386::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:43,387::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:45:43,387::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:45:43,393::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00099034 s, 358 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:43,394::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:43,394::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:43,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:43,394::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:43,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) (8533) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) (8533) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8533) Building response >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) (8533) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:43,395::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:43,637::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8531) Building response >Thread-19::DEBUG::2014-09-09 11:45:43,637::__init__::225::IOProcess::(_processLogs) (8531) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:43,638::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:45:43,638::utils::778::Storage.Misc.excCmd::(watchCmd) /usr/bin/nice -n 19 /usr/bin/ionice -c 3 /usr/bin/dd if=/dev/zero of=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f/images/9b58299d-0e4c-4799-ba1d-57760aad1bd8/94f6b335-3794-4683-bfe7-6bdca8bc02e2 bs=1048576 seek=0 skip=0 conv=notrunc count=128 oflag=direct (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:43,638::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:43,895::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:43,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3919::DEBUG::2014-09-09 11:45:43,897::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:44,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:44,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898907 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) (8534) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:44,182::__init__::225::IOProcess::(_processLogs) (8534) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:44,251::__init__::225::IOProcess::(_processLogs) DEBUG|(8534) Building response >Thread-19::DEBUG::2014-09-09 11:45:44,251::__init__::225::IOProcess::(_processLogs) (8534) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:44,251::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:45:44,252::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:45:44,252::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:45:44,259::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000990878 s, 553 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:44,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:44,261::__init__::225::IOProcess::(_processLogs) (8535) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:44,261::__init__::225::IOProcess::(_processLogs) (8535) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:44,261::__init__::225::IOProcess::(_processLogs) (8535) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:44,261::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) (8536) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:44,262::__init__::225::IOProcess::(_processLogs) (8536) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:44,263::__init__::225::IOProcess::(_processLogs) (8536) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:44,263::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:44,263::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:45:44,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:44,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:44,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:44,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:44,264::__init__::225::IOProcess::(_processLogs) (8537) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:44,264::__init__::225::IOProcess::(_processLogs) (8537) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:44,264::__init__::225::IOProcess::(_processLogs) (8537) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:44,265::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:44,265::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:45:44,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) (8538) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) (8538) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) (8538) Building response >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) (8538) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:44,266::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:44,620::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:44,621::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3920::DEBUG::2014-09-09 11:45:44,621::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3920::DEBUG::2014-09-09 11:45:44,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a36f6c5-9d4d-4e07-90f5-5e4526a7e64e`::moving from state init -> state preparing >Thread-3920::INFO::2014-09-09 11:45:44,622::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3920::INFO::2014-09-09 11:45:44,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3920::DEBUG::2014-09-09 11:45:44,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a36f6c5-9d4d-4e07-90f5-5e4526a7e64e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3920::DEBUG::2014-09-09 11:45:44,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a36f6c5-9d4d-4e07-90f5-5e4526a7e64e`::moving from state preparing -> state finished >Thread-3920::DEBUG::2014-09-09 11:45:44,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3920::DEBUG::2014-09-09 11:45:44,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3920::DEBUG::2014-09-09 11:45:44,623::task::993::Storage.TaskManager.Task::(_decref) Task=`9a36f6c5-9d4d-4e07-90f5-5e4526a7e64e`::ref 0 aborting False >Thread-3920::DEBUG::2014-09-09 11:45:44,623::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3920::DEBUG::2014-09-09 11:45:44,623::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:46,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:46,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897854 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:46,710::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:46,711::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3921::DEBUG::2014-09-09 11:45:46,711::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3921::DEBUG::2014-09-09 11:45:46,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`038058c0-d4bc-4964-adfe-bf1f5c040fe0`::moving from state init -> state preparing >Thread-3921::INFO::2014-09-09 11:45:46,712::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3921::DEBUG::2014-09-09 11:45:46,712::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`85482b75-6a27-4545-9b85-997d615efa0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3921::DEBUG::2014-09-09 11:45:46,712::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3921::DEBUG::2014-09-09 11:45:46,712::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3921::DEBUG::2014-09-09 11:45:46,712::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`85482b75-6a27-4545-9b85-997d615efa0b`::Granted request >Thread-3921::DEBUG::2014-09-09 11:45:46,713::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`038058c0-d4bc-4964-adfe-bf1f5c040fe0`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3921::DEBUG::2014-09-09 11:45:46,713::task::993::Storage.TaskManager.Task::(_decref) Task=`038058c0-d4bc-4964-adfe-bf1f5c040fe0`::ref 1 aborting False >Thread-3921::INFO::2014-09-09 11:45:46,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283878883328', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283873640448', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283876786176', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3921::DEBUG::2014-09-09 11:45:46,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`038058c0-d4bc-4964-adfe-bf1f5c040fe0`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283878883328', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283873640448', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283876786176', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3921::DEBUG::2014-09-09 11:45:46,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`038058c0-d4bc-4964-adfe-bf1f5c040fe0`::moving from state preparing -> state finished >Thread-3921::DEBUG::2014-09-09 11:45:46,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3921::DEBUG::2014-09-09 11:45:46,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3921::DEBUG::2014-09-09 11:45:46,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3921::DEBUG::2014-09-09 11:45:46,715::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3921::DEBUG::2014-09-09 11:45:46,715::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3921::DEBUG::2014-09-09 11:45:46,715::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3921::DEBUG::2014-09-09 11:45:46,715::task::993::Storage.TaskManager.Task::(_decref) Task=`038058c0-d4bc-4964-adfe-bf1f5c040fe0`::ref 0 aborting False >Thread-3921::DEBUG::2014-09-09 11:45:46,715::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283878883328', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283873640448', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283876786176', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3921::DEBUG::2014-09-09 11:45:46,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:46,915::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:46,915::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3922::DEBUG::2014-09-09 11:45:46,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:48,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:48,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900455 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:48,899::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:48,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:48,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:48,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:48,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:48,900::__init__::225::IOProcess::(_processLogs) (8539) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:48,900::__init__::225::IOProcess::(_processLogs) (8539) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:48,975::__init__::225::IOProcess::(_processLogs) (8539) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:48,975::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:45:48,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:45:48,982::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105789 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) (8540) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:48,983::__init__::225::IOProcess::(_processLogs) (8540) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:48,984::__init__::225::IOProcess::(_processLogs) (8540) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:48,984::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:50,024::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:50,026::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3923::DEBUG::2014-09-09 11:45:50,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:50,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:50,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901694 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:52,379::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:52,379::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3924::DEBUG::2014-09-09 11:45:52,379::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >Thread-3924::DEBUG::2014-09-09 11:45:52,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6bb3a7e-0641-43ce-9bcf-ea1b6280da92`::moving from state init -> state preparing >Thread-3924::INFO::2014-09-09 11:45:52,381::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3924::DEBUG::2014-09-09 11:45:52,381::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3924::DEBUG::2014-09-09 11:45:52,381::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3924::DEBUG::2014-09-09 11:45:52,381::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3924::DEBUG::2014-09-09 11:45:52,381::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3924::DEBUG::2014-09-09 11:45:52,381::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3924::DEBUG::2014-09-09 11:45:52,381::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3924::INFO::2014-09-09 11:45:52,381::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3924::DEBUG::2014-09-09 11:45:52,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6bb3a7e-0641-43ce-9bcf-ea1b6280da92`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3924::DEBUG::2014-09-09 11:45:52,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6bb3a7e-0641-43ce-9bcf-ea1b6280da92`::moving from state preparing -> state finished >Thread-3924::DEBUG::2014-09-09 11:45:52,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3924::DEBUG::2014-09-09 11:45:52,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3924::DEBUG::2014-09-09 11:45:52,382::task::993::Storage.TaskManager.Task::(_decref) Task=`c6bb3a7e-0641-43ce-9bcf-ea1b6280da92`::ref 0 aborting False >Thread-3924::DEBUG::2014-09-09 11:45:52,382::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3924::DEBUG::2014-09-09 11:45:52,382::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:52,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:52,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905341 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:53,040::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:53,041::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3925::DEBUG::2014-09-09 11:45:53,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cfd0ccd-f7d9-4e33-83b5-2889cc2f8422`::moving from state init -> state preparing >Thread-3925::INFO::2014-09-09 11:45:53,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3925::INFO::2014-09-09 11:45:53,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105789', 'lastCheck': '4.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000990878', 'lastCheck': '8.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00099034', 'lastCheck': '9.6', 'valid': True}} >Thread-3925::DEBUG::2014-09-09 11:45:53,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`7cfd0ccd-f7d9-4e33-83b5-2889cc2f8422`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105789', 'lastCheck': '4.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000990878', 'lastCheck': '8.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00099034', 'lastCheck': '9.6', 'valid': True}} >Thread-3925::DEBUG::2014-09-09 11:45:53,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cfd0ccd-f7d9-4e33-83b5-2889cc2f8422`::moving from state preparing -> state finished >Thread-3925::DEBUG::2014-09-09 11:45:53,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3925::DEBUG::2014-09-09 11:45:53,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3925::DEBUG::2014-09-09 11:45:53,042::task::993::Storage.TaskManager.Task::(_decref) Task=`7cfd0ccd-f7d9-4e33-83b5-2889cc2f8422`::ref 0 aborting False >Thread-3925::DEBUG::2014-09-09 11:45:53,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:53,056::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:53,057::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3926::DEBUG::2014-09-09 11:45:53,058::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:45:53,396::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:53,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:53,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:53,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:53,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:53,397::__init__::225::IOProcess::(_processLogs) (8541) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:53,397::__init__::225::IOProcess::(_processLogs) (8541) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:53,398::__init__::225::IOProcess::(_processLogs) (8541) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:53,398::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:45:53,398::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:45:53,405::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000907286 s, 391 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:53,405::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:45:53,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:53,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:53,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:53,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:53,406::__init__::225::IOProcess::(_processLogs) (8542) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:53,406::__init__::225::IOProcess::(_processLogs) (8542) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:53,406::__init__::225::IOProcess::(_processLogs) (8542) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:53,406::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:54,266::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:54,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:54,266::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:54,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:54,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:54,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:54,267::__init__::225::IOProcess::(_processLogs) (8543) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:54,267::__init__::225::IOProcess::(_processLogs) (8543) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:54,331::__init__::225::IOProcess::(_processLogs) (8543) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:54,331::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:45:54,331::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:45:54,340::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101203 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:54,340::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:45:54,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:54,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:54,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:54,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:54,341::__init__::225::IOProcess::(_processLogs) (8544) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:54,341::__init__::225::IOProcess::(_processLogs) (8544) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:54,341::__init__::225::IOProcess::(_processLogs) (8544) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:54,342::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:45:54,342::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:45:54,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:54,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) (8545) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) (8545) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) (8545) Building response >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) (8545) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:54,343::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) (8546) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) (8546) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) (8546) Building response >Thread-19::DEBUG::2014-09-09 11:45:54,344::__init__::225::IOProcess::(_processLogs) (8546) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:54,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:54,345::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:45:54,345::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:45:54,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:54,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) (8547) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) (8547) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) (8547) Building response >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) (8547) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:54,346::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:45:54,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:54,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899895 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:45:56,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:56,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897533 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:57,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:57,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3927::DEBUG::2014-09-09 11:45:57,050::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:57,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3928::DEBUG::2014-09-09 11:45:57,192::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:45:57,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3928::DEBUG::2014-09-09 11:45:57,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d5bce6f-0498-40de-a191-dfd85c1ed9b4`::moving from state init -> state preparing >Thread-3928::INFO::2014-09-09 11:45:57,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3928::INFO::2014-09-09 11:45:57,193::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3928::DEBUG::2014-09-09 11:45:57,193::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d5bce6f-0498-40de-a191-dfd85c1ed9b4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3928::DEBUG::2014-09-09 11:45:57,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d5bce6f-0498-40de-a191-dfd85c1ed9b4`::moving from state preparing -> state finished >Thread-3928::DEBUG::2014-09-09 11:45:57,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3928::DEBUG::2014-09-09 11:45:57,193::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3928::DEBUG::2014-09-09 11:45:57,194::task::993::Storage.TaskManager.Task::(_decref) Task=`8d5bce6f-0498-40de-a191-dfd85c1ed9b4`::ref 0 aborting False >Thread-3928::DEBUG::2014-09-09 11:45:57,194::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3928::DEBUG::2014-09-09 11:45:57,194::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:45:57,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:45:57,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3929::DEBUG::2014-09-09 11:45:57,295::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3929::DEBUG::2014-09-09 11:45:57,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b514848-0452-40e1-b623-a0de168210aa`::moving from state init -> state preparing >Thread-3929::INFO::2014-09-09 11:45:57,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3929::DEBUG::2014-09-09 11:45:57,296::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b3ce5530-3b0c-4e2c-91f6-fd077f5d0ac2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3929::DEBUG::2014-09-09 11:45:57,297::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3929::DEBUG::2014-09-09 11:45:57,297::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3929::DEBUG::2014-09-09 11:45:57,297::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b3ce5530-3b0c-4e2c-91f6-fd077f5d0ac2`::Granted request >Thread-3929::DEBUG::2014-09-09 11:45:57,297::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7b514848-0452-40e1-b623-a0de168210aa`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3929::DEBUG::2014-09-09 11:45:57,297::task::993::Storage.TaskManager.Task::(_decref) Task=`7b514848-0452-40e1-b623-a0de168210aa`::ref 1 aborting False >Thread-3929::INFO::2014-09-09 11:45:57,299::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283850571776', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283827503104', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283830648832', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3929::DEBUG::2014-09-09 11:45:57,299::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b514848-0452-40e1-b623-a0de168210aa`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283850571776', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283827503104', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283830648832', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3929::DEBUG::2014-09-09 11:45:57,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b514848-0452-40e1-b623-a0de168210aa`::moving from state preparing -> state finished >Thread-3929::DEBUG::2014-09-09 11:45:57,299::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3929::DEBUG::2014-09-09 11:45:57,299::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3929::DEBUG::2014-09-09 11:45:57,299::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3929::DEBUG::2014-09-09 11:45:57,299::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3929::DEBUG::2014-09-09 11:45:57,300::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3929::DEBUG::2014-09-09 11:45:57,300::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3929::DEBUG::2014-09-09 11:45:57,300::task::993::Storage.TaskManager.Task::(_decref) Task=`7b514848-0452-40e1-b623-a0de168210aa`::ref 0 aborting False >Thread-3929::DEBUG::2014-09-09 11:45:57,300::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283850571776', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283827503104', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283830648832', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3929::DEBUG::2014-09-09 11:45:57,300::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:45:58,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:45:58,985::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:58,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:58,985::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:58,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:58,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:58,986::__init__::225::IOProcess::(_processLogs) (8548) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:58,986::__init__::225::IOProcess::(_processLogs) (8548) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:59,017::__init__::225::IOProcess::(_processLogs) (8548) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:59,018::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:59,018::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:45:59,020::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:45:59,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0967595 s, 10.6 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 11:45:59,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104875 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:45:59,028::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:45:59,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:45:59,029::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:45:59,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:45:59,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:45:59,031::__init__::225::IOProcess::(_processLogs) (8549) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:45:59,032::__init__::225::IOProcess::(_processLogs) (8549) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:45:59,032::__init__::225::IOProcess::(_processLogs) (8549) Building response >Thread-19::DEBUG::2014-09-09 11:45:59,033::__init__::225::IOProcess::(_processLogs) (8549) Queuing response >Thread-19::DEBUG::2014-09-09 11:45:59,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:45:59,034::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:00,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:00,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3930::DEBUG::2014-09-09 11:46:00,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:01,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:01,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903531 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:02,385::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:02,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3931::DEBUG::2014-09-09 11:46:02,386::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >Thread-3931::DEBUG::2014-09-09 11:46:02,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7b69fcc-cb77-464e-93cb-de24cce19932`::moving from state init -> state preparing >Thread-3931::INFO::2014-09-09 11:46:02,387::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3931::DEBUG::2014-09-09 11:46:02,387::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3931::DEBUG::2014-09-09 11:46:02,387::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3931::DEBUG::2014-09-09 11:46:02,387::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3931::DEBUG::2014-09-09 11:46:02,387::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3931::DEBUG::2014-09-09 11:46:02,387::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3931::DEBUG::2014-09-09 11:46:02,388::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3931::INFO::2014-09-09 11:46:02,388::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3931::DEBUG::2014-09-09 11:46:02,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7b69fcc-cb77-464e-93cb-de24cce19932`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3931::DEBUG::2014-09-09 11:46:02,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7b69fcc-cb77-464e-93cb-de24cce19932`::moving from state preparing -> state finished >Thread-3931::DEBUG::2014-09-09 11:46:02,388::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3931::DEBUG::2014-09-09 11:46:02,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3931::DEBUG::2014-09-09 11:46:02,388::task::993::Storage.TaskManager.Task::(_decref) Task=`e7b69fcc-cb77-464e-93cb-de24cce19932`::ref 0 aborting False >Thread-3931::DEBUG::2014-09-09 11:46:02,388::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3931::DEBUG::2014-09-09 11:46:02,388::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:03,085::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:03,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3932::DEBUG::2014-09-09 11:46:03,086::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:03,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:03,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898175 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:03,407::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) (8550) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:03,408::__init__::225::IOProcess::(_processLogs) (8550) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:03,483::__init__::225::IOProcess::(_processLogs) DEBUG|(8550) Building response >Thread-19::DEBUG::2014-09-09 11:46:03,483::__init__::225::IOProcess::(_processLogs) (8550) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:03,483::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:03,484::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:46:03,484::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:46:03,491::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000999013 s, 355 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) (8551) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:03,492::__init__::225::IOProcess::(_processLogs) (8551) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:03,493::__init__::225::IOProcess::(_processLogs) DEBUG|(8551) Building response >Thread-19::DEBUG::2014-09-09 11:46:03,493::__init__::225::IOProcess::(_processLogs) (8551) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:03,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:03,493::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:04,346::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:04,346::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) (8552) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:04,347::__init__::225::IOProcess::(_processLogs) (8552) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:04,422::__init__::225::IOProcess::(_processLogs) DEBUG|(8552) Building response >Thread-19::DEBUG::2014-09-09 11:46:04,422::__init__::225::IOProcess::(_processLogs) (8552) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:04,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:04,423::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:46:04,423::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:46:04,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000905912 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) (8553) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:04,513::__init__::225::IOProcess::(_processLogs) (8553) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:04,514::__init__::225::IOProcess::(_processLogs) (8553) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:04,514::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:04,515::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:46:04,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:04,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) (8554) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) (8554) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) (8554) Building response >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) (8554) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:46:04,516::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) (8555) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) (8555) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) (8555) Building response >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) (8555) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:04,517::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) (8556) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:04,518::__init__::225::IOProcess::(_processLogs) (8556) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:04,519::__init__::225::IOProcess::(_processLogs) (8556) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:04,519::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:46:05,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:05,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899033 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:06,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:06,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3933::DEBUG::2014-09-09 11:46:06,184::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:07,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:07,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899918 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:07,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3934::DEBUG::2014-09-09 11:46:07,898::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:46:07,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3934::DEBUG::2014-09-09 11:46:07,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ff3015b-e5ef-49ba-b30a-a9646122ec7e`::moving from state init -> state preparing >Thread-3934::INFO::2014-09-09 11:46:07,899::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3934::INFO::2014-09-09 11:46:07,900::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3934::DEBUG::2014-09-09 11:46:07,900::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ff3015b-e5ef-49ba-b30a-a9646122ec7e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3934::DEBUG::2014-09-09 11:46:07,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ff3015b-e5ef-49ba-b30a-a9646122ec7e`::moving from state preparing -> state finished >Thread-3934::DEBUG::2014-09-09 11:46:07,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3934::DEBUG::2014-09-09 11:46:07,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3934::DEBUG::2014-09-09 11:46:07,900::task::993::Storage.TaskManager.Task::(_decref) Task=`8ff3015b-e5ef-49ba-b30a-a9646122ec7e`::ref 0 aborting False >Thread-3934::DEBUG::2014-09-09 11:46:07,900::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3934::DEBUG::2014-09-09 11:46:07,900::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:08,107::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:08,107::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3935::DEBUG::2014-09-09 11:46:08,107::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3935::DEBUG::2014-09-09 11:46:08,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3c2dd02-8fe9-49c2-b2d8-c1a0c19d572d`::moving from state init -> state preparing >Thread-3935::INFO::2014-09-09 11:46:08,108::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3935::DEBUG::2014-09-09 11:46:08,109::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cd3bd07b-9987-4118-94f9-ac3f3c3e40ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3935::DEBUG::2014-09-09 11:46:08,109::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3935::DEBUG::2014-09-09 11:46:08,109::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3935::DEBUG::2014-09-09 11:46:08,109::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cd3bd07b-9987-4118-94f9-ac3f3c3e40ae`::Granted request >Thread-3935::DEBUG::2014-09-09 11:46:08,109::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d3c2dd02-8fe9-49c2-b2d8-c1a0c19d572d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3935::DEBUG::2014-09-09 11:46:08,109::task::993::Storage.TaskManager.Task::(_decref) Task=`d3c2dd02-8fe9-49c2-b2d8-c1a0c19d572d`::ref 1 aborting False >Thread-3935::INFO::2014-09-09 11:46:08,111::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283803385856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283765637120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283774025728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3935::DEBUG::2014-09-09 11:46:08,111::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3c2dd02-8fe9-49c2-b2d8-c1a0c19d572d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283803385856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283765637120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283774025728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3935::DEBUG::2014-09-09 11:46:08,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3c2dd02-8fe9-49c2-b2d8-c1a0c19d572d`::moving from state preparing -> state finished >Thread-3935::DEBUG::2014-09-09 11:46:08,111::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3935::DEBUG::2014-09-09 11:46:08,111::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3935::DEBUG::2014-09-09 11:46:08,111::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3935::DEBUG::2014-09-09 11:46:08,111::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3935::DEBUG::2014-09-09 11:46:08,111::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3935::DEBUG::2014-09-09 11:46:08,112::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3935::DEBUG::2014-09-09 11:46:08,112::task::993::Storage.TaskManager.Task::(_decref) Task=`d3c2dd02-8fe9-49c2-b2d8-c1a0c19d572d`::ref 0 aborting False >Thread-3935::DEBUG::2014-09-09 11:46:08,112::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283803385856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283765637120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283774025728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3935::DEBUG::2014-09-09 11:46:08,112::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) (8557) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:09,032::__init__::225::IOProcess::(_processLogs) (8557) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:09,033::__init__::225::IOProcess::(_processLogs) (8557) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:09,033::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:46:09,034::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:46:09,041::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011263 s, 997 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) (8558) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:09,042::__init__::225::IOProcess::(_processLogs) (8558) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:09,043::__init__::225::IOProcess::(_processLogs) (8558) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:09,043::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:09,203::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:09,203::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3936::DEBUG::2014-09-09 11:46:09,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5f6710d-34c8-4408-bbd8-da7387c9178c`::moving from state init -> state preparing >Thread-3936::INFO::2014-09-09 11:46:09,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3936::INFO::2014-09-09 11:46:09,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011263', 'lastCheck': '0.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000905912', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000999013', 'lastCheck': '5.7', 'valid': True}} >Thread-3936::DEBUG::2014-09-09 11:46:09,205::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5f6710d-34c8-4408-bbd8-da7387c9178c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011263', 'lastCheck': '0.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000905912', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000999013', 'lastCheck': '5.7', 'valid': True}} >Thread-3936::DEBUG::2014-09-09 11:46:09,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5f6710d-34c8-4408-bbd8-da7387c9178c`::moving from state preparing -> state finished >Thread-3936::DEBUG::2014-09-09 11:46:09,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3936::DEBUG::2014-09-09 11:46:09,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3936::DEBUG::2014-09-09 11:46:09,205::task::993::Storage.TaskManager.Task::(_decref) Task=`f5f6710d-34c8-4408-bbd8-da7387c9178c`::ref 0 aborting False >Thread-3936::DEBUG::2014-09-09 11:46:09,206::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:09,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:09,224::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3937::DEBUG::2014-09-09 11:46:09,225::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:09,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:09,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900761 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:46:11,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:11,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089925 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:12,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:12,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3938::DEBUG::2014-09-09 11:46:12,392::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >Thread-3938::DEBUG::2014-09-09 11:46:12,393::task::595::Storage.TaskManager.Task::(_updateState) Task=`e10f1c15-f919-4446-9ffd-4d33024e08b2`::moving from state init -> state preparing >Thread-3938::INFO::2014-09-09 11:46:12,393::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3938::DEBUG::2014-09-09 11:46:12,393::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3938::DEBUG::2014-09-09 11:46:12,394::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3938::DEBUG::2014-09-09 11:46:12,394::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3938::DEBUG::2014-09-09 11:46:12,394::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3938::DEBUG::2014-09-09 11:46:12,394::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3938::DEBUG::2014-09-09 11:46:12,394::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3938::INFO::2014-09-09 11:46:12,394::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3938::DEBUG::2014-09-09 11:46:12,394::task::1191::Storage.TaskManager.Task::(prepare) Task=`e10f1c15-f919-4446-9ffd-4d33024e08b2`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3938::DEBUG::2014-09-09 11:46:12,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`e10f1c15-f919-4446-9ffd-4d33024e08b2`::moving from state preparing -> state finished >Thread-3938::DEBUG::2014-09-09 11:46:12,394::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3938::DEBUG::2014-09-09 11:46:12,394::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3938::DEBUG::2014-09-09 11:46:12,394::task::993::Storage.TaskManager.Task::(_decref) Task=`e10f1c15-f919-4446-9ffd-4d33024e08b2`::ref 0 aborting False >Thread-3938::DEBUG::2014-09-09 11:46:12,394::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3938::DEBUG::2014-09-09 11:46:12,395::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:13,229::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:13,230::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3939::DEBUG::2014-09-09 11:46:13,231::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) (8559) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) (8559) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:13,494::__init__::225::IOProcess::(_processLogs) (8559) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:13,495::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:46:13,495::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:46:13,502::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0010526 s, 337 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) (8560) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:13,503::__init__::225::IOProcess::(_processLogs) (8560) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:13,504::__init__::225::IOProcess::(_processLogs) (8560) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:13,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:13,505::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:46:13,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:13,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905749 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:14,520::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:14,520::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:14,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:14,520::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:14,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:14,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:14,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:14,521::__init__::225::IOProcess::(_processLogs) (8561) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:14,521::__init__::225::IOProcess::(_processLogs) (8561) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:14,582::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8561) Building response >Thread-19::DEBUG::2014-09-09 11:46:14,582::__init__::225::IOProcess::(_processLogs) (8561) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:14,583::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:46:14,583::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:14,583::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:46:14,592::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000988121 s, 555 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) (8562) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:14,593::__init__::225::IOProcess::(_processLogs) (8562) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:14,594::__init__::225::IOProcess::(_processLogs) DEBUG|(8562) Building response >Thread-19::DEBUG::2014-09-09 11:46:14,594::__init__::225::IOProcess::(_processLogs) (8562) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:14,594::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:14,594::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:14,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) (8563) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) (8563) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) (8563) Building response >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) (8563) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:46:14,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) (8564) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) (8564) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) (8564) Building response >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) (8564) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:14,597::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:14,598::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:14,598::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:46:14,598::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:14,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:14,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) (8565) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) (8565) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) (8565) Building response >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) (8565) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:14,599::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:46:15,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:15,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897595 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:16,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:16,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3940::DEBUG::2014-09-09 11:46:16,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:18,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:18,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899712 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:18,563::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:18,564::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3941::DEBUG::2014-09-09 11:46:18,564::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3941::DEBUG::2014-09-09 11:46:18,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`adbe0144-553c-4acb-84f0-f6836fed3e71`::moving from state init -> state preparing >Thread-3941::INFO::2014-09-09 11:46:18,565::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3941::INFO::2014-09-09 11:46:18,565::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3941::DEBUG::2014-09-09 11:46:18,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`adbe0144-553c-4acb-84f0-f6836fed3e71`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3941::DEBUG::2014-09-09 11:46:18,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`adbe0144-553c-4acb-84f0-f6836fed3e71`::moving from state preparing -> state finished >Thread-3941::DEBUG::2014-09-09 11:46:18,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3941::DEBUG::2014-09-09 11:46:18,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3941::DEBUG::2014-09-09 11:46:18,566::task::993::Storage.TaskManager.Task::(_decref) Task=`adbe0144-553c-4acb-84f0-f6836fed3e71`::ref 0 aborting False >Thread-3941::DEBUG::2014-09-09 11:46:18,566::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3941::DEBUG::2014-09-09 11:46:18,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:18,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:18,696::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3942::DEBUG::2014-09-09 11:46:18,696::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3942::DEBUG::2014-09-09 11:46:18,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`76a26709-0e74-4240-a640-3dfe23eadbd8`::moving from state init -> state preparing >Thread-3942::INFO::2014-09-09 11:46:18,697::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3942::DEBUG::2014-09-09 11:46:18,698::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a12a09e7-039e-4b64-b9a2-f6718022b736`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3942::DEBUG::2014-09-09 11:46:18,698::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3942::DEBUG::2014-09-09 11:46:18,698::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3942::DEBUG::2014-09-09 11:46:18,698::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a12a09e7-039e-4b64-b9a2-f6718022b736`::Granted request >Thread-3942::DEBUG::2014-09-09 11:46:18,699::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76a26709-0e74-4240-a640-3dfe23eadbd8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3942::DEBUG::2014-09-09 11:46:18,699::task::993::Storage.TaskManager.Task::(_decref) Task=`76a26709-0e74-4240-a640-3dfe23eadbd8`::ref 1 aborting False >Thread-3942::INFO::2014-09-09 11:46:18,700::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283738374144', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283713208320', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283718451200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3942::DEBUG::2014-09-09 11:46:18,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`76a26709-0e74-4240-a640-3dfe23eadbd8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283738374144', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283713208320', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283718451200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3942::DEBUG::2014-09-09 11:46:18,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`76a26709-0e74-4240-a640-3dfe23eadbd8`::moving from state preparing -> state finished >Thread-3942::DEBUG::2014-09-09 11:46:18,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3942::DEBUG::2014-09-09 11:46:18,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3942::DEBUG::2014-09-09 11:46:18,701::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3942::DEBUG::2014-09-09 11:46:18,701::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3942::DEBUG::2014-09-09 11:46:18,701::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3942::DEBUG::2014-09-09 11:46:18,701::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3942::DEBUG::2014-09-09 11:46:18,701::task::993::Storage.TaskManager.Task::(_decref) Task=`76a26709-0e74-4240-a640-3dfe23eadbd8`::ref 0 aborting False >Thread-3942::DEBUG::2014-09-09 11:46:18,701::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283738374144', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283713208320', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283718451200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3942::DEBUG::2014-09-09 11:46:18,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:19,044::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:19,044::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:19,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:19,044::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:19,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:19,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:19,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:19,045::__init__::225::IOProcess::(_processLogs) (8566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:19,045::__init__::225::IOProcess::(_processLogs) (8566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:19,045::__init__::225::IOProcess::(_processLogs) DEBUG|(8566) Building response >Thread-19::DEBUG::2014-09-09 11:46:19,046::__init__::225::IOProcess::(_processLogs) (8566) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:19,046::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:19,046::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:46:19,046::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:46:19,053::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00121881 s, 921 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:19,054::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:19,054::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:19,054::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:19,054::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:19,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) (8567) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) (8567) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8567) Building response >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) (8567) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:19,055::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:19,056::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:19,251::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:19,252::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3943::DEBUG::2014-09-09 11:46:19,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:20,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:20,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0950475 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:22,267::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:22,268::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3944::DEBUG::2014-09-09 11:46:22,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:22,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:22,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902898 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:22,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3945::DEBUG::2014-09-09 11:46:22,399::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >JsonRpcServer::DEBUG::2014-09-09 11:46:22,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3945::DEBUG::2014-09-09 11:46:22,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e1649b0-4774-4e9d-94a2-f9e0d9c0fa2f`::moving from state init -> state preparing >Thread-3945::INFO::2014-09-09 11:46:22,401::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3945::DEBUG::2014-09-09 11:46:22,401::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3945::DEBUG::2014-09-09 11:46:22,401::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3945::DEBUG::2014-09-09 11:46:22,401::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3945::DEBUG::2014-09-09 11:46:22,401::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3945::DEBUG::2014-09-09 11:46:22,401::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3945::DEBUG::2014-09-09 11:46:22,401::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3945::INFO::2014-09-09 11:46:22,401::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3945::DEBUG::2014-09-09 11:46:22,401::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e1649b0-4774-4e9d-94a2-f9e0d9c0fa2f`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3945::DEBUG::2014-09-09 11:46:22,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e1649b0-4774-4e9d-94a2-f9e0d9c0fa2f`::moving from state preparing -> state finished >Thread-3945::DEBUG::2014-09-09 11:46:22,402::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3945::DEBUG::2014-09-09 11:46:22,402::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3945::DEBUG::2014-09-09 11:46:22,402::task::993::Storage.TaskManager.Task::(_decref) Task=`8e1649b0-4774-4e9d-94a2-f9e0d9c0fa2f`::ref 0 aborting False >Thread-3945::DEBUG::2014-09-09 11:46:22,402::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3945::DEBUG::2014-09-09 11:46:22,402::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:23,505::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) (8568) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:23,506::__init__::225::IOProcess::(_processLogs) (8568) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:23,507::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8568) Building response >Thread-3443::DEBUG::2014-09-09 11:46:23,507::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:23,507::__init__::225::IOProcess::(_processLogs) (8568) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:23,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:23,512::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:46:23,514::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000994713 s, 357 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:23,514::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:23,514::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:23,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:23,514::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) (8569) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) (8569) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8569) Building response >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) (8569) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:23,515::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:23,516::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:46:24,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:24,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08978 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:24,599::__init__::225::IOProcess::(_processLogs) (8570) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:24,600::__init__::225::IOProcess::(_processLogs) (8570) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:24,600::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8570) Building response >Thread-19::DEBUG::2014-09-09 11:46:24,600::__init__::225::IOProcess::(_processLogs) (8570) Queuing response >Thread-24::DEBUG::2014-09-09 11:46:24,600::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:24,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:24,605::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:46:24,608::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000989901 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) (8571) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:24,609::__init__::225::IOProcess::(_processLogs) (8571) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:24,610::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8571) Building response >Thread-19::DEBUG::2014-09-09 11:46:24,610::__init__::225::IOProcess::(_processLogs) (8571) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:24,610::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:24,611::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:24,611::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:24,611::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:46:24,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:24,611::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:24,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) (8572) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) (8572) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) (8572) Building response >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) (8572) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:24,612::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) (8573) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) (8573) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) (8573) Building response >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) (8573) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:24,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:24,614::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:24,614::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:24,614::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:46:24,614::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:24,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:24,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) (8574) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) (8574) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) (8574) Building response >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) (8574) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:24,615::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:25,281::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:25,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3946::DEBUG::2014-09-09 11:46:25,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`eee26e3c-d888-4a62-89ef-437f81525363`::moving from state init -> state preparing >Thread-3946::INFO::2014-09-09 11:46:25,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3946::INFO::2014-09-09 11:46:25,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00121881', 'lastCheck': '6.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989901', 'lastCheck': '0.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000994713', 'lastCheck': '1.8', 'valid': True}} >Thread-3946::DEBUG::2014-09-09 11:46:25,283::task::1191::Storage.TaskManager.Task::(prepare) Task=`eee26e3c-d888-4a62-89ef-437f81525363`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00121881', 'lastCheck': '6.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989901', 'lastCheck': '0.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000994713', 'lastCheck': '1.8', 'valid': True}} >Thread-3946::DEBUG::2014-09-09 11:46:25,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`eee26e3c-d888-4a62-89ef-437f81525363`::moving from state preparing -> state finished >Thread-3946::DEBUG::2014-09-09 11:46:25,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3946::DEBUG::2014-09-09 11:46:25,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3946::DEBUG::2014-09-09 11:46:25,284::task::993::Storage.TaskManager.Task::(_decref) Task=`eee26e3c-d888-4a62-89ef-437f81525363`::ref 0 aborting False >Thread-3946::DEBUG::2014-09-09 11:46:25,285::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:25,291::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:25,292::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3947::DEBUG::2014-09-09 11:46:25,293::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:26,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:26,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901829 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:46:28,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:28,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904289 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:28,992::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:28,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3948::DEBUG::2014-09-09 11:46:28,993::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3948::DEBUG::2014-09-09 11:46:28,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`f08ac3b0-c4a3-41a8-8cbf-7a7853ea2d34`::moving from state init -> state preparing >Thread-3948::INFO::2014-09-09 11:46:28,994::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3948::INFO::2014-09-09 11:46:28,995::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3948::DEBUG::2014-09-09 11:46:28,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`f08ac3b0-c4a3-41a8-8cbf-7a7853ea2d34`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3948::DEBUG::2014-09-09 11:46:28,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`f08ac3b0-c4a3-41a8-8cbf-7a7853ea2d34`::moving from state preparing -> state finished >Thread-3948::DEBUG::2014-09-09 11:46:28,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3948::DEBUG::2014-09-09 11:46:28,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3948::DEBUG::2014-09-09 11:46:28,995::task::993::Storage.TaskManager.Task::(_decref) Task=`f08ac3b0-c4a3-41a8-8cbf-7a7853ea2d34`::ref 0 aborting False >Thread-3948::DEBUG::2014-09-09 11:46:28,995::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3948::DEBUG::2014-09-09 11:46:28,995::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) (8575) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:29,057::__init__::225::IOProcess::(_processLogs) (8575) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:29,130::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3949::DEBUG::2014-09-09 11:46:29,130::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:46:29,130::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3949::DEBUG::2014-09-09 11:46:29,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`f77fc83f-8386-43ad-87a7-ae5aad06fb2b`::moving from state init -> state preparing >Thread-3949::INFO::2014-09-09 11:46:29,131::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3949::DEBUG::2014-09-09 11:46:29,132::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`af66485a-61fe-4e85-832a-675f7773443b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3949::DEBUG::2014-09-09 11:46:29,132::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3949::DEBUG::2014-09-09 11:46:29,132::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3949::DEBUG::2014-09-09 11:46:29,132::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`af66485a-61fe-4e85-832a-675f7773443b`::Granted request >Thread-3949::DEBUG::2014-09-09 11:46:29,132::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f77fc83f-8386-43ad-87a7-ae5aad06fb2b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3949::DEBUG::2014-09-09 11:46:29,132::task::993::Storage.TaskManager.Task::(_decref) Task=`f77fc83f-8386-43ad-87a7-ae5aad06fb2b`::ref 1 aborting False >Thread-3949::INFO::2014-09-09 11:46:29,134::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283416461312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283378712576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283391295488', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3949::DEBUG::2014-09-09 11:46:29,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`f77fc83f-8386-43ad-87a7-ae5aad06fb2b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283416461312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283378712576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283391295488', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3949::DEBUG::2014-09-09 11:46:29,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`f77fc83f-8386-43ad-87a7-ae5aad06fb2b`::moving from state preparing -> state finished >Thread-3949::DEBUG::2014-09-09 11:46:29,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3949::DEBUG::2014-09-09 11:46:29,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3949::DEBUG::2014-09-09 11:46:29,134::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3949::DEBUG::2014-09-09 11:46:29,135::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3949::DEBUG::2014-09-09 11:46:29,135::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3949::DEBUG::2014-09-09 11:46:29,135::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3949::DEBUG::2014-09-09 11:46:29,135::task::993::Storage.TaskManager.Task::(_decref) Task=`f77fc83f-8386-43ad-87a7-ae5aad06fb2b`::ref 0 aborting False >Thread-3949::DEBUG::2014-09-09 11:46:29,135::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283416461312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283378712576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283391295488', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3949::DEBUG::2014-09-09 11:46:29,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:29,145::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8575) Building response >Thread-19::DEBUG::2014-09-09 11:46:29,145::__init__::225::IOProcess::(_processLogs) (8575) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:29,146::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:46:29,146::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:29,146::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:46:29,153::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103488 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:29,153::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) (8576) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) (8576) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:29,154::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8576) Building response >Thread-19::DEBUG::2014-09-09 11:46:29,155::__init__::225::IOProcess::(_processLogs) (8576) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:29,155::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:29,155::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:46:30,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:30,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897438 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:32,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:32,066::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3950::DEBUG::2014-09-09 11:46:32,067::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:32,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:32,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905426 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) (8577) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:33,517::__init__::225::IOProcess::(_processLogs) (8577) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:33,519::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8577) Building response >Thread-19::DEBUG::2014-09-09 11:46:33,519::__init__::225::IOProcess::(_processLogs) (8577) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:33,519::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:46:33,520::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:33,520::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:46:33,527::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000936916 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:33,528::__init__::225::IOProcess::(_processLogs) (8578) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:33,529::__init__::225::IOProcess::(_processLogs) (8578) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:33,529::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8578) Building response >Thread-19::DEBUG::2014-09-09 11:46:33,529::__init__::225::IOProcess::(_processLogs) (8578) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:33,529::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:33,530::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:33,658::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:33,660::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3951::DEBUG::2014-09-09 11:46:33,660::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >Thread-3951::DEBUG::2014-09-09 11:46:33,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`d72869b3-9ab7-48f7-ab3c-ed28271dd848`::moving from state init -> state preparing >Thread-3951::INFO::2014-09-09 11:46:33,661::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3951::DEBUG::2014-09-09 11:46:33,661::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3951::DEBUG::2014-09-09 11:46:33,661::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3951::DEBUG::2014-09-09 11:46:33,661::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3951::DEBUG::2014-09-09 11:46:33,662::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3951::INFO::2014-09-09 11:46:33,662::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`d72869b3-9ab7-48f7-ab3c-ed28271dd848`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`d72869b3-9ab7-48f7-ab3c-ed28271dd848`::moving from state preparing -> state finished >Thread-3951::DEBUG::2014-09-09 11:46:33,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::task::993::Storage.TaskManager.Task::(_decref) Task=`d72869b3-9ab7-48f7-ab3c-ed28271dd848`::ref 0 aborting False >Thread-3951::DEBUG::2014-09-09 11:46:33,662::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3951::DEBUG::2014-09-09 11:46:33,662::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) (8579) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:34,615::__init__::225::IOProcess::(_processLogs) (8579) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:34,616::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(8579) Building response >Thread-19::DEBUG::2014-09-09 11:46:34,616::__init__::225::IOProcess::(_processLogs) (8579) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:34,617::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:46:34,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:34,617::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:46:34,625::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000931814 s, 588 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:34,625::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) (8580) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) (8580) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) DEBUG|(8580) Building response >Thread-19::DEBUG::2014-09-09 11:46:34,626::__init__::225::IOProcess::(_processLogs) (8580) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:34,627::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:34,627::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:34,627::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:34,627::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:46:34,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) (8581) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) (8581) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) (8581) Building response >Thread-19::DEBUG::2014-09-09 11:46:34,628::__init__::225::IOProcess::(_processLogs) (8581) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:34,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) (8582) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) (8582) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) (8582) Building response >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) (8582) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:34,630::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) (8583) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) (8583) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) DEBUG|(8583) Building response >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) (8583) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:34,631::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:34,632::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:46:34,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:35,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900363 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:35,078::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:35,079::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3952::DEBUG::2014-09-09 11:46:35,080::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:37,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:37,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896025 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:38,197::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:38,198::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3953::DEBUG::2014-09-09 11:46:38,199::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:38,974::utils::790::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['128+0 records in', '128+0 records out', '134217728 bytes (134 MB) copied, 66.9464 s, 2.0 MB/s']; <rc> = 0 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:38,974::misc::262::Storage.Misc::(validateDDBytes) err: ['128+0 records in', '128+0 records out', '134217728 bytes (134 MB) copied, 66.9464 s, 2.0 MB/s'], size: 134217728 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::INFO::2014-09-09 11:46:38,974::fileVolume::133::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f/images/f3610f26-4317-4ca8-8c1a-ffe5f2fad008/7a8d5544-0400-4021-bab0-deb0c0958ca6 with size = 262144 sectors >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) Message size is 242 >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:38,975::__init__::225::IOProcess::(_processLogs) (8584) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:46:38,976::__init__::225::IOProcess::(_processLogs) (8584) Got request for method 'chmod' >Thread-19::DEBUG::2014-09-09 11:46:39,133::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8584) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,133::__init__::225::IOProcess::(_processLogs) (8584) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,133::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:39,134::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,134::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:46:39,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,134::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) (8585) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) (8585) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) (8585) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) (8585) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:46:39,135::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) (8586) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:39,136::__init__::225::IOProcess::(_processLogs) (8586) Got request for method 'access' >Dummy-97::DEBUG::2014-09-09 11:46:39,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:39,156::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,156::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:39,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,156::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,157::__init__::225::IOProcess::(_processLogs) (8587) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:39,157::__init__::225::IOProcess::(_processLogs) (8587) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:39,223::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8586) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,223::__init__::225::IOProcess::(_processLogs) (8586) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,224::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Sending response sized 56 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:39,224::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:46:39,225::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8587) Building response >Thread-23::DEBUG::2014-09-09 11:46:39,225::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:39,225::__init__::225::IOProcess::(_processLogs) (8587) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,230::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) (8588) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:39,231::__init__::225::IOProcess::(_processLogs) (8588) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:39,313::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8588) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,313::__init__::225::IOProcess::(_processLogs) (8588) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,314::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,315::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-23::DEBUG::2014-09-09 11:46:39,316::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109562 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:39,317::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,318::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:39,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,320::__init__::225::IOProcess::(_processLogs) (8589) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:39,321::__init__::225::IOProcess::(_processLogs) (8589) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:39,321::__init__::225::IOProcess::(_processLogs) (8589) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,322::__init__::225::IOProcess::(_processLogs) (8589) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,323::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Dummy-97::DEBUG::2014-09-09 11:46:39,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0979213 s, 10.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:39,324::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,325::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:39,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,325::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,327::__init__::225::IOProcess::(_processLogs) (8590) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:39,328::__init__::225::IOProcess::(_processLogs) (8590) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:39,328::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8590) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,329::__init__::225::IOProcess::(_processLogs) (8590) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,330::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:39,331::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,331::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:46:39,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,333::__init__::225::IOProcess::(_processLogs) (8591) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:46:39,334::__init__::225::IOProcess::(_processLogs) (8591) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:46:39,428::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8591) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,428::__init__::225::IOProcess::(_processLogs) (8591) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,428::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,429::__init__::225::IOProcess::(_processLogs) (8592) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:39,430::__init__::225::IOProcess::(_processLogs) (8592) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:39,742::__init__::225::IOProcess::(_processLogs) Message size is 242DEBUG|(8592) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,742::__init__::225::IOProcess::(_processLogs) (8592) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,742::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:39,742::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) (8593) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:39,743::__init__::225::IOProcess::(_processLogs) (8593) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:39,910::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8593) Building response >Thread-19::DEBUG::2014-09-09 11:46:39,910::__init__::225::IOProcess::(_processLogs) (8593) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:39,910::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:39,910::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) (8594) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:39,911::__init__::225::IOProcess::(_processLogs) (8594) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:40,086::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8594) Building response >Thread-19::DEBUG::2014-09-09 11:46:40,086::__init__::225::IOProcess::(_processLogs) (8594) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,086::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:40,087::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:40,087::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:40,087::__init__::225::IOProcess::(_processLogs) Message size is 559 >Thread-19::DEBUG::2014-09-09 11:46:40,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,087::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:40,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,088::__init__::225::IOProcess::(_processLogs) (8595) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:40,088::__init__::225::IOProcess::(_processLogs) (8595) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:40,431::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8595) Building response >Thread-19::DEBUG::2014-09-09 11:46:40,431::__init__::225::IOProcess::(_processLogs) (8595) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,431::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:40,431::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Message size is 747 >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) (8596) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:40,432::__init__::225::IOProcess::(_processLogs) (8596) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:40,587::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8596) Building response >Thread-19::DEBUG::2014-09-09 11:46:40,587::__init__::225::IOProcess::(_processLogs) (8596) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,587::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:40,588::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:40,588::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:40,588::__init__::225::IOProcess::(_processLogs) Message size is 663 >Thread-19::DEBUG::2014-09-09 11:46:40,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,588::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:40,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,589::__init__::225::IOProcess::(_processLogs) (8597) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:40,589::__init__::225::IOProcess::(_processLogs) (8597) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:40,829::__init__::225::IOProcess::(_processLogs) (8597) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,829::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:40,829::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:40,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:40,830::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:40,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) (8598) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) (8598) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) (8598) Building response >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) (8598) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:40,831::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) (8599) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:40,832::__init__::225::IOProcess::(_processLogs) (8599) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:40,919::__init__::225::IOProcess::(_processLogs) (8599) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,920::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:40,920::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:40,920::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:46:40,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,921::__init__::225::IOProcess::(_processLogs) (8600) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:40,921::__init__::225::IOProcess::(_processLogs) (8600) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:40,923::__init__::225::IOProcess::(_processLogs) (8600) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,924::__init__::225::IOProcess::(_processLogs) (8601) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:40,925::__init__::225::IOProcess::(_processLogs) (8601) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:40,928::__init__::225::IOProcess::(_processLogs) (8601) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,928::__init__::225::IOProcess::(_processLogs) Sending response sized 289 >Thread-19::DEBUG::2014-09-09 11:46:40,928::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:40,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) (8602) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) (8602) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) (8602) Building response >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) (8602) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:40,929::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:40,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:40,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:40,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:40,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:40,930::__init__::225::IOProcess::(_processLogs) (8603) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:40,930::__init__::225::IOProcess::(_processLogs) (8603) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:41,088::__init__::225::IOProcess::(_processLogs) (8603) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,088::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,088::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) (8604) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) (8604) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) (8604) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,089::__init__::225::IOProcess::(_processLogs) (8604) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) (8605) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:41,090::__init__::225::IOProcess::(_processLogs) (8605) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:41,091::__init__::225::IOProcess::(_processLogs) (8605) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,092::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,092::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:41,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) (8606) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) (8606) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) (8606) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) (8606) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,094::__init__::225::IOProcess::(_processLogs) (8607) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:41,094::__init__::225::IOProcess::(_processLogs) (8607) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:41,095::__init__::225::IOProcess::(_processLogs) (8607) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,095::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,095::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:46:41,095::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) (8608) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) (8608) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) (8608) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) (8608) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,096::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) (8609) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) (8609) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:41,097::__init__::225::IOProcess::(_processLogs) (8609) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,098::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,098::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:41,098::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) (8610) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) (8610) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) (8610) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) (8610) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:41,099::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) (8611) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) (8611) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) (8611) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,100::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) (8612) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:46:41,101::__init__::225::IOProcess::(_processLogs) (8612) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:46:41,140::__init__::225::IOProcess::(_processLogs) (8612) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,140::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) (8613) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:46:41,141::__init__::225::IOProcess::(_processLogs) (8613) Got request for method 'lexists' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:41,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:41,211::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3954::DEBUG::2014-09-09 11:46:41,212::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:41,230::__init__::225::IOProcess::(_processLogs) (8613) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,231::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:46:41,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:41,464::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:41,465::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:41,466::__init__::225::IOProcess::(_processLogs) Message size is 434 >Thread-19::DEBUG::2014-09-09 11:46:41,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,467::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,467::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,468::__init__::225::IOProcess::(_processLogs) (8614) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:41,469::__init__::225::IOProcess::(_processLogs) (8614) Got request for method 'rename' >Dummy-97::DEBUG::2014-09-09 11:46:41,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122053 s, 8.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:41,555::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8614) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,555::__init__::225::IOProcess::(_processLogs) (8614) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,555::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,557::__init__::225::IOProcess::(_processLogs) (8615) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:41,557::__init__::225::IOProcess::(_processLogs) (8615) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:41,557::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8615) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,557::__init__::225::IOProcess::(_processLogs) (8615) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,558::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:41,558::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:46:41,558::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,558::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:41,558::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) (8616) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) (8616) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:41,559::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8616) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,560::__init__::225::IOProcess::(_processLogs) (8616) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,560::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,560::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:41,560::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:41,560::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:41,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) (8617) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) (8617) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) (8617) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) (8617) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,561::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) (8618) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:46:41,562::__init__::225::IOProcess::(_processLogs) (8618) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:46:41,563::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8618) Building response >Thread-19::DEBUG::2014-09-09 11:46:41,563::__init__::225::IOProcess::(_processLogs) (8618) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:41,563::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) (8619) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:41,564::__init__::225::IOProcess::(_processLogs) (8619) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:42,020::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8619) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,020::__init__::225::IOProcess::(_processLogs) (8619) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,020::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,021::__init__::225::IOProcess::(_processLogs) (8620) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:42,022::__init__::225::IOProcess::(_processLogs) (8620) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:42,249::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8620) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,249::__init__::225::IOProcess::(_processLogs) (8620) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,249::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,250::__init__::225::IOProcess::(_processLogs) (8621) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:42,251::__init__::225::IOProcess::(_processLogs) (8621) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:42,492::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8621) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,493::__init__::225::IOProcess::(_processLogs) (8621) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,493::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Message size is 811 >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) (8622) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:42,494::__init__::225::IOProcess::(_processLogs) (8622) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:42,741::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(8622) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,741::__init__::225::IOProcess::(_processLogs) (8622) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,741::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) (8623) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) (8623) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:42,742::__init__::225::IOProcess::(_processLogs) (8623) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,743::__init__::225::IOProcess::(_processLogs) (8623) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,743::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:42,743::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:42,743::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) (8624) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:42,744::__init__::225::IOProcess::(_processLogs) (8624) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:42,745::__init__::225::IOProcess::(_processLogs) DEBUG|(8624) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,745::__init__::225::IOProcess::(_processLogs) (8624) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,745::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:42,745::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:42,746::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:42,746::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,746::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:46:42,746::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,747::__init__::225::IOProcess::(_processLogs) (8625) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:42,747::__init__::225::IOProcess::(_processLogs) (8625) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:42,749::__init__::225::IOProcess::(_processLogs) DEBUG|(8625) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,749::__init__::225::IOProcess::(_processLogs) (8625) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,749::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,749::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:42,749::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) (8626) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:42,750::__init__::225::IOProcess::(_processLogs) (8626) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:42,753::__init__::225::IOProcess::(_processLogs) DEBUG|(8626) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,753::__init__::225::IOProcess::(_processLogs) (8626) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,753::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,754::__init__::225::IOProcess::(_processLogs) Sending response sized 338 >Thread-19::DEBUG::2014-09-09 11:46:42,754::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,754::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:42,754::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,754::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) (8627) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) (8627) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) (8627) Building response >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) (8627) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:42,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:42,756::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:42,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:42,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:42,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:42,756::__init__::225::IOProcess::(_processLogs) (8628) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:42,756::__init__::225::IOProcess::(_processLogs) (8628) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:43,074::__init__::225::IOProcess::(_processLogs) DEBUG|(8628) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,074::__init__::225::IOProcess::(_processLogs) (8628) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,074::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) (8629) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:43,075::__init__::225::IOProcess::(_processLogs) (8629) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) (8629) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) (8629) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:43,076::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,077::__init__::225::IOProcess::(_processLogs) (8630) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:43,077::__init__::225::IOProcess::(_processLogs) (8630) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:43,078::__init__::225::IOProcess::(_processLogs) DEBUG|(8630) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,078::__init__::225::IOProcess::(_processLogs) (8630) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,078::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,078::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,079::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,079::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:46:43,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,079::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) (8631) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) (8631) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) (8631) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) (8631) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:46:43,080::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) (8632) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) (8632) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) DEBUG|(8632) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,081::__init__::225::IOProcess::(_processLogs) (8632) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,082::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,082::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,082::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,082::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:43,082::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) (8633) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) (8633) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) (8633) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) (8633) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,083::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) (8634) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:43,084::__init__::225::IOProcess::(_processLogs) (8634) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) DEBUG|(8634) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) (8634) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:46:43,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) (8635) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) (8635) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) (8635) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,086::__init__::225::IOProcess::(_processLogs) (8635) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) (8636) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:43,087::__init__::225::IOProcess::(_processLogs) (8636) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:43,088::__init__::225::IOProcess::(_processLogs) DEBUG|(8636) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,088::__init__::225::IOProcess::(_processLogs) (8636) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,088::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) (8637) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) (8637) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) (8637) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) (8637) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) (8638) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) (8638) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) DEBUG|(8638) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) (8638) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,091::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) (8639) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:46:43,092::__init__::225::IOProcess::(_processLogs) (8639) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:46:43,093::__init__::225::IOProcess::(_processLogs) DEBUG|(8639) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,093::__init__::225::IOProcess::(_processLogs) (8639) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,093::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,093::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,093::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) (8640) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) (8640) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) DEBUG|(8640) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,094::__init__::225::IOProcess::(_processLogs) (8640) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,095::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:43,095::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' >Thread-19::DEBUG::2014-09-09 11:46:43,095::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:43,096::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' (0 active users) >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:43,096::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' is free, finding out if anyone is waiting for it. >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:43,096::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008', Clearing records. >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:43,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::moving from state running -> state finished >Thread-19::DEBUG::2014-09-09 11:46:43,096::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,096::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:46:43,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) (8641) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) (8641) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) DEBUG|(8641) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) (8641) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,097::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:43,097::task::752::Storage.TaskManager.Task::(_save) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/ba8a3b14-3bfa-4994-80e6-82489e7f6be2.temp >Thread-19::DEBUG::2014-09-09 11:46:43,098::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,098::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:43,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,098::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) (8642) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) (8642) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) DEBUG|(8642) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) (8642) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,099::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) (8643) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) (8643) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) (8643) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) (8643) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,102::__init__::225::IOProcess::(_processLogs) (8644) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:46:43,102::__init__::225::IOProcess::(_processLogs) (8644) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:46:43,103::__init__::225::IOProcess::(_processLogs) DEBUG|(8644) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,103::__init__::225::IOProcess::(_processLogs) (8644) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,103::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,105::__init__::225::IOProcess::(_processLogs) (8645) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:43,105::__init__::225::IOProcess::(_processLogs) (8645) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:43,434::__init__::225::IOProcess::(_processLogs) DEBUG|(8645) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,434::__init__::225::IOProcess::(_processLogs) (8645) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,434::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) Message size is 396 >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) (8646) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:43,435::__init__::225::IOProcess::(_processLogs) (8646) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:46:43,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:43,530::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,530::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) (8647) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:43,531::__init__::225::IOProcess::(_processLogs) (8647) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:43,614::__init__::225::IOProcess::(_processLogs) DEBUG|(8647) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,615::__init__::225::IOProcess::(_processLogs) (8647) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,616::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:46:43,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:43,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970286 s, 10.6 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:46:43,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00103149 s, 344 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:43,625::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,626::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:43,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,628::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,629::__init__::225::IOProcess::(_processLogs) (8648) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:43,630::__init__::225::IOProcess::(_processLogs) (8648) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:43,630::__init__::225::IOProcess::(_processLogs) (8648) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,631::__init__::225::IOProcess::(_processLogs) (8648) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,631::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:43,665::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:43,666::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3955::DEBUG::2014-09-09 11:46:43,666::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3955::DEBUG::2014-09-09 11:46:43,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbcdef55-8662-4174-b361-204d2072e3a4`::moving from state init -> state preparing >Thread-3955::INFO::2014-09-09 11:46:43,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3955::INFO::2014-09-09 11:46:43,667::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3955::DEBUG::2014-09-09 11:46:43,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbcdef55-8662-4174-b361-204d2072e3a4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3955::DEBUG::2014-09-09 11:46:43,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbcdef55-8662-4174-b361-204d2072e3a4`::moving from state preparing -> state finished >Thread-3955::DEBUG::2014-09-09 11:46:43,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3955::DEBUG::2014-09-09 11:46:43,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3955::DEBUG::2014-09-09 11:46:43,667::task::993::Storage.TaskManager.Task::(_decref) Task=`dbcdef55-8662-4174-b361-204d2072e3a4`::ref 0 aborting False >Thread-3955::DEBUG::2014-09-09 11:46:43,667::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3955::DEBUG::2014-09-09 11:46:43,668::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:43,693::__init__::225::IOProcess::(_processLogs) DEBUG|(8646) Building response >Thread-19::DEBUG::2014-09-09 11:46:43,693::__init__::225::IOProcess::(_processLogs) (8646) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:43,693::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:43,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:43,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:43,695::__init__::225::IOProcess::(_processLogs) (8649) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:43,695::__init__::225::IOProcess::(_processLogs) (8649) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:43,782::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:43,783::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3956::DEBUG::2014-09-09 11:46:43,783::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3956::DEBUG::2014-09-09 11:46:43,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac60ba8b-2dbc-41d5-9067-841564ea5082`::moving from state init -> state preparing >Thread-3956::INFO::2014-09-09 11:46:43,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3956::DEBUG::2014-09-09 11:46:43,784::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0078585d-972f-4180-9841-80e848374144`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3956::DEBUG::2014-09-09 11:46:43,784::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3956::DEBUG::2014-09-09 11:46:43,784::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3956::DEBUG::2014-09-09 11:46:43,784::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0078585d-972f-4180-9841-80e848374144`::Granted request >Thread-3956::DEBUG::2014-09-09 11:46:43,784::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac60ba8b-2dbc-41d5-9067-841564ea5082`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3956::DEBUG::2014-09-09 11:46:43,784::task::993::Storage.TaskManager.Task::(_decref) Task=`ac60ba8b-2dbc-41d5-9067-841564ea5082`::ref 1 aborting False >Thread-3956::INFO::2014-09-09 11:46:43,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283175288832', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283219329024', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283137540096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3956::DEBUG::2014-09-09 11:46:43,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac60ba8b-2dbc-41d5-9067-841564ea5082`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283175288832', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283219329024', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283137540096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3956::DEBUG::2014-09-09 11:46:43,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac60ba8b-2dbc-41d5-9067-841564ea5082`::moving from state preparing -> state finished >Thread-3956::DEBUG::2014-09-09 11:46:43,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3956::DEBUG::2014-09-09 11:46:43,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3956::DEBUG::2014-09-09 11:46:43,787::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3956::DEBUG::2014-09-09 11:46:43,787::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3956::DEBUG::2014-09-09 11:46:43,787::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3956::DEBUG::2014-09-09 11:46:43,787::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3956::DEBUG::2014-09-09 11:46:43,787::task::993::Storage.TaskManager.Task::(_decref) Task=`ac60ba8b-2dbc-41d5-9067-841564ea5082`::ref 0 aborting False >Thread-3956::DEBUG::2014-09-09 11:46:43,787::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283175288832', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283219329024', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283137540096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3956::DEBUG::2014-09-09 11:46:43,787::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:44,158::__init__::225::IOProcess::(_processLogs) DEBUG|(8649) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,159::__init__::225::IOProcess::(_processLogs) (8649) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,159::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:44,160::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,160::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:46:44,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,160::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,161::__init__::225::IOProcess::(_processLogs) (8650) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:44,161::__init__::225::IOProcess::(_processLogs) (8650) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:44,221::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:44,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3957::DEBUG::2014-09-09 11:46:44,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9ee131e-b069-480d-8c79-a60643f81270`::moving from state init -> state preparing >Thread-3957::INFO::2014-09-09 11:46:44,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3957::INFO::2014-09-09 11:46:44,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109562', 'lastCheck': '4.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000931814', 'lastCheck': '9.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103149', 'lastCheck': '0.6', 'valid': True}} >Thread-3957::DEBUG::2014-09-09 11:46:44,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9ee131e-b069-480d-8c79-a60643f81270`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109562', 'lastCheck': '4.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000931814', 'lastCheck': '9.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103149', 'lastCheck': '0.6', 'valid': True}} >Thread-3957::DEBUG::2014-09-09 11:46:44,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9ee131e-b069-480d-8c79-a60643f81270`::moving from state preparing -> state finished >Thread-3957::DEBUG::2014-09-09 11:46:44,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3957::DEBUG::2014-09-09 11:46:44,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3957::DEBUG::2014-09-09 11:46:44,224::task::993::Storage.TaskManager.Task::(_decref) Task=`b9ee131e-b069-480d-8c79-a60643f81270`::ref 0 aborting False >Thread-3957::DEBUG::2014-09-09 11:46:44,224::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:44,319::utils::790::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['128+0 records in', '128+0 records out', '134217728 bytes (134 MB) copied, 60.6737 s, 2.2 MB/s']; <rc> = 0 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:44,319::misc::262::Storage.Misc::(validateDDBytes) err: ['128+0 records in', '128+0 records out', '134217728 bytes (134 MB) copied, 60.6737 s, 2.2 MB/s'], size: 134217728 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::INFO::2014-09-09 11:46:44,320::fileVolume::133::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f/images/9b58299d-0e4c-4799-ba1d-57760aad1bd8/94f6b335-3794-4683-bfe7-6bdca8bc02e2 with size = 262144 sectors >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) Message size is 242 >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,321::__init__::225::IOProcess::(_processLogs) (8651) Finding callback 'chmod'... >Thread-19::DEBUG::2014-09-09 11:46:44,321::__init__::225::IOProcess::(_processLogs) (8651) Got request for method 'chmod' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:44,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:44,355::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3958::DEBUG::2014-09-09 11:46:44,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:44,565::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3959::DEBUG::2014-09-09 11:46:44,566::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >JsonRpcServer::DEBUG::2014-09-09 11:46:44,566::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3959::DEBUG::2014-09-09 11:46:44,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fbad65-a55e-44a0-92ed-3e3bb8a9bf0f`::moving from state init -> state preparing >Thread-3959::INFO::2014-09-09 11:46:44,567::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3959::DEBUG::2014-09-09 11:46:44,567::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3959::DEBUG::2014-09-09 11:46:44,567::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3959::DEBUG::2014-09-09 11:46:44,567::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3959::DEBUG::2014-09-09 11:46:44,567::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3959::DEBUG::2014-09-09 11:46:44,567::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3959::DEBUG::2014-09-09 11:46:44,568::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3959::INFO::2014-09-09 11:46:44,568::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3959::DEBUG::2014-09-09 11:46:44,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`83fbad65-a55e-44a0-92ed-3e3bb8a9bf0f`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3959::DEBUG::2014-09-09 11:46:44,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fbad65-a55e-44a0-92ed-3e3bb8a9bf0f`::moving from state preparing -> state finished >Thread-3959::DEBUG::2014-09-09 11:46:44,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3959::DEBUG::2014-09-09 11:46:44,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3959::DEBUG::2014-09-09 11:46:44,568::task::993::Storage.TaskManager.Task::(_decref) Task=`83fbad65-a55e-44a0-92ed-3e3bb8a9bf0f`::ref 0 aborting False >Thread-3959::DEBUG::2014-09-09 11:46:44,568::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3959::DEBUG::2014-09-09 11:46:44,568::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:44,632::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,632::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:44,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,632::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) (8652) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) (8652) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) DEBUG|(8652) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) (8652) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,633::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,634::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:46:44,634::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:46:44,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000917371 s, 597 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) (8653) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) (8653) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:44,642::__init__::225::IOProcess::(_processLogs) DEBUG|(8653) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,643::__init__::225::IOProcess::(_processLogs) (8653) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,643::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,643::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:44,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) (8654) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) (8654) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:44,644::__init__::225::IOProcess::(_processLogs) DEBUG|(8654) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) (8654) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) (8655) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) (8655) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) DEBUG|(8655) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) (8655) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,646::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,647::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:44,647::__init__::225::IOProcess::(_processLogs) DEBUG|(8650) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) (8650) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) (8656) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) Message size is 811 >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) (8656) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) (8656) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,649::__init__::225::IOProcess::(_processLogs) (8656) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,650::__init__::225::IOProcess::(_processLogs) DEBUGGenerating json...DEBUG >Thread-19::DEBUG::2014-09-09 11:46:44,650::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:44,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,650::__init__::225::IOProcess::(_processLogs) (8657) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:44,650::__init__::225::IOProcess::(_processLogs) (8657) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:44,894::__init__::225::IOProcess::(_processLogs) DEBUG|(8651) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,894::__init__::225::IOProcess::(_processLogs) (8651) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,894::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:44,895::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,895::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:46:44,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,895::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) (8658) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) (8658) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) (8658) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) (8658) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,896::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) (8659) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) (8659) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) DEBUG|(8659) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,897::__init__::225::IOProcess::(_processLogs) (8659) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,898::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:44,898::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:46:44,898::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) (8660) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:44,899::__init__::225::IOProcess::(_processLogs) (8660) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) DEBUG|(8660) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) (8660) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:44,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) (8661) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) (8661) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) (8661) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) (8661) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) (8662) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:46:44,902::__init__::225::IOProcess::(_processLogs) (8662) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:46:44,904::__init__::225::IOProcess::(_processLogs) DEBUG|(8662) Building response >Thread-19::DEBUG::2014-09-09 11:46:44,904::__init__::225::IOProcess::(_processLogs) (8662) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:44,904::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:44,904::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) (8663) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:44,905::__init__::225::IOProcess::(_processLogs) (8663) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:45,014::__init__::225::IOProcess::(_processLogs) DEBUG|(8657) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,014::__init__::225::IOProcess::(_processLogs) (8657) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,014::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,014::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:45,014::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,014::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:45,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,015::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:45,015::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:45,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) (8664) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) (8664) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) (8664) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) (8664) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:46:45,016::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) (8665) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:45,017::__init__::225::IOProcess::(_processLogs) (8665) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:45,034::__init__::225::IOProcess::(_processLogs) DEBUG|(8665) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,034::__init__::225::IOProcess::(_processLogs) (8665) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,034::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::WARNING::2014-09-09 11:46:45,035::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:45,035::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,035::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) (8666) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:45,036::__init__::225::IOProcess::(_processLogs) (8666) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:45,038::__init__::225::IOProcess::(_processLogs) DEBUG|(8666) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) (8666) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,039::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,040::__init__::225::IOProcess::(_processLogs) (8667) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:45,040::__init__::225::IOProcess::(_processLogs) (8667) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:45,043::__init__::225::IOProcess::(_processLogs) DEBUG|(8667) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,043::__init__::225::IOProcess::(_processLogs) (8667) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,043::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,043::__init__::225::IOProcess::(_processLogs) Sending response sized 240 >Thread-19::DEBUG::2014-09-09 11:46:45,043::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,043::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) (8668) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) (8668) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:45,044::__init__::225::IOProcess::(_processLogs) (8668) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) (8668) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) (8669) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:45,045::__init__::225::IOProcess::(_processLogs) (8669) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:45,363::__init__::225::IOProcess::(_processLogs) DEBUG|(8669) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,363::__init__::225::IOProcess::(_processLogs) (8669) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,364::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,364::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,364::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,364::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:46:45,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,365::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) (8670) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) (8670) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) (8670) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) (8670) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,366::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,367::__init__::225::IOProcess::(_processLogs) (8671) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:45,367::__init__::225::IOProcess::(_processLogs) (8671) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:45,368::__init__::225::IOProcess::(_processLogs) DEBUG|(8671) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,368::__init__::225::IOProcess::(_processLogs) (8671) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,368::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,368::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,369::__init__::225::IOProcess::(_processLogs) (8672) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) (8672) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) (8672) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) (8672) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,371::__init__::225::IOProcess::(_processLogs) (8673) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:45,371::__init__::225::IOProcess::(_processLogs) (8673) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:45,371::__init__::225::IOProcess::(_processLogs) DEBUG|(8673) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,371::__init__::225::IOProcess::(_processLogs) (8673) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,371::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) (8674) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) (8674) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) (8674) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) (8674) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,373::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,374::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,374::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,374::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,374::__init__::225::IOProcess::(_processLogs) (8675) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:45,374::__init__::225::IOProcess::(_processLogs) (8675) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:45,375::__init__::225::IOProcess::(_processLogs) DEBUG|(8675) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,375::__init__::225::IOProcess::(_processLogs) (8675) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,375::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,375::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,375::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,375::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) (8676) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) (8676) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) DEBUG|(8676) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,376::__init__::225::IOProcess::(_processLogs) (8676) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,378::__init__::225::IOProcess::(_processLogs) (8677) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:46:45,378::__init__::225::IOProcess::(_processLogs) (8677) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:46:45,378::__init__::225::IOProcess::(_processLogs) DEBUG|(8677) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,378::__init__::225::IOProcess::(_processLogs) (8677) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,378::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-09-09 11:46:45,379::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,379::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,379::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (1 active users) >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,379::task::916::Storage.TaskManager.Task::(_runJobs) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::Task.run: exit - success: result {'uuid': u'7a8d5544-0400-4021-bab0-deb0c0958ca6'} >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,380::task::993::Storage.TaskManager.Task::(_decref) Task=`ba8a3b14-3bfa-4994-80e6-82489e7f6be2`::ref 0 aborting False >ba8a3b14-3bfa-4994-80e6-82489e7f6be2::DEBUG::2014-09-09 11:46:45,380::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-19::DEBUG::2014-09-09 11:46:45,460::__init__::225::IOProcess::(_processLogs) DEBUG|(8663) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,460::__init__::225::IOProcess::(_processLogs) (8663) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,460::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,460::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) (8678) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:45,461::__init__::225::IOProcess::(_processLogs) (8678) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:45,581::__init__::225::IOProcess::(_processLogs) DEBUG|(8678) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,581::__init__::225::IOProcess::(_processLogs) (8678) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,581::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,581::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:45,581::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) (8679) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:45,582::__init__::225::IOProcess::(_processLogs) (8679) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:46:45,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:45,733::__init__::225::IOProcess::(_processLogs) DEBUG|(8679) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,734::__init__::225::IOProcess::(_processLogs) (8679) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,735::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:45,737::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,737::__init__::225::IOProcess::(_processLogs) Message size is 559 >Thread-19::DEBUG::2014-09-09 11:46:45,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,740::__init__::225::IOProcess::(_processLogs) (8680) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:45,740::__init__::225::IOProcess::(_processLogs) (8680) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:46:45,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0965738 s, 10.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:45,889::__init__::225::IOProcess::(_processLogs) DEBUG|(8680) Building response >Thread-19::DEBUG::2014-09-09 11:46:45,890::__init__::225::IOProcess::(_processLogs) (8680) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:45,890::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:45,890::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:45,890::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:45,890::__init__::225::IOProcess::(_processLogs) Message size is 747 >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) (8681) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:45,891::__init__::225::IOProcess::(_processLogs) (8681) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:46,007::__init__::225::IOProcess::(_processLogs) DEBUG|(8681) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,007::__init__::225::IOProcess::(_processLogs) (8681) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,007::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) Message size is 663 >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,008::__init__::225::IOProcess::(_processLogs) (8682) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:46,009::__init__::225::IOProcess::(_processLogs) (8682) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:46,140::__init__::225::IOProcess::(_processLogs) DEBUG|(8682) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,140::__init__::225::IOProcess::(_processLogs) (8682) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,141::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,141::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:46,141::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,141::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:46,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,142::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:46,142::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:46,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) (8683) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) (8683) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) (8683) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) (8683) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:46:46,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) (8684) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) (8684) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:46,144::__init__::225::IOProcess::(_processLogs) DEBUG|(8684) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,145::__init__::225::IOProcess::(_processLogs) (8684) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,145::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:46,145::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:46,145::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) (8685) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:46,146::__init__::225::IOProcess::(_processLogs) (8685) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:46,148::__init__::225::IOProcess::(_processLogs) DEBUG|(8685) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,148::__init__::225::IOProcess::(_processLogs) (8685) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,150::__init__::225::IOProcess::(_processLogs) (8686) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:46,150::__init__::225::IOProcess::(_processLogs) (8686) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) DEBUG|(8686) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) (8686) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) Sending response sized 289 >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:46,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) (8687) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) (8687) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) (8687) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) (8687) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) (8688) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:46,155::__init__::225::IOProcess::(_processLogs) (8688) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:46,391::__init__::225::IOProcess::(_processLogs) DEBUG|(8688) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,391::__init__::225::IOProcess::(_processLogs) (8688) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,391::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,391::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,392::__init__::225::IOProcess::(_processLogs) (8689) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) (8689) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) (8689) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) (8689) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,394::__init__::225::IOProcess::(_processLogs) (8690) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:46,394::__init__::225::IOProcess::(_processLogs) (8690) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:46,395::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8690) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,395::__init__::225::IOProcess::(_processLogs) (8690) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,395::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,395::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,395::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,395::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) (8691) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) (8691) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) (8691) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) (8691) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) (8692) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:46,397::__init__::225::IOProcess::(_processLogs) (8692) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:46,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8692) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,398::__init__::225::IOProcess::(_processLogs) (8692) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,398::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,398::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) (8693) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) (8693) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) (8693) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,399::__init__::225::IOProcess::(_processLogs) (8693) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) (8694) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:46,400::__init__::225::IOProcess::(_processLogs) (8694) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:46,401::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8694) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,401::__init__::225::IOProcess::(_processLogs) (8694) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,401::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,401::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,401::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) (8695) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) (8695) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:46,402::__init__::225::IOProcess::(_processLogs) (8695) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) (8695) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,403::__init__::225::IOProcess::(_processLogs) (8696) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:46,404::__init__::225::IOProcess::(_processLogs) (8696) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8696) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) (8696) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) (8697) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) (8697) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8697) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,406::__init__::225::IOProcess::(_processLogs) (8697) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,407::__init__::225::IOProcess::(_processLogs) (8698) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:46:46,408::__init__::225::IOProcess::(_processLogs) (8698) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:46:46,408::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8698) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,408::__init__::225::IOProcess::(_processLogs) (8698) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,408::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,408::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:46,566::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Message size is 434 >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) (8699) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:46,567::__init__::225::IOProcess::(_processLogs) (8699) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:46,568::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8699) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,568::__init__::225::IOProcess::(_processLogs) (8699) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,569::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,569::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,569::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,569::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:46:46,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,569::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) (8700) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) (8700) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8700) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) (8700) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,570::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:46,570::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:46:46,571::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,571::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) (8701) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:46,572::__init__::225::IOProcess::(_processLogs) (8701) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:46,573::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8701) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,573::__init__::225::IOProcess::(_processLogs) (8701) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,573::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,573::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:46,573::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) (8702) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:46,574::__init__::225::IOProcess::(_processLogs) (8702) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) (8702) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) (8702) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,576::__init__::225::IOProcess::(_processLogs) (8703) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:46:46,576::__init__::225::IOProcess::(_processLogs) (8703) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:46:46,576::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8703) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,576::__init__::225::IOProcess::(_processLogs) (8703) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,576::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,577::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:46,577::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,577::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:46:46,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,578::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,578::__init__::225::IOProcess::(_processLogs) (8704) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:46,578::__init__::225::IOProcess::(_processLogs) (8704) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:46,909::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8704) Building response >Thread-19::DEBUG::2014-09-09 11:46:46,909::__init__::225::IOProcess::(_processLogs) (8704) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:46,909::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) (8705) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:46,910::__init__::225::IOProcess::(_processLogs) (8705) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:47,051::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8705) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,051::__init__::225::IOProcess::(_processLogs) (8705) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,051::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) (8706) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:47,052::__init__::225::IOProcess::(_processLogs) (8706) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:47,335::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8706) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,335::__init__::225::IOProcess::(_processLogs) (8706) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,335::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,336::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:47,336::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,336::__init__::225::IOProcess::(_processLogs) Message size is 811 >Thread-19::DEBUG::2014-09-09 11:46:47,336::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,337::__init__::225::IOProcess::(_processLogs) (8707) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:47,337::__init__::225::IOProcess::(_processLogs) (8707) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:47,469::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8707) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,469::__init__::225::IOProcess::(_processLogs) (8707) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,469::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:47,470::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,470::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:47,470::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:47,470::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) (8708) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) (8708) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:47,471::__init__::225::IOProcess::(_processLogs) (8708) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) (8708) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,472::__init__::225::IOProcess::(_processLogs) (8709) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:47,473::__init__::225::IOProcess::(_processLogs) (8709) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:47,473::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8709) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,473::__init__::225::IOProcess::(_processLogs) (8709) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,473::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:47,473::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:47,474::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,474::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,474::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:46:47,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,474::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,475::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,475::__init__::225::IOProcess::(_processLogs) (8710) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:47,475::__init__::225::IOProcess::(_processLogs) (8710) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8710) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) (8710) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:47,477::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,478::__init__::225::IOProcess::(_processLogs) (8711) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:47,478::__init__::225::IOProcess::(_processLogs) (8711) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:47,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8711) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,481::__init__::225::IOProcess::(_processLogs) (8711) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,481::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,482::__init__::225::IOProcess::(_processLogs) Sending response sized 338 >Thread-19::DEBUG::2014-09-09 11:46:47,482::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,482::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:47,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,482::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,483::__init__::225::IOProcess::(_processLogs) (8712) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:47,483::__init__::225::IOProcess::(_processLogs) (8712) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) (8712) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) (8712) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,485::__init__::225::IOProcess::(_processLogs) (8713) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:47,485::__init__::225::IOProcess::(_processLogs) (8713) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:47,610::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8713) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,610::__init__::225::IOProcess::(_processLogs) (8713) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,611::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,611::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,611::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,611::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:46:47,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,611::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) (8714) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) (8714) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) (8714) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) (8714) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:47,612::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) (8715) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:47,613::__init__::225::IOProcess::(_processLogs) (8715) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:47,614::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8715) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,614::__init__::225::IOProcess::(_processLogs) (8715) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,614::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) (8716) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) (8716) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) (8716) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) (8716) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,617::__init__::225::IOProcess::(_processLogs) (8717) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:47,617::__init__::225::IOProcess::(_processLogs) (8717) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:47,617::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8717) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,617::__init__::225::IOProcess::(_processLogs) (8717) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,617::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) (8718) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) (8718) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) (8718) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) (8718) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,619::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,620::__init__::225::IOProcess::(_processLogs) (8719) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:47,620::__init__::225::IOProcess::(_processLogs) (8719) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8719) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) (8719) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:47,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) (8720) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) (8720) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) (8720) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) (8720) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,622::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) (8721) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) (8721) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:47,623::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8721) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,624::__init__::225::IOProcess::(_processLogs) (8721) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,624::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,624::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:47,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) (8722) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) (8722) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) (8722) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) (8722) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,625::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) (8723) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:47,626::__init__::225::IOProcess::(_processLogs) (8723) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8723) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) (8723) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:46:47,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) (8724) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) (8724) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8724) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,628::__init__::225::IOProcess::(_processLogs) (8724) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,630::__init__::225::IOProcess::(_processLogs) (8725) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:46:47,630::__init__::225::IOProcess::(_processLogs) (8725) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:46:47,630::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8725) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,630::__init__::225::IOProcess::(_processLogs) (8725) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,630::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:47,631::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' >Thread-19::DEBUG::2014-09-09 11:46:47,631::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:47,631::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' (0 active users) >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:47,632::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' is free, finding out if anyone is waiting for it. >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:47,632::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8', Clearing records. >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:47,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::moving from state running -> state finished >Thread-19::DEBUG::2014-09-09 11:46:47,632::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,632::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:46:47,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,632::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) (8726) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) (8726) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8726) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) (8726) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,633::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:47,633::task::752::Storage.TaskManager.Task::(_save) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::_save: orig /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5 temp /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/master/tasks/94ac3a4e-5e52-478a-9fba-6b5d490488c5.temp >Thread-19::DEBUG::2014-09-09 11:46:47,634::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,634::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,634::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:47,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,634::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,635::__init__::225::IOProcess::(_processLogs) (8727) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:47,635::__init__::225::IOProcess::(_processLogs) (8727) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:47,635::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8727) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,636::__init__::225::IOProcess::(_processLogs) (8727) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,636::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,636::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:47,636::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,636::__init__::225::IOProcess::(_processLogs) Message size is 187 >Thread-19::DEBUG::2014-09-09 11:46:47,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) (8728) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) (8728) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) (8728) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) (8728) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Sending response sized 75 >Thread-19::DEBUG::2014-09-09 11:46:47,637::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) Message size is 188 >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) (8729) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-09-09 11:46:47,638::__init__::225::IOProcess::(_processLogs) (8729) Got request for method 'mkdir' >Thread-19::DEBUG::2014-09-09 11:46:47,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8729) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,639::__init__::225::IOProcess::(_processLogs) (8729) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,640::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:47,640::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,640::__init__::225::IOProcess::(_processLogs) Message size is 650 >Thread-19::DEBUG::2014-09-09 11:46:47,640::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,640::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,640::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,641::__init__::225::IOProcess::(_processLogs) (8730) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:47,641::__init__::225::IOProcess::(_processLogs) (8730) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 11:46:47,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:47,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895224 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:47,870::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8730) Building response >Thread-19::DEBUG::2014-09-09 11:46:47,870::__init__::225::IOProcess::(_processLogs) (8730) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:47,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:47,870::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:47,870::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) Message size is 396 >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) (8731) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:47,871::__init__::225::IOProcess::(_processLogs) (8731) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:48,020::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8731) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,020::__init__::225::IOProcess::(_processLogs) (8731) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) Message size is 755 >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) (8732) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:48,021::__init__::225::IOProcess::(_processLogs) (8732) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:48,154::__init__::225::IOProcess::(_processLogs) (8732) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,154::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) Message size is 627 >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) (8733) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:48,155::__init__::225::IOProcess::(_processLogs) (8733) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:48,314::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:48,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3960::DEBUG::2014-09-09 11:46:48,316::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:48,429::__init__::225::IOProcess::(_processLogs) (8733) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,429::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) Message size is 811 >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) (8734) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 11:46:48,430::__init__::225::IOProcess::(_processLogs) (8734) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 11:46:48,529::__init__::225::IOProcess::(_processLogs) (8734) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,529::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:46:48,529::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:48,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:48,530::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) (8735) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) (8735) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) (8735) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) (8735) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,531::__init__::225::IOProcess::(_processLogs) Sending response sized 72 >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) (8736) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:48,532::__init__::225::IOProcess::(_processLogs) (8736) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:48,533::__init__::225::IOProcess::(_processLogs) (8736) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,533::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::WARNING::2014-09-09 11:46:48,533::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) Message size is 307 >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) (8737) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:48,534::__init__::225::IOProcess::(_processLogs) (8737) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) (8737) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,538::__init__::225::IOProcess::(_processLogs) (8738) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:46:48,538::__init__::225::IOProcess::(_processLogs) (8738) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:46:48,541::__init__::225::IOProcess::(_processLogs) (8738) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,541::__init__::225::IOProcess::(_processLogs) Sending response sized 240 >Thread-19::DEBUG::2014-09-09 11:46:48,541::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:48,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) (8739) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) (8739) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) (8739) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) (8739) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,542::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) (8740) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:48,543::__init__::225::IOProcess::(_processLogs) (8740) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:48,656::__init__::225::IOProcess::(_processLogs) (8740) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,657::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:48,657::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:46:48,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) (8741) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) (8741) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) (8741) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) (8741) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:48,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) (8742) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) (8742) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8742) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,659::__init__::225::IOProcess::(_processLogs) (8742) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,660::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:48,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,660::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:46:48,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) (8743) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) (8743) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) (8743) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) (8743) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,661::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) (8744) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) (8744) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8744) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,662::__init__::225::IOProcess::(_processLogs) (8744) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,663::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:48,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,663::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-09-09 11:46:48,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) (8745) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) (8745) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) (8745) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) (8745) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-09-09 11:46:48,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) (8746) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) (8746) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8746) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,665::__init__::225::IOProcess::(_processLogs) (8746) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Message size is 177 >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,667::__init__::225::IOProcess::(_processLogs) (8747) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:46:48,667::__init__::225::IOProcess::(_processLogs) (8747) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:46:48,667::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8747) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,667::__init__::225::IOProcess::(_processLogs) (8747) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:48,667::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:48,667::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) (8748) Finding callback 'lexists'... >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) (8748) Got request for method 'lexists' >Thread-19::DEBUG::2014-09-09 11:46:48,668::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8748) Building response >Thread-19::DEBUG::2014-09-09 11:46:48,669::__init__::225::IOProcess::(_processLogs) (8748) Queuing response >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,669::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-09-09 11:46:48,669::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,669::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 11:46:48,669::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,670::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,670::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,670::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,670::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,671::task::916::Storage.TaskManager.Task::(_runJobs) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::Task.run: exit - success: result {'uuid': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2'} >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,671::task::993::Storage.TaskManager.Task::(_decref) Task=`94ac3a4e-5e52-478a-9fba-6b5d490488c5`::ref 0 aborting False >94ac3a4e-5e52-478a-9fba-6b5d490488c5::DEBUG::2014-09-09 11:46:48,671::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-19::DEBUG::2014-09-09 11:46:49,330::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:49,331::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:49,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:49,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:49,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:49,333::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:46:49,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:49,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:49,339::__init__::225::IOProcess::(_processLogs) (8749) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:49,340::__init__::225::IOProcess::(_processLogs) (8749) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:49,340::__init__::225::IOProcess::(_processLogs) (8749) Building response >Thread-19::DEBUG::2014-09-09 11:46:49,341::__init__::225::IOProcess::(_processLogs) (8749) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:49,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:46:49,342::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00118041 s, 951 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:49,342::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:46:49,344::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:49,344::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:49,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:49,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:49,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:49,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:49,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:49,348::__init__::225::IOProcess::(_processLogs) (8750) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:49,349::__init__::225::IOProcess::(_processLogs) (8750) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:49,349::__init__::225::IOProcess::(_processLogs) (8750) Building response >Thread-19::DEBUG::2014-09-09 11:46:49,350::__init__::225::IOProcess::(_processLogs) (8750) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:49,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:49,351::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:46:49,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:49,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.09536 s, 10.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:51,330::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:51,331::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3961::DEBUG::2014-09-09 11:46:51,332::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:52,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:52,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899278 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) (8751) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:53,630::__init__::225::IOProcess::(_processLogs) (8751) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:53,631::__init__::225::IOProcess::(_processLogs) (8751) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:53,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:46:53,631::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:46:53,638::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00107097 s, 331 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:53,638::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) (8752) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) (8752) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:53,639::__init__::225::IOProcess::(_processLogs) (8752) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:53,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:53,640::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:46:54,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:54,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899337 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:54,345::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:54,346::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3962::DEBUG::2014-09-09 11:46:54,347::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:54,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:54,566::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3963::DEBUG::2014-09-09 11:46:54,566::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3963::DEBUG::2014-09-09 11:46:54,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`14db106e-b9b6-4e1c-a5dc-a00e67bf1b1c`::moving from state init -> state preparing >Thread-3963::INFO::2014-09-09 11:46:54,567::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3963::INFO::2014-09-09 11:46:54,567::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3963::DEBUG::2014-09-09 11:46:54,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`14db106e-b9b6-4e1c-a5dc-a00e67bf1b1c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3963::DEBUG::2014-09-09 11:46:54,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`14db106e-b9b6-4e1c-a5dc-a00e67bf1b1c`::moving from state preparing -> state finished >Thread-3963::DEBUG::2014-09-09 11:46:54,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3963::DEBUG::2014-09-09 11:46:54,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3963::DEBUG::2014-09-09 11:46:54,568::task::993::Storage.TaskManager.Task::(_decref) Task=`14db106e-b9b6-4e1c-a5dc-a00e67bf1b1c`::ref 0 aborting False >Thread-3963::DEBUG::2014-09-09 11:46:54,568::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3963::DEBUG::2014-09-09 11:46:54,568::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:46:54,649::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) (8753) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) (8753) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) (8753) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:54,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:46:54,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:46:54,659::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00108802 s, 504 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) (8754) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:54,660::__init__::225::IOProcess::(_processLogs) (8754) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:54,661::__init__::225::IOProcess::(_processLogs) (8754) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:54,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:54,661::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:46:54,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) (8755) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) (8755) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) (8755) Building response >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) (8755) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:54,662::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) (8756) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:54,663::__init__::225::IOProcess::(_processLogs) (8756) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) (8756) Building response >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) (8756) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:54,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) (8757) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) (8757) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) (8757) Building response >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) (8757) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:54,665::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:54,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:54,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3964::DEBUG::2014-09-09 11:46:54,682::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3964::DEBUG::2014-09-09 11:46:54,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff54c235-901d-4cd1-9477-a548bb344f12`::moving from state init -> state preparing >Thread-3964::INFO::2014-09-09 11:46:54,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3964::DEBUG::2014-09-09 11:46:54,683::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0b9aeb82-a142-472e-907d-a30f094442c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3964::DEBUG::2014-09-09 11:46:54,683::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3964::DEBUG::2014-09-09 11:46:54,683::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3964::DEBUG::2014-09-09 11:46:54,684::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0b9aeb82-a142-472e-907d-a30f094442c7`::Granted request >Thread-3964::DEBUG::2014-09-09 11:46:54,684::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff54c235-901d-4cd1-9477-a548bb344f12`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3964::DEBUG::2014-09-09 11:46:54,684::task::993::Storage.TaskManager.Task::(_decref) Task=`ff54c235-901d-4cd1-9477-a548bb344f12`::ref 1 aborting False >Thread-3964::INFO::2014-09-09 11:46:54,685::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283103985664', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283057848320', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283060994048', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3964::DEBUG::2014-09-09 11:46:54,685::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff54c235-901d-4cd1-9477-a548bb344f12`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283103985664', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283057848320', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283060994048', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3964::DEBUG::2014-09-09 11:46:54,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff54c235-901d-4cd1-9477-a548bb344f12`::moving from state preparing -> state finished >Thread-3964::DEBUG::2014-09-09 11:46:54,686::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3964::DEBUG::2014-09-09 11:46:54,686::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3964::DEBUG::2014-09-09 11:46:54,686::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3964::DEBUG::2014-09-09 11:46:54,686::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3964::DEBUG::2014-09-09 11:46:54,686::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3964::DEBUG::2014-09-09 11:46:54,686::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3964::DEBUG::2014-09-09 11:46:54,686::task::993::Storage.TaskManager.Task::(_decref) Task=`ff54c235-901d-4cd1-9477-a548bb344f12`::ref 0 aborting False >Thread-3964::DEBUG::2014-09-09 11:46:54,686::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283103985664', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283057848320', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283060994048', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3964::DEBUG::2014-09-09 11:46:54,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:55,083::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:55,083::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3965::DEBUG::2014-09-09 11:46:55,083::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksStatuses' in bridge with {} >Thread-3965::DEBUG::2014-09-09 11:46:55,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`08f00eee-a664-4b59-874c-8e038c9344f2`::moving from state init -> state preparing >Thread-3965::INFO::2014-09-09 11:46:55,084::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-3965::DEBUG::2014-09-09 11:46:55,084::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-3965::DEBUG::2014-09-09 11:46:55,084::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-3965::DEBUG::2014-09-09 11:46:55,084::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3965::DEBUG::2014-09-09 11:46:55,084::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-3965::DEBUG::2014-09-09 11:46:55,084::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >Thread-3965::DEBUG::2014-09-09 11:46:55,084::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3965::INFO::2014-09-09 11:46:55,084::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3965::DEBUG::2014-09-09 11:46:55,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`08f00eee-a664-4b59-874c-8e038c9344f2`::finished: {'allTasksStatus': {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}}} >Thread-3965::DEBUG::2014-09-09 11:46:55,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`08f00eee-a664-4b59-874c-8e038c9344f2`::moving from state preparing -> state finished >Thread-3965::DEBUG::2014-09-09 11:46:55,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3965::DEBUG::2014-09-09 11:46:55,085::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3965::DEBUG::2014-09-09 11:46:55,085::task::993::Storage.TaskManager.Task::(_decref) Task=`08f00eee-a664-4b59-874c-8e038c9344f2`::ref 0 aborting False >Thread-3965::DEBUG::2014-09-09 11:46:55,085::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksStatuses' in bridge with {'94ac3a4e-5e52-478a-9fba-6b5d490488c5': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '94ac3a4e-5e52-478a-9fba-6b5d490488c5'}, 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'}} >Thread-3965::DEBUG::2014-09-09 11:46:55,085::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:56,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:56,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895427 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:57,296::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3966::DEBUG::2014-09-09 11:46:57,297::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.getInfo' in bridge with {u'imageID': u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'volumeID': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >JsonRpcServer::DEBUG::2014-09-09 11:46:57,297::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3966::DEBUG::2014-09-09 11:46:57,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec45f120-2809-460a-8a0a-ca11df6d19a0`::moving from state init -> state preparing >Thread-3966::INFO::2014-09-09 11:46:57,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', volUUID=u'7a8d5544-0400-4021-bab0-deb0c0958ca6', options=None) >Thread-3966::DEBUG::2014-09-09 11:46:57,299::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`44e59c30-c176-4e76-9270-35f06edbf35c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3133' at 'getVolumeInfo' >Thread-3966::DEBUG::2014-09-09 11:46:57,299::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3966::DEBUG::2014-09-09 11:46:57,299::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3966::DEBUG::2014-09-09 11:46:57,299::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`44e59c30-c176-4e76-9270-35f06edbf35c`::Granted request >Thread-3966::DEBUG::2014-09-09 11:46:57,299::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ec45f120-2809-460a-8a0a-ca11df6d19a0`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3966::DEBUG::2014-09-09 11:46:57,299::task::993::Storage.TaskManager.Task::(_decref) Task=`ec45f120-2809-460a-8a0a-ca11df6d19a0`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) (8758) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,300::__init__::225::IOProcess::(_processLogs) (8758) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,301::__init__::225::IOProcess::(_processLogs) (8758) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,301::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,301::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-3966::DEBUG::2014-09-09 11:46:57,301::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:46:57,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) (8759) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) (8759) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) (8759) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) (8759) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) Message size is 240 >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) (8760) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,303::__init__::225::IOProcess::(_processLogs) (8760) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,304::__init__::225::IOProcess::(_processLogs) (8760) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,304::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,304::__init__::225::IOProcess::(_processLogs) Message size is 245 >Thread-19::DEBUG::2014-09-09 11:46:57,304::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,305::__init__::225::IOProcess::(_processLogs) (8761) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,305::__init__::225::IOProcess::(_processLogs) (8761) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,305::__init__::225::IOProcess::(_processLogs) (8761) Queuing response >Thread-3966::INFO::2014-09-09 11:46:57,305::volume::848::Storage.Volume::(getInfo) Info request: sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f imgUUID=f3610f26-4317-4ca8-8c1a-ffe5f2fad008 volUUID = 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:46:57,305::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,306::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,306::__init__::225::IOProcess::(_processLogs) (8762) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,307::__init__::225::IOProcess::(_processLogs) (8762) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,309::__init__::225::IOProcess::(_processLogs) (8762) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,309::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,310::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,310::__init__::225::IOProcess::(_processLogs) (8763) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,311::__init__::225::IOProcess::(_processLogs) (8763) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,312::__init__::225::IOProcess::(_processLogs) (8763) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,313::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,313::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,314::__init__::225::IOProcess::(_processLogs) (8764) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,314::__init__::225::IOProcess::(_processLogs) (8764) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,315::__init__::225::IOProcess::(_processLogs) (8764) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,316::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,316::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:46:57,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) (8765) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) (8765) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) (8765) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) (8765) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,317::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:46:57,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3966::INFO::2014-09-09 11:46:57,318::volume::876::Storage.Volume::(getInfo) 85442237-be11-4bd0-b6c3-43ba60c1b87f/f3610f26-4317-4ca8-8c1a-ffe5f2fad008/7a8d5544-0400-4021-bab0-deb0c0958ca6 info is {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', 'ctime': '1410277601', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', 'truesize': '134221824', 'type': 'PREALLOCATED'} >Thread-3966::INFO::2014-09-09 11:46:57,318::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', 'ctime': '1410277601', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', 'truesize': '134221824', 'type': 'PREALLOCATED'}} >Thread-19::DEBUG::2014-09-09 11:46:57,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3966::DEBUG::2014-09-09 11:46:57,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec45f120-2809-460a-8a0a-ca11df6d19a0`::finished: {'info': {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', 'ctime': '1410277601', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', 'truesize': '134221824', 'type': 'PREALLOCATED'}} >Thread-19::DEBUG::2014-09-09 11:46:57,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-3966::DEBUG::2014-09-09 11:46:57,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec45f120-2809-460a-8a0a-ca11df6d19a0`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-09-09 11:46:57,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-3966::DEBUG::2014-09-09 11:46:57,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-09-09 11:46:57,320::__init__::225::IOProcess::(_processLogs) (8766) Finding callback 'stat'... >Thread-3966::DEBUG::2014-09-09 11:46:57,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 11:46:57,320::__init__::225::IOProcess::(_processLogs) (8766) Got request for method 'stat' >Thread-3966::DEBUG::2014-09-09 11:46:57,321::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-19::DEBUG::2014-09-09 11:46:57,321::__init__::225::IOProcess::(_processLogs) (8766) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,322::__init__::225::IOProcess::(_processLogs) (8766) Queuing response >Thread-3966::DEBUG::2014-09-09 11:46:57,322::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-19::DEBUG::2014-09-09 11:46:57,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3966::DEBUG::2014-09-09 11:46:57,322::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-09-09 11:46:57,323::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-3966::DEBUG::2014-09-09 11:46:57,323::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3966::DEBUG::2014-09-09 11:46:57,323::task::993::Storage.TaskManager.Task::(_decref) Task=`ec45f120-2809-460a-8a0a-ca11df6d19a0`::ref 0 aborting False >Thread-3966::WARNING::2014-09-09 11:46:57,323::Bridge::210::root::(_typeFixup) Fixing up type VolumeInfo >Thread-3966::WARNING::2014-09-09 11:46:57,323::Bridge::448::root::(fieldClone) fieldClone: type -> allocType >Thread-3966::DEBUG::2014-09-09 11:46:57,323::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.getInfo' in bridge with {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', 'ctime': '1410277601', 'disktype': '2', 'legality': 'LEGAL', 'allocType': 'PREALLOCATED', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', 'truesize': '134221824', 'type': 'PREALLOCATED'} >Thread-3966::DEBUG::2014-09-09 11:46:57,324::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:57,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:57,354::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3967::DEBUG::2014-09-09 11:46:57,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:57,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:57,645::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3968::DEBUG::2014-09-09 11:46:57,645::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.getInfo' in bridge with {u'imageID': u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'volumeID': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >Thread-3968::DEBUG::2014-09-09 11:46:57,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`b643e2e9-089b-40fb-a094-be0441d5b4d1`::moving from state init -> state preparing >Thread-3968::INFO::2014-09-09 11:46:57,646::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', volUUID=u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', options=None) >Thread-3968::DEBUG::2014-09-09 11:46:57,646::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`542ed233-afb7-4025-b341-a861dfc85fe3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3133' at 'getVolumeInfo' >Thread-3968::DEBUG::2014-09-09 11:46:57,646::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3968::DEBUG::2014-09-09 11:46:57,647::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3968::DEBUG::2014-09-09 11:46:57,647::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`542ed233-afb7-4025-b341-a861dfc85fe3`::Granted request >Thread-3968::DEBUG::2014-09-09 11:46:57,647::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b643e2e9-089b-40fb-a094-be0441d5b4d1`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3968::DEBUG::2014-09-09 11:46:57,647::task::993::Storage.TaskManager.Task::(_decref) Task=`b643e2e9-089b-40fb-a094-be0441d5b4d1`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:46:57,647::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-09-09 11:46:57,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) (8767) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) (8767) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) (8767) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,648::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:57,649::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-09-09 11:46:57,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3968::DEBUG::2014-09-09 11:46:57,649::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:46:57,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) (8768) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) (8768) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) (8768) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) (8768) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) Message size is 240 >Thread-19::DEBUG::2014-09-09 11:46:57,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) (8769) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) (8769) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) (8769) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,651::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) Message size is 245 >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) (8770) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,652::__init__::225::IOProcess::(_processLogs) (8770) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,653::__init__::225::IOProcess::(_processLogs) (8770) Queuing response >Thread-3968::INFO::2014-09-09 11:46:57,653::volume::848::Storage.Volume::(getInfo) Info request: sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f imgUUID=9b58299d-0e4c-4799-ba1d-57760aad1bd8 volUUID = 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:46:57,653::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) (8771) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,654::__init__::225::IOProcess::(_processLogs) (8771) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,657::__init__::225::IOProcess::(_processLogs) (8771) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,657::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,657::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,658::__init__::225::IOProcess::(_processLogs) (8772) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,658::__init__::225::IOProcess::(_processLogs) (8772) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,660::__init__::225::IOProcess::(_processLogs) (8772) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,660::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) (8773) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,661::__init__::225::IOProcess::(_processLogs) (8773) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,663::__init__::225::IOProcess::(_processLogs) (8773) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,663::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,664::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:46:57,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,664::__init__::225::IOProcess::(_processLogs) (8774) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) (8774) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) (8774) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) (8774) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,666::__init__::225::IOProcess::(_processLogs) (8775) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,666::__init__::225::IOProcess::(_processLogs) (8775) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,666::__init__::225::IOProcess::(_processLogs) (8775) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,666::__init__::225::IOProcess::(_processLogs) (8775) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3968::INFO::2014-09-09 11:46:57,666::volume::876::Storage.Volume::(getInfo) 85442237-be11-4bd0-b6c3-43ba60c1b87f/9b58299d-0e4c-4799-ba1d-57760aad1bd8/94f6b335-3794-4683-bfe7-6bdca8bc02e2 info is {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9b58299d-0e4c-4799-ba1d-57760aad1bd8', 'ctime': '1410277606', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', 'truesize': '134221824', 'type': 'PREALLOCATED'} >Thread-3968::INFO::2014-09-09 11:46:57,666::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9b58299d-0e4c-4799-ba1d-57760aad1bd8', 'ctime': '1410277606', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', 'truesize': '134221824', 'type': 'PREALLOCATED'}} >Thread-3968::DEBUG::2014-09-09 11:46:57,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`b643e2e9-089b-40fb-a094-be0441d5b4d1`::finished: {'info': {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9b58299d-0e4c-4799-ba1d-57760aad1bd8', 'ctime': '1410277606', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', 'truesize': '134221824', 'type': 'PREALLOCATED'}} >Thread-3968::DEBUG::2014-09-09 11:46:57,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`b643e2e9-089b-40fb-a094-be0441d5b4d1`::moving from state preparing -> state finished >Thread-3968::DEBUG::2014-09-09 11:46:57,666::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3968::DEBUG::2014-09-09 11:46:57,666::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3968::DEBUG::2014-09-09 11:46:57,667::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3968::DEBUG::2014-09-09 11:46:57,667::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3968::DEBUG::2014-09-09 11:46:57,667::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3968::DEBUG::2014-09-09 11:46:57,667::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3968::DEBUG::2014-09-09 11:46:57,667::task::993::Storage.TaskManager.Task::(_decref) Task=`b643e2e9-089b-40fb-a094-be0441d5b4d1`::ref 0 aborting False >Thread-3968::WARNING::2014-09-09 11:46:57,667::Bridge::210::root::(_typeFixup) Fixing up type VolumeInfo >Thread-3968::WARNING::2014-09-09 11:46:57,667::Bridge::448::root::(fieldClone) fieldClone: type -> allocType >Thread-3968::DEBUG::2014-09-09 11:46:57,667::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.getInfo' in bridge with {'status': 'OK', 'domain': '85442237-be11-4bd0-b6c3-43ba60c1b87f', 'voltype': 'LEAF', 'description': 'OVF_STORE', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '9b58299d-0e4c-4799-ba1d-57760aad1bd8', 'ctime': '1410277606', 'disktype': '2', 'legality': 'LEGAL', 'allocType': 'PREALLOCATED', 'mtime': '0', 'apparentsize': '134217728', 'children': [], 'pool': '', 'capacity': '134217728', 'uuid': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', 'truesize': '134221824', 'type': 'PREALLOCATED'} >Thread-3968::DEBUG::2014-09-09 11:46:57,668::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:57,839::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:46:57,839::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3969::DEBUG::2014-09-09 11:46:57,839::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.setDescription' in bridge with {u'imageID': u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', u'description': u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"85442237-be11-4bd0-b6c3-43ba60c1b87f"}],"Last Updated":null}', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'volumeID': u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >Thread-3969::DEBUG::2014-09-09 11:46:57,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`55250edb-70ae-4c51-80b2-37ffd423c9a9`::moving from state init -> state preparing >Thread-3969::INFO::2014-09-09 11:46:57,840::logUtils::44::dispatcher::(wrapper) Run and protect: setVolumeDescription(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'9b58299d-0e4c-4799-ba1d-57760aad1bd8', volUUID=u'94f6b335-3794-4683-bfe7-6bdca8bc02e2', description=u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"85442237-be11-4bd0-b6c3-43ba60c1b87f"}],"Last Updated":null}', options=None) >Thread-3969::DEBUG::2014-09-09 11:46:57,840::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`8b1f06f6-cdc3-4e77-a9b6-204a135f927c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1292' at 'setVolumeDescription' >Thread-3969::DEBUG::2014-09-09 11:46:57,840::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3969::DEBUG::2014-09-09 11:46:57,841::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3969::DEBUG::2014-09-09 11:46:57,841::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`8b1f06f6-cdc3-4e77-a9b6-204a135f927c`::Granted request >Thread-3969::DEBUG::2014-09-09 11:46:57,841::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`55250edb-70ae-4c51-80b2-37ffd423c9a9`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3969::DEBUG::2014-09-09 11:46:57,841::task::993::Storage.TaskManager.Task::(_decref) Task=`55250edb-70ae-4c51-80b2-37ffd423c9a9`::ref 1 aborting False >Thread-3969::DEBUG::2014-09-09 11:46:57,841::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8`ReqID=`f3b958ac-2c74-4f1d-892e-e71f61343d87`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1884' at 'setVolumeDescription' >Thread-3969::DEBUG::2014-09-09 11:46:57,841::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' for lock type 'exclusive' >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) (8776) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:46:57,842::__init__::225::IOProcess::(_processLogs) (8776) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:46:57,844::__init__::225::IOProcess::(_processLogs) (8776) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,844::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-09-09 11:46:57,844::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) (8777) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) (8777) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) (8777) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) (8777) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,845::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:57,846::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-09-09 11:46:57,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3969::DEBUG::2014-09-09 11:46:57,846::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:46:57,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) (8778) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) (8778) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) (8778) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) (8778) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) Message size is 240 >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,848::__init__::225::IOProcess::(_processLogs) (8779) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,848::__init__::225::IOProcess::(_processLogs) (8779) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) (8779) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) (8779) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) Message size is 245 >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) (8780) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) (8780) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) (8780) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) (8780) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,851::__init__::225::IOProcess::(_processLogs) (8781) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,851::__init__::225::IOProcess::(_processLogs) (8781) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,853::__init__::225::IOProcess::(_processLogs) (8781) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,853::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,853::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) (8782) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) (8782) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) (8782) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,854::__init__::225::IOProcess::(_processLogs) (8782) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,855::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:57,855::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:46:57,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3969::DEBUG::2014-09-09 11:46:57,855::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) (8783) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) (8783) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) (8783) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) (8783) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,856::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) (8784) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) (8784) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) (8784) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) (8784) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) (8785) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) (8785) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) (8785) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) (8785) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,858::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) (8786) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,859::__init__::225::IOProcess::(_processLogs) (8786) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,861::__init__::225::IOProcess::(_processLogs) (8786) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,862::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,862::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,862::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) (8787) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) (8787) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) (8787) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) (8787) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,864::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:57,864::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,864::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:46:57,864::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-3969::DEBUG::2014-09-09 11:46:57,864::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:46:57,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) (8788) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) (8788) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) (8788) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) (8788) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,866::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:46:57,866::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) (8789) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) (8789) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) (8789) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) (8789) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:46:57,867::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) (8790) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) (8790) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) (8790) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) (8790) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,868::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) (8791) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,869::__init__::225::IOProcess::(_processLogs) (8791) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,871::__init__::225::IOProcess::(_processLogs) DEBUG|(8791) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,871::__init__::225::IOProcess::(_processLogs) (8791) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) (8792) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,872::__init__::225::IOProcess::(_processLogs) (8792) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,874::__init__::225::IOProcess::(_processLogs) (8792) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,874::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-3969::INFO::2014-09-09 11:46:57,875::image::224::Storage.Image::(getChain) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f imgUUID=9b58299d-0e4c-4799-ba1d-57760aad1bd8 chain=[<storage.fileVolume.FileVolume object at 0x7f6b846e8990>] >Thread-19::DEBUG::2014-09-09 11:46:57,875::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:57,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,875::__init__::225::IOProcess::(_processLogs) (8793) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,876::__init__::225::IOProcess::(_processLogs) (8793) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,878::__init__::225::IOProcess::(_processLogs) (8793) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,878::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,878::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-3969::DEBUG::2014-09-09 11:46:57,879::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2`ReqID=`4c890968-3792-4964-9db7-b0cce9797c39`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-3969::DEBUG::2014-09-09 11:46:57,879::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2' for lock type 'exclusive' >Thread-3969::DEBUG::2014-09-09 11:46:57,879::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2' is free. Now locking as 'exclusive' (1 active user) >Thread-3969::DEBUG::2014-09-09 11:46:57,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2`ReqID=`4c890968-3792-4964-9db7-b0cce9797c39`::Granted request >Thread-3969::DEBUG::2014-09-09 11:46:57,879::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' is free. Now locking as 'exclusive' (1 active user) >Thread-3969::DEBUG::2014-09-09 11:46:57,880::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8`ReqID=`f3b958ac-2c74-4f1d-892e-e71f61343d87`::Granted request >Thread-19::DEBUG::2014-09-09 11:46:57,880::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,880::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-09-09 11:46:57,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,880::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) (8794) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) (8794) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) (8794) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) (8794) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:57,881::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,882::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-3969::DEBUG::2014-09-09 11:46:57,882::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 94f6b335-3794-4683-bfe7-6bdca8bc02e2 >Thread-19::DEBUG::2014-09-09 11:46:57,882::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,882::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) (8795) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) (8795) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) (8795) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) (8795) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) Message size is 240 >Thread-19::DEBUG::2014-09-09 11:46:57,883::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) (8796) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) (8796) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) (8796) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) (8796) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,885::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,885::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,885::__init__::225::IOProcess::(_processLogs) Message size is 245 >Thread-3969::INFO::2014-09-09 11:46:57,885::volume::593::Storage.Volume::(setDescription) volUUID = 94f6b335-3794-4683-bfe7-6bdca8bc02e2 descr = {"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"85442237-be11-4bd0-b6c3-43ba60c1b87f"}],"Last Updated":null} >Thread-19::DEBUG::2014-09-09 11:46:57,885::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) (8797) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) (8797) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) (8797) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) (8797) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:57,886::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) (8798) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:57,887::__init__::225::IOProcess::(_processLogs) (8798) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:57,889::__init__::225::IOProcess::(_processLogs) (8793) Queuing responseDEBUG|(8798) Building response >Thread-19::DEBUG::2014-09-09 11:46:57,889::__init__::225::IOProcess::(_processLogs) (8798) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:57,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:57,889::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-3969::WARNING::2014-09-09 11:46:58,135::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:46:58,135::__init__::225::IOProcess::(_processLogs) Message size is 432 >Thread-19::DEBUG::2014-09-09 11:46:58,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:58,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:58,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:58,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:58,136::__init__::225::IOProcess::(_processLogs) (8799) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:46:58,136::__init__::225::IOProcess::(_processLogs) (8799) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:46:58,136::__init__::225::IOProcess::(_processLogs) (8799) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:58,136::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3969::DEBUG::2014-09-09 11:46:58,137::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' >Thread-3969::DEBUG::2014-09-09 11:46:58,137::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' (0 active users) >Thread-3969::DEBUG::2014-09-09 11:46:58,137::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8' is free, finding out if anyone is waiting for it. >Thread-3969::DEBUG::2014-09-09 11:46:58,137::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2' >Thread-3969::DEBUG::2014-09-09 11:46:58,137::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2' (0 active users) >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2' is free, finding out if anyone is waiting for it. >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.94f6b335-3794-4683-bfe7-6bdca8bc02e2', Clearing records. >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.9b58299d-0e4c-4799-ba1d-57760aad1bd8', Clearing records. >Thread-3969::INFO::2014-09-09 11:46:58,138::logUtils::47::dispatcher::(wrapper) Run and protect: setVolumeDescription, Return response: None >Thread-3969::DEBUG::2014-09-09 11:46:58,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`55250edb-70ae-4c51-80b2-37ffd423c9a9`::finished: None >Thread-3969::DEBUG::2014-09-09 11:46:58,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`55250edb-70ae-4c51-80b2-37ffd423c9a9`::moving from state preparing -> state finished >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3969::DEBUG::2014-09-09 11:46:58,138::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3969::DEBUG::2014-09-09 11:46:58,139::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3969::DEBUG::2014-09-09 11:46:58,139::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3969::DEBUG::2014-09-09 11:46:58,139::task::993::Storage.TaskManager.Task::(_decref) Task=`55250edb-70ae-4c51-80b2-37ffd423c9a9`::ref 0 aborting False >Thread-3969::DEBUG::2014-09-09 11:46:58,139::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.setDescription' in bridge with True >Thread-3969::DEBUG::2014-09-09 11:46:58,139::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:46:58,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:46:58,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897155 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:46:59,096::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3970::DEBUG::2014-09-09 11:46:59,097::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Volume.setDescription' in bridge with {u'imageID': u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', u'description': u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"85442237-be11-4bd0-b6c3-43ba60c1b87f"}],"Last Updated":null}', u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'volumeID': u'7a8d5544-0400-4021-bab0-deb0c0958ca6', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >JsonRpcServer::DEBUG::2014-09-09 11:46:59,097::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3970::DEBUG::2014-09-09 11:46:59,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`5985fe53-d0d6-42fc-b751-fbb567ce6a06`::moving from state init -> state preparing >Thread-3970::INFO::2014-09-09 11:46:59,098::logUtils::44::dispatcher::(wrapper) Run and protect: setVolumeDescription(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', imgUUID=u'f3610f26-4317-4ca8-8c1a-ffe5f2fad008', volUUID=u'7a8d5544-0400-4021-bab0-deb0c0958ca6', description=u'{"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"85442237-be11-4bd0-b6c3-43ba60c1b87f"}],"Last Updated":null}', options=None) >Thread-3970::DEBUG::2014-09-09 11:46:59,098::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`552980a7-e803-448a-87ac-1129b36551f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1292' at 'setVolumeDescription' >Thread-3970::DEBUG::2014-09-09 11:46:59,098::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'shared' >Thread-3970::DEBUG::2014-09-09 11:46:59,099::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'shared' (1 active user) >Thread-3970::DEBUG::2014-09-09 11:46:59,099::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`552980a7-e803-448a-87ac-1129b36551f4`::Granted request >Thread-3970::DEBUG::2014-09-09 11:46:59,099::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5985fe53-d0d6-42fc-b751-fbb567ce6a06`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (shared) >Thread-3970::DEBUG::2014-09-09 11:46:59,099::task::993::Storage.TaskManager.Task::(_decref) Task=`5985fe53-d0d6-42fc-b751-fbb567ce6a06`::ref 1 aborting False >Thread-3970::DEBUG::2014-09-09 11:46:59,099::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008`ReqID=`58e0c93c-4c0b-4723-835c-0ab821589768`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1884' at 'setVolumeDescription' >Thread-3970::DEBUG::2014-09-09 11:46:59,099::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' for lock type 'exclusive' >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) Message size is 201 >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) (8800) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:46:59,100::__init__::225::IOProcess::(_processLogs) (8800) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:46:59,102::__init__::225::IOProcess::(_processLogs) (8800) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,102::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-09-09 11:46:59,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) (8801) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) (8801) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) (8801) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) (8801) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,103::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:59,104::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-09-09 11:46:59,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3970::DEBUG::2014-09-09 11:46:59,104::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:46:59,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) (8802) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) (8802) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) (8802) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) (8802) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) Message size is 240 >Thread-19::DEBUG::2014-09-09 11:46:59,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) (8803) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) (8803) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) (8803) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) (8803) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Message size is 245 >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) (8804) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) (8804) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) (8804) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) (8804) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,109::__init__::225::IOProcess::(_processLogs) (8805) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:59,109::__init__::225::IOProcess::(_processLogs) (8805) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:59,111::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8805) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,111::__init__::225::IOProcess::(_processLogs) (8805) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,111::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:59,111::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,112::__init__::225::IOProcess::(_processLogs) (8806) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) (8806) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) (8806) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) (8806) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,113::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Queuing request... >Thread-3970::DEBUG::2014-09-09 11:46:59,113::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) (8807) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) (8807) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) (8807) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,114::__init__::225::IOProcess::(_processLogs) (8807) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,115::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,115::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,115::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:46:59,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,115::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) (8808) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) (8808) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) (8808) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) (8808) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,116::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) (8809) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) (8809) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) (8809) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,117::__init__::225::IOProcess::(_processLogs) (8809) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) (8810) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:59,118::__init__::225::IOProcess::(_processLogs) (8810) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:59,120::__init__::225::IOProcess::(_processLogs) (8805) Queuing responseDEBUG|(8810) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,121::__init__::225::IOProcess::(_processLogs) (8810) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,121::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:59,121::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,121::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) (8811) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) (8811) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) (8811) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,122::__init__::225::IOProcess::(_processLogs) (8811) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,123::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:59,123::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,123::__init__::225::IOProcess::(_processLogs) Message size is 204 >Thread-19::DEBUG::2014-09-09 11:46:59,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,123::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-3970::DEBUG::2014-09-09 11:46:59,123::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) (8812) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) (8812) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) (8812) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) (8812) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,124::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) Message size is 241 >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) (8813) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) (8813) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) (8813) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) (8813) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) Message size is 246 >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,126::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) (8814) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) (8814) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) (8814) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) (8814) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,127::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) (8815) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:59,128::__init__::225::IOProcess::(_processLogs) (8815) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:59,130::__init__::225::IOProcess::(_processLogs) DEBUG|(8815) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,130::__init__::225::IOProcess::(_processLogs) (8815) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) (8816) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:59,131::__init__::225::IOProcess::(_processLogs) (8816) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:59,133::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8816) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,133::__init__::225::IOProcess::(_processLogs) (8816) Queuing response >Thread-3970::INFO::2014-09-09 11:46:59,134::image::224::Storage.Image::(getChain) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f imgUUID=f3610f26-4317-4ca8-8c1a-ffe5f2fad008 chain=[<storage.fileVolume.FileVolume object at 0x7f6b846fa6d0>] >Thread-19::DEBUG::2014-09-09 11:46:59,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,134::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:59,134::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,134::__init__::225::IOProcess::(_processLogs) Message size is 253 >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) (8817) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:59,135::__init__::225::IOProcess::(_processLogs) (8817) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:59,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8817) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,137::__init__::225::IOProcess::(_processLogs) (8817) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3970::DEBUG::2014-09-09 11:46:59,138::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6`ReqID=`88698a16-26fc-45bc-a526-f047294c8f9a`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-19::DEBUG::2014-09-09 11:46:59,138::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-3970::DEBUG::2014-09-09 11:46:59,139::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6' for lock type 'exclusive' >Thread-3970::DEBUG::2014-09-09 11:46:59,139::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6' is free. Now locking as 'exclusive' (1 active user) >Thread-3970::DEBUG::2014-09-09 11:46:59,139::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6`ReqID=`88698a16-26fc-45bc-a526-f047294c8f9a`::Granted request >Thread-3970::DEBUG::2014-09-09 11:46:59,139::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' is free. Now locking as 'exclusive' (1 active user) >Thread-3970::DEBUG::2014-09-09 11:46:59,139::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008`ReqID=`58e0c93c-4c0b-4723-835c-0ab821589768`::Granted request >Thread-19::DEBUG::2014-09-09 11:46:59,140::__init__::225::IOProcess::(_processLogs) (8817) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:46:59,140::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-09-09 11:46:59,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:46:59,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) (8818) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) (8818) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) (8818) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) (8818) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) Sending response sized 236 >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-3970::DEBUG::2014-09-09 11:46:59,141::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 7a8d5544-0400-4021-bab0-deb0c0958ca6 >Thread-19::DEBUG::2014-09-09 11:46:59,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) (8819) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) (8819) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) (8819) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) (8819) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,142::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,143::__init__::225::IOProcess::(_processLogs) Message size is 240 >Thread-19::DEBUG::2014-09-09 11:46:59,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) (8820) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) (8820) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) (8820) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) (8820) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) Message size is 245 >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3970::INFO::2014-09-09 11:46:59,144::volume::593::Storage.Volume::(setDescription) volUUID = 7a8d5544-0400-4021-bab0-deb0c0958ca6 descr = {"Updated":false,"Disk Description":"OVF_STORE","Storage Domains":[{"uuid":"85442237-be11-4bd0-b6c3-43ba60c1b87f"}],"Last Updated":null} >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) (8821) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) (8821) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) (8821) Building response >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) (8821) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) Message size is 252 >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) (8822) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:46:59,146::__init__::225::IOProcess::(_processLogs) (8822) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:46:59,148::__init__::225::IOProcess::(_processLogs) (8822) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,148::__init__::225::IOProcess::(_processLogs) Sending response sized 418 >Thread-19::DEBUG::2014-09-09 11:46:59,348::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:59,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,349::__init__::225::IOProcess::(_processLogs) (8823) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:59,349::__init__::225::IOProcess::(_processLogs) (8823) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:59,349::__init__::225::IOProcess::(_processLogs) (8823) Queuing response >Thread-23::DEBUG::2014-09-09 11:46:59,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:46:59,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:46:59,354::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:46:59,357::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010427 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) (8824) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:46:59,358::__init__::225::IOProcess::(_processLogs) (8824) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:46:59,359::__init__::225::IOProcess::(_processLogs) (8824) Queuing response >Thread-19::DEBUG::2014-09-09 11:46:59,359::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:00,362::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:00,363::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3971::DEBUG::2014-09-09 11:47:00,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`cadc645d-0676-407d-b7ef-0fb573876800`::moving from state init -> state preparing >Thread-3971::INFO::2014-09-09 11:47:00,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3971::INFO::2014-09-09 11:47:00,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010427', 'lastCheck': '1.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108802', 'lastCheck': '5.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107097', 'lastCheck': '6.7', 'valid': True}} >Thread-3971::DEBUG::2014-09-09 11:47:00,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`cadc645d-0676-407d-b7ef-0fb573876800`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010427', 'lastCheck': '1.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108802', 'lastCheck': '5.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107097', 'lastCheck': '6.7', 'valid': True}} >Thread-3971::DEBUG::2014-09-09 11:47:00,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`cadc645d-0676-407d-b7ef-0fb573876800`::moving from state preparing -> state finished >Thread-3971::DEBUG::2014-09-09 11:47:00,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3971::DEBUG::2014-09-09 11:47:00,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3971::DEBUG::2014-09-09 11:47:00,365::task::993::Storage.TaskManager.Task::(_decref) Task=`cadc645d-0676-407d-b7ef-0fb573876800`::ref 0 aborting False >Thread-3971::DEBUG::2014-09-09 11:47:00,366::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:00,372::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:00,372::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3972::DEBUG::2014-09-09 11:47:00,373::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:00,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:00,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900736 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:47:02,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:02,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896149 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:03,640::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) (8825) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) (8825) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) (8825) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:03,641::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:47:03,642::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:03,642::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:47:03,650::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000901978 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:03,650::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:03,650::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:03,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:03,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:03,650::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:03,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:03,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:03,651::__init__::225::IOProcess::(_processLogs) (8826) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:03,651::__init__::225::IOProcess::(_processLogs) (8826) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:03,651::__init__::225::IOProcess::(_processLogs) DEBUG|(8826) Building response >Thread-19::DEBUG::2014-09-09 11:47:03,652::__init__::225::IOProcess::(_processLogs) (8826) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:03,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:03,652::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3970::WARNING::2014-09-09 11:47:04,261::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) Message size is 432 >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) (8827) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 11:47:04,262::__init__::225::IOProcess::(_processLogs) (8827) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 11:47:04,263::__init__::225::IOProcess::(_processLogs) DEBUG|(8827) Building response >Thread-19::DEBUG::2014-09-09 11:47:04,263::__init__::225::IOProcess::(_processLogs) (8827) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:04,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:04,263::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-3970::DEBUG::2014-09-09 11:47:04,264::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' >Thread-3970::DEBUG::2014-09-09 11:47:04,264::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' (0 active users) >Thread-3970::DEBUG::2014-09-09 11:47:04,264::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008' is free, finding out if anyone is waiting for it. >Thread-3970::DEBUG::2014-09-09 11:47:04,264::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6' >Thread-3970::DEBUG::2014-09-09 11:47:04,264::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6' (0 active users) >Thread-3970::DEBUG::2014-09-09 11:47:04,264::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6' is free, finding out if anyone is waiting for it. >Thread-3970::DEBUG::2014-09-09 11:47:04,265::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS.7a8d5544-0400-4021-bab0-deb0c0958ca6', Clearing records. >Thread-3970::DEBUG::2014-09-09 11:47:04,265::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS.f3610f26-4317-4ca8-8c1a-ffe5f2fad008', Clearing records. >Thread-3970::INFO::2014-09-09 11:47:04,265::logUtils::47::dispatcher::(wrapper) Run and protect: setVolumeDescription, Return response: None >Thread-3970::DEBUG::2014-09-09 11:47:04,265::task::1191::Storage.TaskManager.Task::(prepare) Task=`5985fe53-d0d6-42fc-b751-fbb567ce6a06`::finished: None >Thread-3970::DEBUG::2014-09-09 11:47:04,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`5985fe53-d0d6-42fc-b751-fbb567ce6a06`::moving from state preparing -> state finished >Thread-3970::DEBUG::2014-09-09 11:47:04,265::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-3970::DEBUG::2014-09-09 11:47:04,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3970::DEBUG::2014-09-09 11:47:04,265::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-3970::DEBUG::2014-09-09 11:47:04,265::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-3970::DEBUG::2014-09-09 11:47:04,266::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-3970::DEBUG::2014-09-09 11:47:04,266::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-3970::DEBUG::2014-09-09 11:47:04,266::task::993::Storage.TaskManager.Task::(_decref) Task=`5985fe53-d0d6-42fc-b751-fbb567ce6a06`::ref 0 aborting False >Thread-3970::DEBUG::2014-09-09 11:47:04,266::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Volume.setDescription' in bridge with True >Thread-3970::DEBUG::2014-09-09 11:47:04,266::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:04,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:04,665::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:04,665::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:04,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:04,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:04,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:04,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:04,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:04,666::__init__::225::IOProcess::(_processLogs) (8828) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:04,666::__init__::225::IOProcess::(_processLogs) (8828) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:04,737::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8828) Building response >Thread-19::DEBUG::2014-09-09 11:47:04,738::__init__::225::IOProcess::(_processLogs) (8828) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:04,738::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:04,739::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:47:04,740::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:04,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0968407 s, 10.6 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:47:04,747::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000927823 s, 591 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:04,748::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:04,749::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:04,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:04,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:04,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:04,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:04,751::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:04,752::__init__::225::IOProcess::(_processLogs) (8829) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:04,752::__init__::225::IOProcess::(_processLogs) (8829) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:04,753::__init__::225::IOProcess::(_processLogs) (8829) Building response >Thread-19::DEBUG::2014-09-09 11:47:04,753::__init__::225::IOProcess::(_processLogs) (8829) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:04,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:04,754::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:04,754::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:04,755::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:47:04,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:04,755::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:04,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:04,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:04,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:04,757::__init__::225::IOProcess::(_processLogs) (8830) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:04,757::__init__::225::IOProcess::(_processLogs) (8830) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:04,758::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8830) Building response >Thread-19::DEBUG::2014-09-09 11:47:04,758::__init__::225::IOProcess::(_processLogs) (8830) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:04,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:04,759::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:04,760::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:04,760::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:47:04,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:04,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:04,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:04,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:04,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:04,762::__init__::225::IOProcess::(_processLogs) (8831) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:04,762::__init__::225::IOProcess::(_processLogs) (8831) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:04,763::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8831) Building response >Thread-19::DEBUG::2014-09-09 11:47:04,763::__init__::225::IOProcess::(_processLogs) (8831) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:04,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:04,764::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:04,765::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:04,765::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:47:04,765::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:04,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:04,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:04,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:04,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:04,767::__init__::225::IOProcess::(_processLogs) (8832) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:04,768::__init__::225::IOProcess::(_processLogs) (8832) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:04,768::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8832) Building response >Thread-19::DEBUG::2014-09-09 11:47:04,769::__init__::225::IOProcess::(_processLogs) (8832) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:04,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:04,770::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:05,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:05,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3973::DEBUG::2014-09-09 11:47:05,085::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3973::DEBUG::2014-09-09 11:47:05,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`163a864f-5db8-42d0-a41f-1d2647e4bc55`::moving from state init -> state preparing >Thread-3973::INFO::2014-09-09 11:47:05,086::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3973::INFO::2014-09-09 11:47:05,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3973::DEBUG::2014-09-09 11:47:05,086::task::1191::Storage.TaskManager.Task::(prepare) Task=`163a864f-5db8-42d0-a41f-1d2647e4bc55`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3973::DEBUG::2014-09-09 11:47:05,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`163a864f-5db8-42d0-a41f-1d2647e4bc55`::moving from state preparing -> state finished >Thread-3973::DEBUG::2014-09-09 11:47:05,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3973::DEBUG::2014-09-09 11:47:05,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3973::DEBUG::2014-09-09 11:47:05,086::task::993::Storage.TaskManager.Task::(_decref) Task=`163a864f-5db8-42d0-a41f-1d2647e4bc55`::ref 0 aborting False >Thread-3973::DEBUG::2014-09-09 11:47:05,086::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3973::DEBUG::2014-09-09 11:47:05,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:05,208::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:05,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3974::DEBUG::2014-09-09 11:47:05,208::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3974::DEBUG::2014-09-09 11:47:05,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f8f203f-ef95-4ae8-9200-ba07966d1308`::moving from state init -> state preparing >Thread-3974::INFO::2014-09-09 11:47:05,209::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3974::DEBUG::2014-09-09 11:47:05,209::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`172dceaa-5457-438e-a7fd-25076d4180b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3974::DEBUG::2014-09-09 11:47:05,209::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3974::DEBUG::2014-09-09 11:47:05,210::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3974::DEBUG::2014-09-09 11:47:05,210::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`172dceaa-5457-438e-a7fd-25076d4180b2`::Granted request >Thread-3974::DEBUG::2014-09-09 11:47:05,210::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0f8f203f-ef95-4ae8-9200-ba07966d1308`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3974::DEBUG::2014-09-09 11:47:05,210::task::993::Storage.TaskManager.Task::(_decref) Task=`0f8f203f-ef95-4ae8-9200-ba07966d1308`::ref 1 aborting False >Thread-3974::INFO::2014-09-09 11:47:05,211::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283045265408', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283035828224', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283037925376', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3974::DEBUG::2014-09-09 11:47:05,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f8f203f-ef95-4ae8-9200-ba07966d1308`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283045265408', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283035828224', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283037925376', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3974::DEBUG::2014-09-09 11:47:05,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f8f203f-ef95-4ae8-9200-ba07966d1308`::moving from state preparing -> state finished >Thread-3974::DEBUG::2014-09-09 11:47:05,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3974::DEBUG::2014-09-09 11:47:05,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3974::DEBUG::2014-09-09 11:47:05,212::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3974::DEBUG::2014-09-09 11:47:05,212::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3974::DEBUG::2014-09-09 11:47:05,212::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3974::DEBUG::2014-09-09 11:47:05,212::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3974::DEBUG::2014-09-09 11:47:05,212::task::993::Storage.TaskManager.Task::(_decref) Task=`0f8f203f-ef95-4ae8-9200-ba07966d1308`::ref 0 aborting False >Thread-3974::DEBUG::2014-09-09 11:47:05,212::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283045265408', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283035828224', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283037925376', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3974::DEBUG::2014-09-09 11:47:05,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:05,669::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:05,669::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3975::DEBUG::2014-09-09 11:47:05,670::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:05,684::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3976::DEBUG::2014-09-09 11:47:05,684::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.clear' in bridge with {u'taskID': u'ba8a3b14-3bfa-4994-80e6-82489e7f6be2'} >JsonRpcServer::DEBUG::2014-09-09 11:47:05,684::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3976::DEBUG::2014-09-09 11:47:05,685::task::595::Storage.TaskManager.Task::(_updateState) Task=`0accb41c-038e-4d01-8656-88c110f4466e`::moving from state init -> state preparing >Thread-3976::INFO::2014-09-09 11:47:05,685::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID=u'ba8a3b14-3bfa-4994-80e6-82489e7f6be2', spUUID=None, options=None) >Thread-3976::DEBUG::2014-09-09 11:47:05,686::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: ba8a3b14-3bfa-4994-80e6-82489e7f6be2 >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,686::__init__::225::IOProcess::(_processLogs) (8833) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:47:05,687::__init__::225::IOProcess::(_processLogs) (8833) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:47:05,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8833) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,689::__init__::225::IOProcess::(_processLogs) (8833) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,689::__init__::225::IOProcess::(_processLogs) Sending response sized 286 >Thread-19::DEBUG::2014-09-09 11:47:05,689::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,689::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) (8834) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) (8834) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) (8834) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,690::__init__::225::IOProcess::(_processLogs) (8834) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) (8835) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:05,691::__init__::225::IOProcess::(_processLogs) (8835) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:05,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8835) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,835::__init__::225::IOProcess::(_processLogs) (8835) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,835::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:05,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) Message size is 212 >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) (8836) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:05,836::__init__::225::IOProcess::(_processLogs) (8836) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) (8836) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) (8836) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,837::__init__::225::IOProcess::(_processLogs) (8837) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:05,838::__init__::225::IOProcess::(_processLogs) (8837) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:05,838::__init__::225::IOProcess::(_processLogs) DEBUG|(8837) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,838::__init__::225::IOProcess::(_processLogs) (8837) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,838::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:05,838::__init__::225::IOProcess::(_processLogs) (8837) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) (8838) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) (8838) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:05,839::__init__::225::IOProcess::(_processLogs) (8838) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) (8838) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) (8839) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:05,840::__init__::225::IOProcess::(_processLogs) (8839) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:05,841::__init__::225::IOProcess::(_processLogs) DEBUG|(8839) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,841::__init__::225::IOProcess::(_processLogs) (8839) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,842::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:05,842::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,842::__init__::225::IOProcess::(_processLogs) Message size is 211 >Thread-19::DEBUG::2014-09-09 11:47:05,842::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) (8840) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) (8840) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) (8840) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) (8840) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:47:05,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) (8841) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) (8841) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) DEBUG|(8841) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) (8841) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,844::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) (8842) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) (8842) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) (8842) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) (8842) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) (8843) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) (8843) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) DEBUG|(8843) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) (8843) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,847::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) (8844) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:47:05,848::__init__::225::IOProcess::(_processLogs) (8844) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:47:05,849::__init__::225::IOProcess::(_processLogs) DEBUG|(8844) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,849::__init__::225::IOProcess::(_processLogs) (8844) Queuing response >Thread-3976::DEBUG::2014-09-09 11:47:05,849::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-19::DEBUG::2014-09-09 11:47:05,849::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3976::INFO::2014-09-09 11:47:05,849::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-19::DEBUG::2014-09-09 11:47:05,850::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3976::DEBUG::2014-09-09 11:47:05,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`0accb41c-038e-4d01-8656-88c110f4466e`::finished: None >Thread-3976::DEBUG::2014-09-09 11:47:05,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`0accb41c-038e-4d01-8656-88c110f4466e`::moving from state preparing -> state finished >Thread-3976::DEBUG::2014-09-09 11:47:05,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3976::DEBUG::2014-09-09 11:47:05,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3976::DEBUG::2014-09-09 11:47:05,850::task::993::Storage.TaskManager.Task::(_decref) Task=`0accb41c-038e-4d01-8656-88c110f4466e`::ref 0 aborting False >Thread-3976::DEBUG::2014-09-09 11:47:05,851::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.clear' in bridge with True >Thread-3976::DEBUG::2014-09-09 11:47:05,851::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:05,968::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:05,969::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3977::DEBUG::2014-09-09 11:47:05,969::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.clear' in bridge with {u'taskID': u'94ac3a4e-5e52-478a-9fba-6b5d490488c5'} >Thread-3977::DEBUG::2014-09-09 11:47:05,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce8e87a9-eacd-48af-bc71-99bfadd862a1`::moving from state init -> state preparing >Thread-3977::INFO::2014-09-09 11:47:05,970::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID=u'94ac3a4e-5e52-478a-9fba-6b5d490488c5', spUUID=None, options=None) >Thread-3977::DEBUG::2014-09-09 11:47:05,970::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 94ac3a4e-5e52-478a-9fba-6b5d490488c5 >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) (8845) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:47:05,970::__init__::225::IOProcess::(_processLogs) (8845) Got request for method 'listdir' >Thread-19::DEBUG::2014-09-09 11:47:05,972::__init__::225::IOProcess::(_processLogs) DEBUG|(8845) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,973::__init__::225::IOProcess::(_processLogs) (8845) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,973::__init__::225::IOProcess::(_processLogs) Sending response sized 286 >Thread-19::DEBUG::2014-09-09 11:47:05,973::__init__::225::IOProcess::(_processLogs) (8845) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,973::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) (8846) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) (8846) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) (8846) Building response >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) (8846) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:05,974::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) (8847) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:05,975::__init__::225::IOProcess::(_processLogs) (8847) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:06,185::__init__::225::IOProcess::(_processLogs) DEBUG|(8847) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,185::__init__::225::IOProcess::(_processLogs) (8847) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,185::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:06,186::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,186::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-09-09 11:47:06,186::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,186::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) (8848) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) (8848) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) (8848) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) (8848) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:47:06,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) (8849) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) (8849) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) DEBUG|(8849) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) (8849) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,188::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) Message size is 212 >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) (8850) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) (8850) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) (8850) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) (8850) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) (8851) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) (8851) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) DEBUG|(8851) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) (8851) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,191::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) Message size is 211 >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,192::__init__::225::IOProcess::(_processLogs) (8852) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) (8852) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) (8852) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) (8852) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,194::__init__::225::IOProcess::(_processLogs) (8853) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:06,194::__init__::225::IOProcess::(_processLogs) (8853) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:06,194::__init__::225::IOProcess::(_processLogs) DEBUG|(8853) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,194::__init__::225::IOProcess::(_processLogs) (8853) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,195::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,195::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:06,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,195::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-09-09 11:47:06,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,195::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) (8854) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) (8854) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) (8854) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) (8854) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-09-09 11:47:06,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) (8855) Finding callback 'unlink'... >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) (8855) Got request for method 'unlink' >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) DEBUG|(8855) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) (8855) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:06,197::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) (8856) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-09-09 11:47:06,198::__init__::225::IOProcess::(_processLogs) (8856) Got request for method 'rmdir' >Thread-19::DEBUG::2014-09-09 11:47:06,199::__init__::225::IOProcess::(_processLogs) DEBUG|(8856) Building response >Thread-19::DEBUG::2014-09-09 11:47:06,199::__init__::225::IOProcess::(_processLogs) (8856) Queuing response >Thread-3977::DEBUG::2014-09-09 11:47:06,199::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-19::DEBUG::2014-09-09 11:47:06,199::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3977::INFO::2014-09-09 11:47:06,199::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-19::DEBUG::2014-09-09 11:47:06,200::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3977::DEBUG::2014-09-09 11:47:06,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce8e87a9-eacd-48af-bc71-99bfadd862a1`::finished: None >Thread-3977::DEBUG::2014-09-09 11:47:06,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce8e87a9-eacd-48af-bc71-99bfadd862a1`::moving from state preparing -> state finished >Thread-3977::DEBUG::2014-09-09 11:47:06,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3977::DEBUG::2014-09-09 11:47:06,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3977::DEBUG::2014-09-09 11:47:06,201::task::993::Storage.TaskManager.Task::(_decref) Task=`ce8e87a9-eacd-48af-bc71-99bfadd862a1`::ref 0 aborting False >Thread-3977::DEBUG::2014-09-09 11:47:06,201::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.clear' in bridge with True >Thread-3977::DEBUG::2014-09-09 11:47:06,201::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:06,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:06,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898008 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:08,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:08,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3978::DEBUG::2014-09-09 11:47:08,680::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:08,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:08,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897574 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:09,360::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:09,360::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:09,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:09,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:09,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:09,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:09,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:09,361::__init__::225::IOProcess::(_processLogs) (8857) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:09,361::__init__::225::IOProcess::(_processLogs) (8857) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:09,362::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8857) Building response >Thread-19::DEBUG::2014-09-09 11:47:09,362::__init__::225::IOProcess::(_processLogs) (8857) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:09,362::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:09,362::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:47:09,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:47:09,370::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106936 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:09,370::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) (8858) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) (8858) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8858) Building response >Thread-19::DEBUG::2014-09-09 11:47:09,371::__init__::225::IOProcess::(_processLogs) (8858) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:09,372::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:09,372::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:10,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:11,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898558 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:11,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:11,686::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3979::DEBUG::2014-09-09 11:47:11,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:13,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:13,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898116 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:13,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:13,652::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:13,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) (8859) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) (8859) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:13,653::__init__::225::IOProcess::(_processLogs) (8859) Queuing response >Thread-3443::DEBUG::2014-09-09 11:47:13,654::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:13,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:13,659::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:47:13,661::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000842681 s, 421 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) (8860) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) (8860) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:13,662::__init__::225::IOProcess::(_processLogs) (8860) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:13,663::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:14,695::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:14,696::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3980::DEBUG::2014-09-09 11:47:14,697::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:14,769::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:14,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:14,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:14,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:14,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:14,769::__init__::225::IOProcess::(_processLogs) (8861) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:14,770::__init__::225::IOProcess::(_processLogs) (8861) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:14,771::__init__::225::IOProcess::(_processLogs) (8861) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:14,771::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:47:14,771::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:47:14,779::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101342 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:14,780::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:14,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:14,780::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:14,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:14,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:14,781::__init__::225::IOProcess::(_processLogs) (8862) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:14,781::__init__::225::IOProcess::(_processLogs) (8862) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:14,781::__init__::225::IOProcess::(_processLogs) (8862) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:14,781::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:14,782::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:47:14,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:14,782::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:14,782::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) (8863) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) (8863) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) (8863) Building response >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) (8863) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:14,783::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) (8864) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) (8864) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) (8864) Building response >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) (8864) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:14,784::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:14,785::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:14,785::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:14,785::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:47:14,785::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:14,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) (8865) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) (8865) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) (8865) Building response >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) (8865) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:14,786::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:47:15,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:15,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898301 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:15,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:15,687::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3981::DEBUG::2014-09-09 11:47:15,687::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3981::DEBUG::2014-09-09 11:47:15,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9126f19-7076-4f50-b90b-8282301492c2`::moving from state init -> state preparing >Thread-3981::INFO::2014-09-09 11:47:15,688::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3981::INFO::2014-09-09 11:47:15,688::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3981::DEBUG::2014-09-09 11:47:15,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9126f19-7076-4f50-b90b-8282301492c2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3981::DEBUG::2014-09-09 11:47:15,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9126f19-7076-4f50-b90b-8282301492c2`::moving from state preparing -> state finished >Thread-3981::DEBUG::2014-09-09 11:47:15,688::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3981::DEBUG::2014-09-09 11:47:15,688::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3981::DEBUG::2014-09-09 11:47:15,688::task::993::Storage.TaskManager.Task::(_decref) Task=`a9126f19-7076-4f50-b90b-8282301492c2`::ref 0 aborting False >Thread-3981::DEBUG::2014-09-09 11:47:15,689::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3981::DEBUG::2014-09-09 11:47:15,689::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:17,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:17,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0908933 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:17,702::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:17,703::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3982::DEBUG::2014-09-09 11:47:17,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`aee09ea8-d1fd-442d-a705-16016793b127`::moving from state init -> state preparing >Thread-3982::INFO::2014-09-09 11:47:17,704::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3982::INFO::2014-09-09 11:47:17,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106936', 'lastCheck': '8.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101342', 'lastCheck': '2.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000842681', 'lastCheck': '4.0', 'valid': True}} >Thread-3982::DEBUG::2014-09-09 11:47:17,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`aee09ea8-d1fd-442d-a705-16016793b127`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106936', 'lastCheck': '8.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101342', 'lastCheck': '2.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000842681', 'lastCheck': '4.0', 'valid': True}} >Thread-3982::DEBUG::2014-09-09 11:47:17,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`aee09ea8-d1fd-442d-a705-16016793b127`::moving from state preparing -> state finished >Thread-3982::DEBUG::2014-09-09 11:47:17,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3982::DEBUG::2014-09-09 11:47:17,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3982::DEBUG::2014-09-09 11:47:17,705::task::993::Storage.TaskManager.Task::(_decref) Task=`aee09ea8-d1fd-442d-a705-16016793b127`::ref 0 aborting False >Thread-3982::DEBUG::2014-09-09 11:47:17,706::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:17,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:17,714::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3983::DEBUG::2014-09-09 11:47:17,715::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:19,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:19,374::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:19,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:19,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:19,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:19,376::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:47:19,377::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:19,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:19,382::__init__::225::IOProcess::(_processLogs) (8866) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:19,383::__init__::225::IOProcess::(_processLogs) (8866) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:19,384::__init__::225::IOProcess::(_processLogs) (8866) Building response >Thread-19::DEBUG::2014-09-09 11:47:19,384::__init__::225::IOProcess::(_processLogs) (8866) Queuing response >Thread-23::DEBUG::2014-09-09 11:47:19,385::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110732 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:19,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:19,386::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:19,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:19,388::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:19,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:19,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:19,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:19,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:19,391::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:19,392::__init__::225::IOProcess::(_processLogs) (8867) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:19,392::__init__::225::IOProcess::(_processLogs) (8867) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:19,393::__init__::225::IOProcess::(_processLogs) (8867) Building response >Thread-19::DEBUG::2014-09-09 11:47:19,393::__init__::225::IOProcess::(_processLogs) (8867) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:19,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:19,394::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:19,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:19,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0953083 s, 10.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:19,935::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:19,936::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3984::DEBUG::2014-09-09 11:47:19,936::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3984::DEBUG::2014-09-09 11:47:19,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ae3763-f8fd-40ea-8c0b-5a125e3464ac`::moving from state init -> state preparing >Thread-3984::INFO::2014-09-09 11:47:19,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3984::DEBUG::2014-09-09 11:47:19,941::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c6707c6d-3b7a-4f49-810f-0b13e826516c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3984::DEBUG::2014-09-09 11:47:19,941::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3984::DEBUG::2014-09-09 11:47:19,942::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3984::DEBUG::2014-09-09 11:47:19,942::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c6707c6d-3b7a-4f49-810f-0b13e826516c`::Granted request >Thread-3984::DEBUG::2014-09-09 11:47:19,943::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`78ae3763-f8fd-40ea-8c0b-5a125e3464ac`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3984::DEBUG::2014-09-09 11:47:19,944::task::993::Storage.TaskManager.Task::(_decref) Task=`78ae3763-f8fd-40ea-8c0b-5a125e3464ac`::ref 1 aborting False >Thread-3984::INFO::2014-09-09 11:47:19,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282959282176', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282959282176', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282979205120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3984::DEBUG::2014-09-09 11:47:19,952::task::1191::Storage.TaskManager.Task::(prepare) Task=`78ae3763-f8fd-40ea-8c0b-5a125e3464ac`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282959282176', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282959282176', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282979205120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3984::DEBUG::2014-09-09 11:47:19,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ae3763-f8fd-40ea-8c0b-5a125e3464ac`::moving from state preparing -> state finished >Thread-3984::DEBUG::2014-09-09 11:47:19,953::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3984::DEBUG::2014-09-09 11:47:19,953::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3984::DEBUG::2014-09-09 11:47:19,954::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3984::DEBUG::2014-09-09 11:47:19,954::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3984::DEBUG::2014-09-09 11:47:19,955::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3984::DEBUG::2014-09-09 11:47:19,955::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3984::DEBUG::2014-09-09 11:47:19,956::task::993::Storage.TaskManager.Task::(_decref) Task=`78ae3763-f8fd-40ea-8c0b-5a125e3464ac`::ref 0 aborting False >Thread-3984::DEBUG::2014-09-09 11:47:19,957::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282959282176', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282959282176', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282979205120', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3984::DEBUG::2014-09-09 11:47:19,957::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:21,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:21,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3985::DEBUG::2014-09-09 11:47:21,443::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:21,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:21,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895347 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) (8868) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:23,664::__init__::225::IOProcess::(_processLogs) (8868) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:23,665::__init__::225::IOProcess::(_processLogs) DEBUG|(8868) Building response >Thread-19::DEBUG::2014-09-09 11:47:23,665::__init__::225::IOProcess::(_processLogs) (8868) Queuing response >Thread-3443::DEBUG::2014-09-09 11:47:23,665::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:23,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:23,670::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:47:23,672::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00092682 s, 383 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:23,672::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:23,672::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) (8869) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) (8869) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:23,673::__init__::225::IOProcess::(_processLogs) DEBUG|(8869) Building response >Thread-19::DEBUG::2014-09-09 11:47:23,674::__init__::225::IOProcess::(_processLogs) (8869) Queuing response >Dummy-97::DEBUG::2014-09-09 11:47:23,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:23,674::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:23,679::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:23,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900724 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:24,448::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:24,449::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3986::DEBUG::2014-09-09 11:47:24,450::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:24,786::__init__::225::IOProcess::(_processLogs) (8870) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:24,787::__init__::225::IOProcess::(_processLogs) (8870) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:24,787::__init__::225::IOProcess::(_processLogs) DEBUG|(8870) Building response >Thread-19::DEBUG::2014-09-09 11:47:24,787::__init__::225::IOProcess::(_processLogs) (8870) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:24,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:24,787::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:47:24,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:47:24,794::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000985157 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:24,795::__init__::225::IOProcess::(_processLogs) (8871) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:24,796::__init__::225::IOProcess::(_processLogs) (8871) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:24,796::__init__::225::IOProcess::(_processLogs) DEBUG|(8871) Building response >Thread-19::DEBUG::2014-09-09 11:47:24,796::__init__::225::IOProcess::(_processLogs) (8871) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:24,796::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:24,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) (8872) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) (8872) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) (8872) Building response >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) (8872) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:24,798::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) (8873) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) (8873) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) (8873) Building response >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) (8873) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:24,799::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:24,800::__init__::225::IOProcess::(_processLogs) (8874) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:24,801::__init__::225::IOProcess::(_processLogs) (8874) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:24,801::__init__::225::IOProcess::(_processLogs) (8874) Building response >Thread-19::DEBUG::2014-09-09 11:47:24,801::__init__::225::IOProcess::(_processLogs) (8874) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:24,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:24,801::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:47:25,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:25,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896864 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:27,460::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:27,460::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3987::DEBUG::2014-09-09 11:47:27,461::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:27,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:27,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897036 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:29,392::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:29,392::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:29,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:29,392::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:29,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:29,392::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:29,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:29,393::__init__::225::IOProcess::(_processLogs) (8875) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:29,393::__init__::225::IOProcess::(_processLogs) (8875) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:29,393::__init__::225::IOProcess::(_processLogs) DEBUG|(8875) Building response >Thread-19::DEBUG::2014-09-09 11:47:29,393::__init__::225::IOProcess::(_processLogs) (8875) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:29,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:29,394::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:47:29,394::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:47:29,401::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115999 s, 968 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:29,401::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:29,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:29,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:29,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:29,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:29,402::__init__::225::IOProcess::(_processLogs) (8876) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:29,402::__init__::225::IOProcess::(_processLogs) (8876) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:29,402::__init__::225::IOProcess::(_processLogs) (8876) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:29,402::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:29,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:30,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897724 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:30,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:30,211::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3988::DEBUG::2014-09-09 11:47:30,211::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3988::DEBUG::2014-09-09 11:47:30,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`e263f766-668a-4ca6-b9ab-62831fc84579`::moving from state init -> state preparing >Thread-3988::INFO::2014-09-09 11:47:30,213::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3988::INFO::2014-09-09 11:47:30,213::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3988::DEBUG::2014-09-09 11:47:30,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`e263f766-668a-4ca6-b9ab-62831fc84579`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3988::DEBUG::2014-09-09 11:47:30,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`e263f766-668a-4ca6-b9ab-62831fc84579`::moving from state preparing -> state finished >Thread-3988::DEBUG::2014-09-09 11:47:30,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3988::DEBUG::2014-09-09 11:47:30,213::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3988::DEBUG::2014-09-09 11:47:30,213::task::993::Storage.TaskManager.Task::(_decref) Task=`e263f766-668a-4ca6-b9ab-62831fc84579`::ref 0 aborting False >Thread-3988::DEBUG::2014-09-09 11:47:30,213::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3988::DEBUG::2014-09-09 11:47:30,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:30,410::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:30,410::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3989::DEBUG::2014-09-09 11:47:30,411::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3989::DEBUG::2014-09-09 11:47:30,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`194ab786-c442-4ba9-863a-59b3c06fa822`::moving from state init -> state preparing >Thread-3989::INFO::2014-09-09 11:47:30,411::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3989::DEBUG::2014-09-09 11:47:30,412::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`12282684-c5d5-451f-9914-d4930dc3ce67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3989::DEBUG::2014-09-09 11:47:30,412::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3989::DEBUG::2014-09-09 11:47:30,412::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3989::DEBUG::2014-09-09 11:47:30,412::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`12282684-c5d5-451f-9914-d4930dc3ce67`::Granted request >Thread-3989::DEBUG::2014-09-09 11:47:30,412::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`194ab786-c442-4ba9-863a-59b3c06fa822`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3989::DEBUG::2014-09-09 11:47:30,412::task::993::Storage.TaskManager.Task::(_decref) Task=`194ab786-c442-4ba9-863a-59b3c06fa822`::ref 1 aborting False >Thread-3989::INFO::2014-09-09 11:47:30,414::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283625127936', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3989::DEBUG::2014-09-09 11:47:30,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`194ab786-c442-4ba9-863a-59b3c06fa822`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283625127936', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3989::DEBUG::2014-09-09 11:47:30,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`194ab786-c442-4ba9-863a-59b3c06fa822`::moving from state preparing -> state finished >Thread-3989::DEBUG::2014-09-09 11:47:30,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3989::DEBUG::2014-09-09 11:47:30,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3989::DEBUG::2014-09-09 11:47:30,414::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3989::DEBUG::2014-09-09 11:47:30,414::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3989::DEBUG::2014-09-09 11:47:30,415::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3989::DEBUG::2014-09-09 11:47:30,415::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3989::DEBUG::2014-09-09 11:47:30,415::task::993::Storage.TaskManager.Task::(_decref) Task=`194ab786-c442-4ba9-863a-59b3c06fa822`::ref 0 aborting False >Thread-3989::DEBUG::2014-09-09 11:47:30,415::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283625127936', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3989::DEBUG::2014-09-09 11:47:30,415::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:30,467::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:30,468::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3990::DEBUG::2014-09-09 11:47:30,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:32,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:32,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898669 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:33,474::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:33,475::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3991::DEBUG::2014-09-09 11:47:33,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`a59bdfbb-daac-4447-b4cd-d5b421e20e51`::moving from state init -> state preparing >Thread-3991::INFO::2014-09-09 11:47:33,476::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3991::INFO::2014-09-09 11:47:33,476::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115999', 'lastCheck': '4.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000985157', 'lastCheck': '8.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00092682', 'lastCheck': '9.8', 'valid': True}} >Thread-3991::DEBUG::2014-09-09 11:47:33,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`a59bdfbb-daac-4447-b4cd-d5b421e20e51`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115999', 'lastCheck': '4.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000985157', 'lastCheck': '8.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00092682', 'lastCheck': '9.8', 'valid': True}} >Thread-3991::DEBUG::2014-09-09 11:47:33,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`a59bdfbb-daac-4447-b4cd-d5b421e20e51`::moving from state preparing -> state finished >Thread-3991::DEBUG::2014-09-09 11:47:33,476::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3991::DEBUG::2014-09-09 11:47:33,476::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3991::DEBUG::2014-09-09 11:47:33,476::task::993::Storage.TaskManager.Task::(_decref) Task=`a59bdfbb-daac-4447-b4cd-d5b421e20e51`::ref 0 aborting False >Thread-3991::DEBUG::2014-09-09 11:47:33,477::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:33,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:33,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3992::DEBUG::2014-09-09 11:47:33,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) (8877) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:33,680::__init__::225::IOProcess::(_processLogs) (8877) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:33,682::__init__::225::IOProcess::(_processLogs) (8877) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:33,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:47:33,682::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:47:33,689::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00095334 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) (8878) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:33,690::__init__::225::IOProcess::(_processLogs) (8878) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:33,691::__init__::225::IOProcess::(_processLogs) (8878) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:33,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:33,691::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:34,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:34,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897342 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) (8879) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:34,801::__init__::225::IOProcess::(_processLogs) (8879) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:34,802::__init__::225::IOProcess::(_processLogs) (8879) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:34,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:47:34,802::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:47:34,809::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100644 s, 544 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:34,810::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:34,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:34,810::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:34,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:34,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:34,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:34,811::__init__::225::IOProcess::(_processLogs) (8880) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:34,811::__init__::225::IOProcess::(_processLogs) (8880) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:34,811::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8880) Building response >Thread-19::DEBUG::2014-09-09 11:47:34,812::__init__::225::IOProcess::(_processLogs) (8880) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:34,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:34,812::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:34,813::__init__::225::IOProcess::(_processLogs) (8881) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) (8881) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) (8881) Building response >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) (8881) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:34,814::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) (8882) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) (8882) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) (8882) Building response >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) (8882) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:34,815::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) (8883) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) (8883) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8883) Building response >Thread-19::DEBUG::2014-09-09 11:47:34,816::__init__::225::IOProcess::(_processLogs) (8883) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:34,817::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:34,817::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:47:36,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:36,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897489 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:36,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:36,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3993::DEBUG::2014-09-09 11:47:36,987::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:38,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:38,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896749 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:39,403::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) (8884) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:39,404::__init__::225::IOProcess::(_processLogs) (8884) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:39,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(8884) Building response >Thread-19::DEBUG::2014-09-09 11:47:39,405::__init__::225::IOProcess::(_processLogs) (8884) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:39,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:39,406::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:47:39,406::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:47:39,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115122 s, 975 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:39,414::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:39,414::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:39,414::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) (8885) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) (8885) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) DEBUG|(8885) Building response >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) (8885) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:39,415::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:39,416::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:40,228::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:40,229::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3994::DEBUG::2014-09-09 11:47:40,230::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:40,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:40,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089719 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:40,895::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-3995::DEBUG::2014-09-09 11:47:40,895::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:47:40,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3995::DEBUG::2014-09-09 11:47:40,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed1abf64-4180-475b-b710-8e4a52cbecbc`::moving from state init -> state preparing >Thread-3995::INFO::2014-09-09 11:47:40,897::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3995::INFO::2014-09-09 11:47:40,897::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3995::DEBUG::2014-09-09 11:47:40,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed1abf64-4180-475b-b710-8e4a52cbecbc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-3995::DEBUG::2014-09-09 11:47:40,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed1abf64-4180-475b-b710-8e4a52cbecbc`::moving from state preparing -> state finished >Thread-3995::DEBUG::2014-09-09 11:47:40,897::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3995::DEBUG::2014-09-09 11:47:40,897::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3995::DEBUG::2014-09-09 11:47:40,897::task::993::Storage.TaskManager.Task::(_decref) Task=`ed1abf64-4180-475b-b710-8e4a52cbecbc`::ref 0 aborting False >Thread-3995::DEBUG::2014-09-09 11:47:40,898::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-3995::DEBUG::2014-09-09 11:47:40,898::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:41,035::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:41,036::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3996::DEBUG::2014-09-09 11:47:41,036::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3996::DEBUG::2014-09-09 11:47:41,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`d84bb235-f421-4212-872d-abd01e48079e`::moving from state init -> state preparing >Thread-3996::INFO::2014-09-09 11:47:41,037::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-3996::DEBUG::2014-09-09 11:47:41,037::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d084ce1d-f03f-4aae-a721-21094bb11f75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-3996::DEBUG::2014-09-09 11:47:41,037::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-3996::DEBUG::2014-09-09 11:47:41,037::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-3996::DEBUG::2014-09-09 11:47:41,037::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d084ce1d-f03f-4aae-a721-21094bb11f75`::Granted request >Thread-3996::DEBUG::2014-09-09 11:47:41,038::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d84bb235-f421-4212-872d-abd01e48079e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-3996::DEBUG::2014-09-09 11:47:41,038::task::993::Storage.TaskManager.Task::(_decref) Task=`d84bb235-f421-4212-872d-abd01e48079e`::ref 1 aborting False >Thread-3996::INFO::2014-09-09 11:47:41,039::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3996::DEBUG::2014-09-09 11:47:41,039::task::1191::Storage.TaskManager.Task::(prepare) Task=`d84bb235-f421-4212-872d-abd01e48079e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3996::DEBUG::2014-09-09 11:47:41,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`d84bb235-f421-4212-872d-abd01e48079e`::moving from state preparing -> state finished >Thread-3996::DEBUG::2014-09-09 11:47:41,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-3996::DEBUG::2014-09-09 11:47:41,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3996::DEBUG::2014-09-09 11:47:41,040::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-3996::DEBUG::2014-09-09 11:47:41,040::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-3996::DEBUG::2014-09-09 11:47:41,040::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-3996::DEBUG::2014-09-09 11:47:41,040::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-3996::DEBUG::2014-09-09 11:47:41,040::task::993::Storage.TaskManager.Task::(_decref) Task=`d84bb235-f421-4212-872d-abd01e48079e`::ref 0 aborting False >Thread-3996::DEBUG::2014-09-09 11:47:41,040::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283623030784', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-3996::DEBUG::2014-09-09 11:47:41,040::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:42,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:42,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898635 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:43,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:43,239::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3997::DEBUG::2014-09-09 11:47:43,240::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) (8886) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:43,692::__init__::225::IOProcess::(_processLogs) (8886) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:43,693::__init__::225::IOProcess::(_processLogs) DEBUG|(8886) Building response >Thread-3443::DEBUG::2014-09-09 11:47:43,693::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:43,693::__init__::225::IOProcess::(_processLogs) (8886) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:43,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:43,698::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:47:43,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000974046 s, 364 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:43,700::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:43,700::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) (8887) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) (8887) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) DEBUG|(8887) Building response >Thread-19::DEBUG::2014-09-09 11:47:43,701::__init__::225::IOProcess::(_processLogs) (8887) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:43,702::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:43,702::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:44,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:44,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897012 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:44,818::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:44,818::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:44,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:44,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:44,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:44,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:44,821::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-24::DEBUG::2014-09-09 11:47:44,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:44,822::__init__::225::IOProcess::(_processLogs) (8888) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:44,827::__init__::225::IOProcess::(_processLogs) (8888) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:44,827::__init__::225::IOProcess::(_processLogs) (8888) Building response >Thread-19::DEBUG::2014-09-09 11:47:44,828::__init__::225::IOProcess::(_processLogs) (8888) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:44,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:44,829::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:47:44,830::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000964775 s, 568 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:44,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:44,832::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:44,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:44,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:44,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:44,834::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:44,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:44,835::__init__::225::IOProcess::(_processLogs) (8889) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:44,836::__init__::225::IOProcess::(_processLogs) (8889) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:44,836::__init__::225::IOProcess::(_processLogs) (8889) Building response >Thread-19::DEBUG::2014-09-09 11:47:44,836::__init__::225::IOProcess::(_processLogs) (8889) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:44,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:44,837::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:44,838::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:44,838::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:47:44,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:44,839::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:44,839::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:44,840::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:44,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:44,841::__init__::225::IOProcess::(_processLogs) (8890) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:44,841::__init__::225::IOProcess::(_processLogs) (8890) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:44,842::__init__::225::IOProcess::(_processLogs) (8890) Building response >Thread-19::DEBUG::2014-09-09 11:47:44,842::__init__::225::IOProcess::(_processLogs) (8890) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:44,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:44,843::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:44,843::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:44,844::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:47:44,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:44,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:44,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) (8891) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) (8891) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) (8891) Building response >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) (8891) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:44,845::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:44,846::__init__::225::IOProcess::(_processLogs) (8892) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:44,847::__init__::225::IOProcess::(_processLogs) (8892) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:44,847::__init__::225::IOProcess::(_processLogs) (8892) Building response >Thread-19::DEBUG::2014-09-09 11:47:44,847::__init__::225::IOProcess::(_processLogs) (8892) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:44,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:44,847::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:46,246::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:46,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3998::DEBUG::2014-09-09 11:47:46,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:46,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:46,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089815 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:47:48,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:49,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897664 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:49,253::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:49,254::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3999::DEBUG::2014-09-09 11:47:49,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc6644ba-fa18-46aa-8d12-ff17d0ec8e34`::moving from state init -> state preparing >Thread-3999::INFO::2014-09-09 11:47:49,255::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-3999::INFO::2014-09-09 11:47:49,255::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115122', 'lastCheck': '9.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964775', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000974046', 'lastCheck': '5.6', 'valid': True}} >Thread-3999::DEBUG::2014-09-09 11:47:49,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc6644ba-fa18-46aa-8d12-ff17d0ec8e34`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115122', 'lastCheck': '9.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964775', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000974046', 'lastCheck': '5.6', 'valid': True}} >Thread-3999::DEBUG::2014-09-09 11:47:49,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc6644ba-fa18-46aa-8d12-ff17d0ec8e34`::moving from state preparing -> state finished >Thread-3999::DEBUG::2014-09-09 11:47:49,256::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-3999::DEBUG::2014-09-09 11:47:49,256::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-3999::DEBUG::2014-09-09 11:47:49,256::task::993::Storage.TaskManager.Task::(_decref) Task=`fc6644ba-fa18-46aa-8d12-ff17d0ec8e34`::ref 0 aborting False >Thread-3999::DEBUG::2014-09-09 11:47:49,257::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:49,264::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:49,264::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4000::DEBUG::2014-09-09 11:47:49,265::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:49,417::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:49,417::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:49,418::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:49,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:49,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:49,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:49,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:49,420::__init__::225::IOProcess::(_processLogs) (8893) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:49,421::__init__::225::IOProcess::(_processLogs) (8893) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:49,422::__init__::225::IOProcess::(_processLogs) DEBUG|(8893) Building response >Thread-23::DEBUG::2014-09-09 11:47:49,422::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:49,423::__init__::225::IOProcess::(_processLogs) (8893) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:49,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:49,429::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:47:49,430::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107238 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:49,432::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:49,432::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:49,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:49,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:49,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:49,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:49,436::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:49,437::__init__::225::IOProcess::(_processLogs) (8894) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:49,437::__init__::225::IOProcess::(_processLogs) (8894) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:49,438::__init__::225::IOProcess::(_processLogs) (8894) Building response >Thread-19::DEBUG::2014-09-09 11:47:49,438::__init__::225::IOProcess::(_processLogs) (8894) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:49,439::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:49,439::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:51,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:51,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896544 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:51,312::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:51,313::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4001::DEBUG::2014-09-09 11:47:51,313::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4001::DEBUG::2014-09-09 11:47:51,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e3daa2d-740a-4133-91aa-a7d992414cdd`::moving from state init -> state preparing >Thread-4001::INFO::2014-09-09 11:47:51,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4001::INFO::2014-09-09 11:47:51,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4001::DEBUG::2014-09-09 11:47:51,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e3daa2d-740a-4133-91aa-a7d992414cdd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4001::DEBUG::2014-09-09 11:47:51,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e3daa2d-740a-4133-91aa-a7d992414cdd`::moving from state preparing -> state finished >Thread-4001::DEBUG::2014-09-09 11:47:51,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4001::DEBUG::2014-09-09 11:47:51,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4001::DEBUG::2014-09-09 11:47:51,315::task::993::Storage.TaskManager.Task::(_decref) Task=`2e3daa2d-740a-4133-91aa-a7d992414cdd`::ref 0 aborting False >Thread-4001::DEBUG::2014-09-09 11:47:51,315::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4001::DEBUG::2014-09-09 11:47:51,315::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:51,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4002::DEBUG::2014-09-09 11:47:51,378::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:47:51,378::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4002::DEBUG::2014-09-09 11:47:51,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3b9a3e6-0387-46b6-928b-c4f3013e8785`::moving from state init -> state preparing >Thread-4002::INFO::2014-09-09 11:47:51,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4002::DEBUG::2014-09-09 11:47:51,380::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`85ecf693-44a7-4c94-b40d-b867d55c36d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4002::DEBUG::2014-09-09 11:47:51,380::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4002::DEBUG::2014-09-09 11:47:51,380::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4002::DEBUG::2014-09-09 11:47:51,380::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`85ecf693-44a7-4c94-b40d-b867d55c36d3`::Granted request >Thread-4002::DEBUG::2014-09-09 11:47:51,380::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3b9a3e6-0387-46b6-928b-c4f3013e8785`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4002::DEBUG::2014-09-09 11:47:51,380::task::993::Storage.TaskManager.Task::(_decref) Task=`a3b9a3e6-0387-46b6-928b-c4f3013e8785`::ref 1 aborting False >Thread-4002::INFO::2014-09-09 11:47:51,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4002::DEBUG::2014-09-09 11:47:51,382::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3b9a3e6-0387-46b6-928b-c4f3013e8785`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4002::DEBUG::2014-09-09 11:47:51,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3b9a3e6-0387-46b6-928b-c4f3013e8785`::moving from state preparing -> state finished >Thread-4002::DEBUG::2014-09-09 11:47:51,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4002::DEBUG::2014-09-09 11:47:51,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4002::DEBUG::2014-09-09 11:47:51,382::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4002::DEBUG::2014-09-09 11:47:51,383::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4002::DEBUG::2014-09-09 11:47:51,383::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4002::DEBUG::2014-09-09 11:47:51,383::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4002::DEBUG::2014-09-09 11:47:51,383::task::993::Storage.TaskManager.Task::(_decref) Task=`a3b9a3e6-0387-46b6-928b-c4f3013e8785`::ref 0 aborting False >Thread-4002::DEBUG::2014-09-09 11:47:51,383::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4002::DEBUG::2014-09-09 11:47:51,383::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:52,733::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:52,734::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4003::DEBUG::2014-09-09 11:47:52,735::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:53,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:53,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898379 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) (8895) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) (8895) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:53,703::__init__::225::IOProcess::(_processLogs) DEBUG|(8895) Building response >Thread-19::DEBUG::2014-09-09 11:47:53,704::__init__::225::IOProcess::(_processLogs) (8895) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:53,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:53,704::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:47:53,704::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:47:53,710::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000886608 s, 400 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:53,711::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:53,711::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:47:53,711::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:53,711::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:53,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) (8896) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) (8896) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) DEBUG|(8896) Building response >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) (8896) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:53,712::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:53,713::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) (8897) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:54,847::__init__::225::IOProcess::(_processLogs) (8897) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:54,848::__init__::225::IOProcess::(_processLogs) DEBUG|(8897) Building response >Thread-19::DEBUG::2014-09-09 11:47:54,848::__init__::225::IOProcess::(_processLogs) (8897) Queuing response >Thread-24::DEBUG::2014-09-09 11:47:54,848::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:54,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:54,853::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:47:54,857::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100359 s, 546 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:54,857::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:54,857::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:47:54,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:54,857::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:54,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:54,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:54,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:54,858::__init__::225::IOProcess::(_processLogs) (8898) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:54,858::__init__::225::IOProcess::(_processLogs) (8898) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:54,858::__init__::225::IOProcess::(_processLogs) DEBUG|(8898) Building response >Thread-19::DEBUG::2014-09-09 11:47:54,858::__init__::225::IOProcess::(_processLogs) (8898) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:54,858::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:54,859::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:47:54,859::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:54,859::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:47:54,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:54,859::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) (8899) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) (8899) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) (8899) Building response >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) (8899) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:54,860::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) (8900) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) (8900) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:54,861::__init__::225::IOProcess::(_processLogs) (8900) Building response >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) (8900) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:54,862::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) (8901) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) (8901) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) (8901) Building response >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) (8901) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:54,863::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:47:55,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:55,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897313 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:55,740::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:55,741::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4004::DEBUG::2014-09-09 11:47:55,742::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:47:57,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:57,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897592 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:47:58,750::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:47:58,751::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4005::DEBUG::2014-09-09 11:47:58,752::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:47:59,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:59,437::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) (8902) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) (8902) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:59,438::__init__::225::IOProcess::(_processLogs) DEBUG|(8902) Building response >Thread-19::DEBUG::2014-09-09 11:47:59,439::__init__::225::IOProcess::(_processLogs) (8902) Queuing response >Thread-23::DEBUG::2014-09-09 11:47:59,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:47:59,439::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:47:59,444::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:47:59,447::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112929 s, 994 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:47:59,447::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:47:59,447::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:47:59,447::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:47:59,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:47:59,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) (8903) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) (8903) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) DEBUG|(8903) Building response >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) (8903) Queuing response >Thread-19::DEBUG::2014-09-09 11:47:59,448::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:47:59,449::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:47:59,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:47:59,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897133 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:48:01,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:01,593::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:01,594::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4006::DEBUG::2014-09-09 11:48:01,594::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4006::DEBUG::2014-09-09 11:48:01,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`fde4d88a-48b7-4ebe-b1be-dcb6ce3d1da2`::moving from state init -> state preparing >Thread-4006::INFO::2014-09-09 11:48:01,595::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4006::INFO::2014-09-09 11:48:01,596::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4006::DEBUG::2014-09-09 11:48:01,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`fde4d88a-48b7-4ebe-b1be-dcb6ce3d1da2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4006::DEBUG::2014-09-09 11:48:01,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`fde4d88a-48b7-4ebe-b1be-dcb6ce3d1da2`::moving from state preparing -> state finished >Thread-4006::DEBUG::2014-09-09 11:48:01,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4006::DEBUG::2014-09-09 11:48:01,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4006::DEBUG::2014-09-09 11:48:01,596::task::993::Storage.TaskManager.Task::(_decref) Task=`fde4d88a-48b7-4ebe-b1be-dcb6ce3d1da2`::ref 0 aborting False >Thread-4006::DEBUG::2014-09-09 11:48:01,596::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4006::DEBUG::2014-09-09 11:48:01,596::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:01,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897306 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:01,758::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:01,759::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4007::DEBUG::2014-09-09 11:48:01,759::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:01,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4008::DEBUG::2014-09-09 11:48:01,910::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:48:01,910::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4008::DEBUG::2014-09-09 11:48:01,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`839a947e-f414-4094-8a5d-1dff173bebf2`::moving from state init -> state preparing >Thread-4008::INFO::2014-09-09 11:48:01,911::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4008::DEBUG::2014-09-09 11:48:01,912::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d1e7e69c-31ae-4d53-906b-99d4e051ca02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4008::DEBUG::2014-09-09 11:48:01,912::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4008::DEBUG::2014-09-09 11:48:01,912::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4008::DEBUG::2014-09-09 11:48:01,912::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d1e7e69c-31ae-4d53-906b-99d4e051ca02`::Granted request >Thread-4008::DEBUG::2014-09-09 11:48:01,912::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`839a947e-f414-4094-8a5d-1dff173bebf2`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4008::DEBUG::2014-09-09 11:48:01,912::task::993::Storage.TaskManager.Task::(_decref) Task=`839a947e-f414-4094-8a5d-1dff173bebf2`::ref 1 aborting False >Thread-4008::INFO::2014-09-09 11:48:01,914::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4008::DEBUG::2014-09-09 11:48:01,914::task::1191::Storage.TaskManager.Task::(prepare) Task=`839a947e-f414-4094-8a5d-1dff173bebf2`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4008::DEBUG::2014-09-09 11:48:01,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`839a947e-f414-4094-8a5d-1dff173bebf2`::moving from state preparing -> state finished >Thread-4008::DEBUG::2014-09-09 11:48:01,914::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4008::DEBUG::2014-09-09 11:48:01,914::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4008::DEBUG::2014-09-09 11:48:01,914::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4008::DEBUG::2014-09-09 11:48:01,914::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4008::DEBUG::2014-09-09 11:48:01,914::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4008::DEBUG::2014-09-09 11:48:01,915::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4008::DEBUG::2014-09-09 11:48:01,915::task::993::Storage.TaskManager.Task::(_decref) Task=`839a947e-f414-4094-8a5d-1dff173bebf2`::ref 0 aborting False >Thread-4008::DEBUG::2014-09-09 11:48:01,915::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4008::DEBUG::2014-09-09 11:48:01,915::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:03,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:03,713::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) (8904) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:03,714::__init__::225::IOProcess::(_processLogs) (8904) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:03,773::__init__::225::IOProcess::(_processLogs) DEBUG|(8904) Building response >Thread-19::DEBUG::2014-09-09 11:48:03,774::__init__::225::IOProcess::(_processLogs) (8904) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:03,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:03,775::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:48:03,776::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:03,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970185 s, 10.6 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:48:03,784::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00093677 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:03,785::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:03,786::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:03,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:03,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:03,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:03,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:03,788::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:03,789::__init__::225::IOProcess::(_processLogs) (8905) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:03,789::__init__::225::IOProcess::(_processLogs) (8905) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:03,790::__init__::225::IOProcess::(_processLogs) (8905) Building response >Thread-19::DEBUG::2014-09-09 11:48:03,790::__init__::225::IOProcess::(_processLogs) (8905) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:03,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:03,791::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:04,764::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:04,765::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4009::DEBUG::2014-09-09 11:48:04,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`be2ff97e-c313-4d10-8167-b404f92ed83e`::moving from state init -> state preparing >Thread-4009::INFO::2014-09-09 11:48:04,766::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4009::INFO::2014-09-09 11:48:04,766::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112929', 'lastCheck': '5.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100359', 'lastCheck': '9.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00093677', 'lastCheck': '1.0', 'valid': True}} >Thread-4009::DEBUG::2014-09-09 11:48:04,766::task::1191::Storage.TaskManager.Task::(prepare) Task=`be2ff97e-c313-4d10-8167-b404f92ed83e`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112929', 'lastCheck': '5.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100359', 'lastCheck': '9.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00093677', 'lastCheck': '1.0', 'valid': True}} >Thread-4009::DEBUG::2014-09-09 11:48:04,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`be2ff97e-c313-4d10-8167-b404f92ed83e`::moving from state preparing -> state finished >Thread-4009::DEBUG::2014-09-09 11:48:04,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4009::DEBUG::2014-09-09 11:48:04,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4009::DEBUG::2014-09-09 11:48:04,767::task::993::Storage.TaskManager.Task::(_decref) Task=`be2ff97e-c313-4d10-8167-b404f92ed83e`::ref 0 aborting False >Thread-4009::DEBUG::2014-09-09 11:48:04,768::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:04,777::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:04,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4010::DEBUG::2014-09-09 11:48:04,778::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:04,863::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:04,863::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:04,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) (8906) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) (8906) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:04,864::__init__::225::IOProcess::(_processLogs) DEBUG|(8906) Building response >Thread-24::DEBUG::2014-09-09 11:48:04,865::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:04,865::__init__::225::IOProcess::(_processLogs) (8906) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:04,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:04,870::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:48:04,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000963722 s, 569 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) (8907) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) (8907) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:04,873::__init__::225::IOProcess::(_processLogs) DEBUG|(8907) Building response >Thread-19::DEBUG::2014-09-09 11:48:04,874::__init__::225::IOProcess::(_processLogs) (8907) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:04,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:04,874::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:04,874::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) (8908) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:04,875::__init__::225::IOProcess::(_processLogs) (8908) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) (8908) Building response >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) (8908) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:04,876::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) (8909) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) (8909) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) (8909) Building response >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) (8909) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:04,877::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) (8910) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) (8910) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) DEBUG|(8910) Building response >Thread-19::DEBUG::2014-09-09 11:48:04,878::__init__::225::IOProcess::(_processLogs) (8910) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:04,879::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:04,879::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:48:05,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:05,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898479 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:48:07,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:07,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897264 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:08,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:08,687::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4011::DEBUG::2014-09-09 11:48:08,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-23::DEBUG::2014-09-09 11:48:09,449::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:48:09,451::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,451::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) (8911) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) (8911) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:09,452::__init__::225::IOProcess::(_processLogs) DEBUG|(8911) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) (8911) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) (8912) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) (8912) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) (8913) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:09,454::__init__::225::IOProcess::(_processLogs) (8913) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) DEBUG|(8912) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) (8912) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) (8913) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) (8913) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,455::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:09,456::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 11:48:09,457::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:48:09,457::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,457::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:48:09,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,457::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,458::__init__::225::IOProcess::(_processLogs) (8914) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:48:09,458::__init__::225::IOProcess::(_processLogs) (8914) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:48:09,531::__init__::225::IOProcess::(_processLogs) DEBUG|(8914) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,531::__init__::225::IOProcess::(_processLogs) (8914) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,531::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:48:09,531::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:48:09,531::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,532::__init__::225::IOProcess::(_processLogs) (8915) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:48:09,533::__init__::225::IOProcess::(_processLogs) (8915) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:48:09,535::__init__::225::IOProcess::(_processLogs) DEBUG|(8915) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,535::__init__::225::IOProcess::(_processLogs) (8915) Queuing response >Thread-23::DEBUG::2014-09-09 11:48:09,535::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:48:09,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:09,536::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 11:48:09,536::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,536::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) (8916) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) (8916) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:09,537::__init__::225::IOProcess::(_processLogs) (8916) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) (8916) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,538::__init__::225::IOProcess::(_processLogs) (8917) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:09,539::__init__::225::IOProcess::(_processLogs) (8917) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:09,539::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8917) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,540::__init__::225::IOProcess::(_processLogs) (8917) Queuing response >Thread-23::DEBUG::2014-09-09 11:48:09,540::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:48:09,540::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-23::INFO::2014-09-09 11:48:09,540::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:48:09,540::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:48:09,541::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:48:09,541::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,541::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:09,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,541::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) (8918) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) (8918) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8918) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) (8918) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,542::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:48:09,543::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:09,543::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:48:09,550::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106723 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:09,550::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:09,550::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:09,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:09,550::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) (8919) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) (8919) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8919) Building response >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) (8919) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:09,551::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:09,552::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:48:10,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:10,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897918 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:11,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:11,698::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4015::DEBUG::2014-09-09 11:48:11,699::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:12,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:12,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897707 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:12,430::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:12,431::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4016::DEBUG::2014-09-09 11:48:12,431::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4016::DEBUG::2014-09-09 11:48:12,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e363f7b-cb46-4d19-aaea-f1b73fc63a0a`::moving from state init -> state preparing >Thread-4016::INFO::2014-09-09 11:48:12,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4016::INFO::2014-09-09 11:48:12,432::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4016::DEBUG::2014-09-09 11:48:12,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e363f7b-cb46-4d19-aaea-f1b73fc63a0a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4016::DEBUG::2014-09-09 11:48:12,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e363f7b-cb46-4d19-aaea-f1b73fc63a0a`::moving from state preparing -> state finished >Thread-4016::DEBUG::2014-09-09 11:48:12,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4016::DEBUG::2014-09-09 11:48:12,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4016::DEBUG::2014-09-09 11:48:12,433::task::993::Storage.TaskManager.Task::(_decref) Task=`5e363f7b-cb46-4d19-aaea-f1b73fc63a0a`::ref 0 aborting False >Thread-4016::DEBUG::2014-09-09 11:48:12,433::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4016::DEBUG::2014-09-09 11:48:12,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:12,483::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:12,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4017::DEBUG::2014-09-09 11:48:12,484::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4017::DEBUG::2014-09-09 11:48:12,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`4831bf0c-6c1a-421a-99df-25314e9acd7a`::moving from state init -> state preparing >Thread-4017::INFO::2014-09-09 11:48:12,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4017::DEBUG::2014-09-09 11:48:12,485::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6f689923-63ed-4a77-9ff0-22f7b3545e38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4017::DEBUG::2014-09-09 11:48:12,485::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4017::DEBUG::2014-09-09 11:48:12,485::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4017::DEBUG::2014-09-09 11:48:12,485::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6f689923-63ed-4a77-9ff0-22f7b3545e38`::Granted request >Thread-4017::DEBUG::2014-09-09 11:48:12,486::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4831bf0c-6c1a-421a-99df-25314e9acd7a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4017::DEBUG::2014-09-09 11:48:12,486::task::993::Storage.TaskManager.Task::(_decref) Task=`4831bf0c-6c1a-421a-99df-25314e9acd7a`::ref 1 aborting False >Thread-4017::INFO::2014-09-09 11:48:12,487::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4017::DEBUG::2014-09-09 11:48:12,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`4831bf0c-6c1a-421a-99df-25314e9acd7a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4017::DEBUG::2014-09-09 11:48:12,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`4831bf0c-6c1a-421a-99df-25314e9acd7a`::moving from state preparing -> state finished >Thread-4017::DEBUG::2014-09-09 11:48:12,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4017::DEBUG::2014-09-09 11:48:12,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4017::DEBUG::2014-09-09 11:48:12,488::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4017::DEBUG::2014-09-09 11:48:12,488::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4017::DEBUG::2014-09-09 11:48:12,488::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4017::DEBUG::2014-09-09 11:48:12,488::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4017::DEBUG::2014-09-09 11:48:12,488::task::993::Storage.TaskManager.Task::(_decref) Task=`4831bf0c-6c1a-421a-99df-25314e9acd7a`::ref 0 aborting False >Thread-4017::DEBUG::2014-09-09 11:48:12,488::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283621982208', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4017::DEBUG::2014-09-09 11:48:12,488::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:13,789::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:13,789::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) (8920) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) (8920) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8920) Building response >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) (8920) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:13,790::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:13,791::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:48:13,791::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:48:13,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000937288 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:13,799::__init__::225::IOProcess::(_processLogs) (8921) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:13,800::__init__::225::IOProcess::(_processLogs) (8921) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:13,800::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8921) Building response >Thread-19::DEBUG::2014-09-09 11:48:13,800::__init__::225::IOProcess::(_processLogs) (8921) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:13,800::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:13,801::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:48:14,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:14,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897731 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:14,705::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:14,705::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4018::DEBUG::2014-09-09 11:48:14,706::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-24::DEBUG::2014-09-09 11:48:14,879::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:14,881::__init__::225::IOProcess::(_processLogs) (8922) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:14,882::__init__::225::IOProcess::(_processLogs) (8922) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:14,882::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8922) Building response >Thread-19::DEBUG::2014-09-09 11:48:14,882::__init__::225::IOProcess::(_processLogs) (8922) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:14,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:14,882::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) (8923) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) (8923) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:14,883::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Message size is 127 >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) (8924) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) (8924) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) (8924) Building response >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) (8924) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:14,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:14,885::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:48:14,885::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8923) Building response >Thread-19::DEBUG::2014-09-09 11:48:14,886::__init__::225::IOProcess::(_processLogs) (8923) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:14,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:14,887::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-24::DEBUG::2014-09-09 11:48:14,889::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:14,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:14,890::__init__::225::IOProcess::(_processLogs) (8925) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:48:14,890::__init__::225::IOProcess::(_processLogs) (8925) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:48:16,014::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8925) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,014::__init__::225::IOProcess::(_processLogs) (8925) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,015::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-24::DEBUG::2014-09-09 11:48:16,015::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:48:16,015::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,015::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:48:16,015::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,016::__init__::225::IOProcess::(_processLogs) (8926) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:48:16,016::__init__::225::IOProcess::(_processLogs) (8926) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:48:16,019::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8926) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,020::__init__::225::IOProcess::(_processLogs) (8926) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,020::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-24::DEBUG::2014-09-09 11:48:16,020::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:48:16,020::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,020::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) (8927) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) (8927) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:16,021::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8927) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,022::__init__::225::IOProcess::(_processLogs) (8927) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,022::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,022::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:16,022::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,022::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:48:16,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,023::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,023::__init__::225::IOProcess::(_processLogs) (8928) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:16,023::__init__::225::IOProcess::(_processLogs) (8928) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:16,024::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8928) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,024::__init__::225::IOProcess::(_processLogs) (8928) Queuing response >Thread-24::DEBUG::2014-09-09 11:48:16,024::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:48:16,024::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-24::INFO::2014-09-09 11:48:16,024::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:48:16,025::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-24::INFO::2014-09-09 11:48:16,025::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) (8929) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:16,026::__init__::225::IOProcess::(_processLogs) (8929) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:16,027::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|(8929) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,027::__init__::225::IOProcess::(_processLogs) (8929) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,027::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:48:16,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:16,027::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:48:16,035::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00089752 s, 611 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:16,035::__init__::225::IOProcess::(_processLogs) (8915) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) (8930) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) (8930) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) DEBUG|(8930) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,036::__init__::225::IOProcess::(_processLogs) (8930) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,037::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,037::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:16,037::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) (8931) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) (8931) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:16,038::__init__::225::IOProcess::(_processLogs) (8931) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) (8931) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) (8932) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) (8932) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) (8932) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) (8932) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:16,040::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 171 >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) (8933) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:16,041::__init__::225::IOProcess::(_processLogs) (8933) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:16,042::__init__::225::IOProcess::(_processLogs) (8933) Building response >Thread-19::DEBUG::2014-09-09 11:48:16,042::__init__::225::IOProcess::(_processLogs) (8933) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:16,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:16,042::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:48:16,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:16,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897234 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:17,713::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:17,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4022::DEBUG::2014-09-09 11:48:17,714::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:18,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:18,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896455 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:19,553::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:19,553::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:19,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:19,554::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:19,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:19,556::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:48:19,556::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:19,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:19,562::__init__::225::IOProcess::(_processLogs) (8934) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:19,562::__init__::225::IOProcess::(_processLogs) (8934) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:19,563::__init__::225::IOProcess::(_processLogs) (8934) Building response >Thread-19::DEBUG::2014-09-09 11:48:19,563::__init__::225::IOProcess::(_processLogs) (8934) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:19,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:48:19,565::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111565 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:19,565::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:19,567::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:19,567::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:19,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:19,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:19,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:19,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:19,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:19,570::__init__::225::IOProcess::(_processLogs) (8935) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:19,571::__init__::225::IOProcess::(_processLogs) DEBUG|(8935) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:19,572::__init__::225::IOProcess::(_processLogs) (8935) Building response >Thread-19::DEBUG::2014-09-09 11:48:19,572::__init__::225::IOProcess::(_processLogs) (8935) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:19,573::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:19,573::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:48:20,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:20,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089685 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:20,722::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:20,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4023::DEBUG::2014-09-09 11:48:20,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`19d213d3-48aa-4e51-9345-0884ba82733e`::moving from state init -> state preparing >Thread-4023::INFO::2014-09-09 11:48:20,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4023::INFO::2014-09-09 11:48:20,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111565', 'lastCheck': '1.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089752', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000937288', 'lastCheck': '6.9', 'valid': True}} >Thread-4023::DEBUG::2014-09-09 11:48:20,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`19d213d3-48aa-4e51-9345-0884ba82733e`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111565', 'lastCheck': '1.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00089752', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000937288', 'lastCheck': '6.9', 'valid': True}} >Thread-4023::DEBUG::2014-09-09 11:48:20,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`19d213d3-48aa-4e51-9345-0884ba82733e`::moving from state preparing -> state finished >Thread-4023::DEBUG::2014-09-09 11:48:20,725::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4023::DEBUG::2014-09-09 11:48:20,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4023::DEBUG::2014-09-09 11:48:20,725::task::993::Storage.TaskManager.Task::(_decref) Task=`19d213d3-48aa-4e51-9345-0884ba82733e`::ref 0 aborting False >Thread-4023::DEBUG::2014-09-09 11:48:20,726::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:20,734::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:20,734::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4024::DEBUG::2014-09-09 11:48:20,735::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:22,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:22,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:22,715::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4025::DEBUG::2014-09-09 11:48:22,715::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4025::DEBUG::2014-09-09 11:48:22,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`a554ea13-4a9a-4279-a73f-c04beb9863dd`::moving from state init -> state preparing >Thread-4025::INFO::2014-09-09 11:48:22,716::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4025::INFO::2014-09-09 11:48:22,716::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4025::DEBUG::2014-09-09 11:48:22,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`a554ea13-4a9a-4279-a73f-c04beb9863dd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4025::DEBUG::2014-09-09 11:48:22,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`a554ea13-4a9a-4279-a73f-c04beb9863dd`::moving from state preparing -> state finished >Thread-4025::DEBUG::2014-09-09 11:48:22,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4025::DEBUG::2014-09-09 11:48:22,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4025::DEBUG::2014-09-09 11:48:22,717::task::993::Storage.TaskManager.Task::(_decref) Task=`a554ea13-4a9a-4279-a73f-c04beb9863dd`::ref 0 aborting False >Thread-4025::DEBUG::2014-09-09 11:48:22,717::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4025::DEBUG::2014-09-09 11:48:22,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:22,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896517 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:22,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:22,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4026::DEBUG::2014-09-09 11:48:22,874::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4026::DEBUG::2014-09-09 11:48:22,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c893292-4fb4-4053-a92f-61a80e0111bf`::moving from state init -> state preparing >Thread-4026::INFO::2014-09-09 11:48:22,875::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4026::DEBUG::2014-09-09 11:48:22,875::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`49655f51-e619-43fd-be70-50267d9bc63e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4026::DEBUG::2014-09-09 11:48:22,875::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4026::DEBUG::2014-09-09 11:48:22,875::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4026::DEBUG::2014-09-09 11:48:22,875::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`49655f51-e619-43fd-be70-50267d9bc63e`::Granted request >Thread-4026::DEBUG::2014-09-09 11:48:22,875::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8c893292-4fb4-4053-a92f-61a80e0111bf`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4026::DEBUG::2014-09-09 11:48:22,876::task::993::Storage.TaskManager.Task::(_decref) Task=`8c893292-4fb4-4053-a92f-61a80e0111bf`::ref 1 aborting False >Thread-4026::INFO::2014-09-09 11:48:22,877::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283036876800', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283176337408', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283310555136', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4026::DEBUG::2014-09-09 11:48:22,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c893292-4fb4-4053-a92f-61a80e0111bf`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283036876800', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283176337408', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283310555136', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4026::DEBUG::2014-09-09 11:48:22,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c893292-4fb4-4053-a92f-61a80e0111bf`::moving from state preparing -> state finished >Thread-4026::DEBUG::2014-09-09 11:48:22,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4026::DEBUG::2014-09-09 11:48:22,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4026::DEBUG::2014-09-09 11:48:22,878::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4026::DEBUG::2014-09-09 11:48:22,878::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4026::DEBUG::2014-09-09 11:48:22,878::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4026::DEBUG::2014-09-09 11:48:22,878::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4026::DEBUG::2014-09-09 11:48:22,878::task::993::Storage.TaskManager.Task::(_decref) Task=`8c893292-4fb4-4053-a92f-61a80e0111bf`::ref 0 aborting False >Thread-4026::DEBUG::2014-09-09 11:48:22,878::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283036876800', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283176337408', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283310555136', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4026::DEBUG::2014-09-09 11:48:22,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-3443::DEBUG::2014-09-09 11:48:23,801::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:48:23,803::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:23,803::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:48:23,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:23,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:23,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:23,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:23,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:23,804::__init__::225::IOProcess::(_processLogs) (8936) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:23,804::__init__::225::IOProcess::(_processLogs) (8936) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:23,804::__init__::225::IOProcess::(_processLogs) DEBUG|(8936) Building response >Thread-19::DEBUG::2014-09-09 11:48:23,805::__init__::225::IOProcess::(_processLogs) (8936) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:23,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:23,806::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:48:23,807::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:23,808::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:48:23,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:23,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:23,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3443::DEBUG::2014-09-09 11:48:23,811::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:48:23,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:23,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:23,811::__init__::225::IOProcess::(_processLogs) (8937) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:23,811::__init__::225::IOProcess::(_processLogs) (8937) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) DEBUG|(8937) Building response >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) (8937) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:48:23,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) (8938) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) (8938) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:23,813::__init__::225::IOProcess::(_processLogs) DEBUG|(8938) Building response >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) (8938) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:23,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:23,815::__init__::225::IOProcess::(_processLogs) (8939) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:48:23,815::__init__::225::IOProcess::(_processLogs) (8939) Got request for method 'touch' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:24,094::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:24,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4030::DEBUG::2014-09-09 11:48:24,095::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:24,216::__init__::225::IOProcess::(_processLogs) (8939) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:24,216::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3443::DEBUG::2014-09-09 11:48:24,216::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) (8940) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:48:24,217::__init__::225::IOProcess::(_processLogs) (8940) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:48:24,219::__init__::225::IOProcess::(_processLogs) DEBUG|(8940) Building response >Thread-19::DEBUG::2014-09-09 11:48:24,219::__init__::225::IOProcess::(_processLogs) (8940) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:24,219::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:48:24,219::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:48:24,220::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-19::DEBUG::2014-09-09 11:48:24,221::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:24,221::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:48:24,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:24,221::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:24,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:24,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) (8941) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) (8941) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) (8941) Building response >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) (8941) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:24,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:24,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:24,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:24,223::__init__::225::IOProcess::(_processLogs) (8942) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:48:24,223::__init__::225::IOProcess::(_processLogs) (8942) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:48:24,225::__init__::225::IOProcess::(_processLogs) DEBUG|(8942) Building response >Thread-19::DEBUG::2014-09-09 11:48:24,225::__init__::225::IOProcess::(_processLogs) (8942) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:24,225::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:48:24,225::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:48:24,225::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::INFO::2014-09-09 11:48:24,225::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 11:48:24,226::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:48:24,226::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:24,226::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:24,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:24,226::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:24,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:24,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:24,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:24,227::__init__::225::IOProcess::(_processLogs) (8943) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:24,227::__init__::225::IOProcess::(_processLogs) (8943) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:24,227::__init__::225::IOProcess::(_processLogs) DEBUG|(8943) Building response >Thread-3443::DEBUG::2014-09-09 11:48:24,228::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:24,228::__init__::225::IOProcess::(_processLogs) (8943) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:24,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:24,233::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:48:24,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000877864 s, 404 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) (8944) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:24,235::__init__::225::IOProcess::(_processLogs) (8944) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:24,236::__init__::225::IOProcess::(_processLogs) DEBUG|(8944) Building response >Thread-19::DEBUG::2014-09-09 11:48:24,236::__init__::225::IOProcess::(_processLogs) (8944) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:24,236::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:24,237::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:48:24,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:24,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897048 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:26,041::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) (8945) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) (8945) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:26,042::__init__::225::IOProcess::(_processLogs) DEBUG|(8945) Building response >Thread-24::DEBUG::2014-09-09 11:48:26,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:26,043::__init__::225::IOProcess::(_processLogs) (8945) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:26,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:26,048::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:48:26,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000940842 s, 582 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) (8946) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) (8946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) DEBUG|(8946) Building response >Thread-19::DEBUG::2014-09-09 11:48:26,052::__init__::225::IOProcess::(_processLogs) (8946) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:26,053::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:26,053::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:26,053::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 165 >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) (8947) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:26,054::__init__::225::IOProcess::(_processLogs) (8947) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:26,055::__init__::225::IOProcess::(_processLogs) (8947) Building response >Thread-19::DEBUG::2014-09-09 11:48:26,055::__init__::225::IOProcess::(_processLogs) (8947) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:26,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:26,055::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:26,055::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:26,055::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) (8948) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) (8948) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) (8948) Building response >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) (8948) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:26,056::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:26,057::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:26,057::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:48:26,057::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:26,057::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:26,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:26,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) (8949) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) (8949) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) (8949) Building response >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) (8949) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:26,058::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:48:26,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:26,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897001 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:27,101::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:27,102::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4031::DEBUG::2014-09-09 11:48:27,102::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:28,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:29,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896678 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:29,572::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:29,572::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:29,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) (8950) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) (8950) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:29,573::__init__::225::IOProcess::(_processLogs) DEBUG|(8950) Building response >Thread-19::DEBUG::2014-09-09 11:48:29,574::__init__::225::IOProcess::(_processLogs) (8950) Queuing response >Thread-23::DEBUG::2014-09-09 11:48:29,574::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:29,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:29,579::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:48:29,599::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0189605 s, 59.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:29,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:29,599::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:29,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:29,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:29,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:29,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:29,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:29,600::__init__::225::IOProcess::(_processLogs) (8951) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:29,600::__init__::225::IOProcess::(_processLogs) (8951) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:29,600::__init__::225::IOProcess::(_processLogs) (8951) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:29,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:29,601::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:30,111::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:30,112::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4032::DEBUG::2014-09-09 11:48:30,114::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:31,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:31,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.092129 s, 11.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:33,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:33,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4033::DEBUG::2014-09-09 11:48:33,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:33,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:33,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898453 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:33,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:33,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4034::DEBUG::2014-09-09 11:48:33,552::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4034::DEBUG::2014-09-09 11:48:33,553::task::595::Storage.TaskManager.Task::(_updateState) Task=`036cf3a1-5f8e-480d-8f8e-8861a73f9896`::moving from state init -> state preparing >Thread-4034::INFO::2014-09-09 11:48:33,553::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4034::INFO::2014-09-09 11:48:33,553::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4034::DEBUG::2014-09-09 11:48:33,553::task::1191::Storage.TaskManager.Task::(prepare) Task=`036cf3a1-5f8e-480d-8f8e-8861a73f9896`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4034::DEBUG::2014-09-09 11:48:33,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`036cf3a1-5f8e-480d-8f8e-8861a73f9896`::moving from state preparing -> state finished >Thread-4034::DEBUG::2014-09-09 11:48:33,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4034::DEBUG::2014-09-09 11:48:33,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4034::DEBUG::2014-09-09 11:48:33,554::task::993::Storage.TaskManager.Task::(_decref) Task=`036cf3a1-5f8e-480d-8f8e-8861a73f9896`::ref 0 aborting False >Thread-4034::DEBUG::2014-09-09 11:48:33,554::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4034::DEBUG::2014-09-09 11:48:33,554::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:33,615::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4035::DEBUG::2014-09-09 11:48:33,616::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:48:33,616::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4035::DEBUG::2014-09-09 11:48:33,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e4a8a8c-7f3a-4a9d-bc82-36b81789db8c`::moving from state init -> state preparing >Thread-4035::INFO::2014-09-09 11:48:33,616::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4035::DEBUG::2014-09-09 11:48:33,617::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a6be6504-c7c7-403a-9685-de66c4da78ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4035::DEBUG::2014-09-09 11:48:33,617::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4035::DEBUG::2014-09-09 11:48:33,617::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4035::DEBUG::2014-09-09 11:48:33,617::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a6be6504-c7c7-403a-9685-de66c4da78ca`::Granted request >Thread-4035::DEBUG::2014-09-09 11:48:33,617::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e4a8a8c-7f3a-4a9d-bc82-36b81789db8c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4035::DEBUG::2014-09-09 11:48:33,617::task::993::Storage.TaskManager.Task::(_decref) Task=`3e4a8a8c-7f3a-4a9d-bc82-36b81789db8c`::ref 1 aborting False >Thread-4035::INFO::2014-09-09 11:48:33,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283615690752', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282950893568', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282949844992', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4035::DEBUG::2014-09-09 11:48:33,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e4a8a8c-7f3a-4a9d-bc82-36b81789db8c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283615690752', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282950893568', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282949844992', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4035::DEBUG::2014-09-09 11:48:33,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e4a8a8c-7f3a-4a9d-bc82-36b81789db8c`::moving from state preparing -> state finished >Thread-4035::DEBUG::2014-09-09 11:48:33,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4035::DEBUG::2014-09-09 11:48:33,619::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4035::DEBUG::2014-09-09 11:48:33,619::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4035::DEBUG::2014-09-09 11:48:33,620::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4035::DEBUG::2014-09-09 11:48:33,620::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4035::DEBUG::2014-09-09 11:48:33,620::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4035::DEBUG::2014-09-09 11:48:33,620::task::993::Storage.TaskManager.Task::(_decref) Task=`3e4a8a8c-7f3a-4a9d-bc82-36b81789db8c`::ref 0 aborting False >Thread-4035::DEBUG::2014-09-09 11:48:33,620::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283615690752', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282950893568', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282949844992', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4035::DEBUG::2014-09-09 11:48:33,620::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:34,237::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:34,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:34,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:34,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:34,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:34,237::__init__::225::IOProcess::(_processLogs) (8952) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:34,238::__init__::225::IOProcess::(_processLogs) (8952) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:34,240::__init__::225::IOProcess::(_processLogs) (8952) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:34,240::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:48:34,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:48:34,247::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000878544 s, 404 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) (8953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:34,248::__init__::225::IOProcess::(_processLogs) (8953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:34,249::__init__::225::IOProcess::(_processLogs) (8953) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:34,249::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:48:35,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:35,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896847 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) (8954) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:36,058::__init__::225::IOProcess::(_processLogs) (8954) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:36,059::__init__::225::IOProcess::(_processLogs) (8954) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:36,059::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:48:36,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:48:36,066::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000908619 s, 603 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) (8955) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:36,067::__init__::225::IOProcess::(_processLogs) (8955) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:36,068::__init__::225::IOProcess::(_processLogs) (8955) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:36,068::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:36,068::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) (8956) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) (8956) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:36,069::__init__::225::IOProcess::(_processLogs) (8956) Building response >Thread-19::DEBUG::2014-09-09 11:48:36,070::__init__::225::IOProcess::(_processLogs) (8956) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:36,070::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:36,070::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:36,070::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:36,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:36,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) (8957) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) (8957) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) (8957) Building response >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) (8957) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:48:36,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) (8958) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) (8958) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) (8958) Building response >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) (8958) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:36,072::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:36,073::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:36,129::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:36,130::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4036::DEBUG::2014-09-09 11:48:36,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e09beba-5b8f-49ea-836d-73c9dad43a96`::moving from state init -> state preparing >Thread-4036::INFO::2014-09-09 11:48:36,131::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4036::INFO::2014-09-09 11:48:36,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0189605', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000908619', 'lastCheck': '0.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878544', 'lastCheck': '1.9', 'valid': True}} >Thread-4036::DEBUG::2014-09-09 11:48:36,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e09beba-5b8f-49ea-836d-73c9dad43a96`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0189605', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000908619', 'lastCheck': '0.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878544', 'lastCheck': '1.9', 'valid': True}} >Thread-4036::DEBUG::2014-09-09 11:48:36,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e09beba-5b8f-49ea-836d-73c9dad43a96`::moving from state preparing -> state finished >Thread-4036::DEBUG::2014-09-09 11:48:36,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4036::DEBUG::2014-09-09 11:48:36,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4036::DEBUG::2014-09-09 11:48:36,132::task::993::Storage.TaskManager.Task::(_decref) Task=`5e09beba-5b8f-49ea-836d-73c9dad43a96`::ref 0 aborting False >Thread-4036::DEBUG::2014-09-09 11:48:36,132::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:36,138::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:36,139::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4037::DEBUG::2014-09-09 11:48:36,140::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:37,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:37,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897227 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:48:39,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:39,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900427 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:39,601::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:39,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:39,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:39,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:39,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:39,602::__init__::225::IOProcess::(_processLogs) (8959) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:39,602::__init__::225::IOProcess::(_processLogs) (8959) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:39,603::__init__::225::IOProcess::(_processLogs) (8959) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:39,603::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:48:39,604::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:48:39,611::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104821 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:39,611::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:39,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:39,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:39,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:39,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:39,612::__init__::225::IOProcess::(_processLogs) (8960) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:39,612::__init__::225::IOProcess::(_processLogs) (8960) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:39,612::__init__::225::IOProcess::(_processLogs) (8960) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:39,612::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:40,821::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:40,822::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4038::DEBUG::2014-09-09 11:48:40,823::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:41,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:41,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896077 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:48:43,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:43,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897296 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:43,893::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4039::DEBUG::2014-09-09 11:48:43,893::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:48:43,893::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4039::DEBUG::2014-09-09 11:48:43,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbc06fd7-714c-49c3-aee3-051ec4130d28`::moving from state init -> state preparing >Thread-4039::INFO::2014-09-09 11:48:43,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4039::INFO::2014-09-09 11:48:43,895::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4039::DEBUG::2014-09-09 11:48:43,895::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbc06fd7-714c-49c3-aee3-051ec4130d28`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4039::DEBUG::2014-09-09 11:48:43,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbc06fd7-714c-49c3-aee3-051ec4130d28`::moving from state preparing -> state finished >Thread-4039::DEBUG::2014-09-09 11:48:43,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4039::DEBUG::2014-09-09 11:48:43,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4039::DEBUG::2014-09-09 11:48:43,895::task::993::Storage.TaskManager.Task::(_decref) Task=`dbc06fd7-714c-49c3-aee3-051ec4130d28`::ref 0 aborting False >Thread-4039::DEBUG::2014-09-09 11:48:43,895::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4039::DEBUG::2014-09-09 11:48:43,896::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:43,943::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:43,944::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4040::DEBUG::2014-09-09 11:48:43,945::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:43,979::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:43,979::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4041::DEBUG::2014-09-09 11:48:43,979::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4041::DEBUG::2014-09-09 11:48:43,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`54c04b98-5cba-4ec8-ae2f-5d9b33bbc4a1`::moving from state init -> state preparing >Thread-4041::INFO::2014-09-09 11:48:43,980::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4041::DEBUG::2014-09-09 11:48:43,980::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7cef293a-555d-48ac-bf59-de2197f2077b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4041::DEBUG::2014-09-09 11:48:43,980::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4041::DEBUG::2014-09-09 11:48:43,981::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4041::DEBUG::2014-09-09 11:48:43,981::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7cef293a-555d-48ac-bf59-de2197f2077b`::Granted request >Thread-4041::DEBUG::2014-09-09 11:48:43,982::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`54c04b98-5cba-4ec8-ae2f-5d9b33bbc4a1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4041::DEBUG::2014-09-09 11:48:43,982::task::993::Storage.TaskManager.Task::(_decref) Task=`54c04b98-5cba-4ec8-ae2f-5d9b33bbc4a1`::ref 1 aborting False >Thread-4041::INFO::2014-09-09 11:48:43,983::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283086159872', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283279097856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283615690752', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4041::DEBUG::2014-09-09 11:48:43,983::task::1191::Storage.TaskManager.Task::(prepare) Task=`54c04b98-5cba-4ec8-ae2f-5d9b33bbc4a1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283086159872', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283279097856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283615690752', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4041::DEBUG::2014-09-09 11:48:43,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`54c04b98-5cba-4ec8-ae2f-5d9b33bbc4a1`::moving from state preparing -> state finished >Thread-4041::DEBUG::2014-09-09 11:48:43,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4041::DEBUG::2014-09-09 11:48:43,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4041::DEBUG::2014-09-09 11:48:43,984::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4041::DEBUG::2014-09-09 11:48:43,984::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4041::DEBUG::2014-09-09 11:48:43,984::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4041::DEBUG::2014-09-09 11:48:43,984::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4041::DEBUG::2014-09-09 11:48:43,984::task::993::Storage.TaskManager.Task::(_decref) Task=`54c04b98-5cba-4ec8-ae2f-5d9b33bbc4a1`::ref 0 aborting False >Thread-4041::DEBUG::2014-09-09 11:48:43,984::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283086159872', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283279097856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283615690752', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4041::DEBUG::2014-09-09 11:48:43,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:44,250::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:44,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:44,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:44,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:44,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:44,250::__init__::225::IOProcess::(_processLogs) (8961) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:44,251::__init__::225::IOProcess::(_processLogs) (8961) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:44,251::__init__::225::IOProcess::(_processLogs) (8961) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:44,251::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:48:44,252::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:48:44,258::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000858953 s, 413 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:44,258::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:44,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) (8962) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) (8962) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) DEBUG|(8962) Building response >Thread-19::DEBUG::2014-09-09 11:48:44,259::__init__::225::IOProcess::(_processLogs) (8962) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:44,260::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:44,260::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:48:45,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:45,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897435 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:46,072::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) (8963) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) (8963) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:46,073::__init__::225::IOProcess::(_processLogs) DEBUG|(8963) Building response >Thread-19::DEBUG::2014-09-09 11:48:46,074::__init__::225::IOProcess::(_processLogs) (8963) Queuing response >Thread-24::DEBUG::2014-09-09 11:48:46,074::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:46,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:46,079::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:48:46,081::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000926859 s, 591 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:46,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:46,083::__init__::225::IOProcess::(_processLogs) (8964) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:46,083::__init__::225::IOProcess::(_processLogs) (8964) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:46,083::__init__::225::IOProcess::(_processLogs) DEBUG|(8964) Building response >Thread-19::DEBUG::2014-09-09 11:48:46,083::__init__::225::IOProcess::(_processLogs) (8964) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:46,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:46,083::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) (8965) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:46,084::__init__::225::IOProcess::(_processLogs) (8965) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) DEBUG|(8965) Building response >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) (8965) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:46,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) (8966) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) (8966) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) DEBUG|(8966) Building response >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) (8966) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:46,086::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:46,087::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:46,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:46,087::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:48:46,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:46,087::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) (8967) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) (8967) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) (8967) Building response >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) (8967) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:46,088::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:46,951::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:46,951::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4042::DEBUG::2014-09-09 11:48:46,952::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:47,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:47,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896744 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:49,614::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:49,614::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:49,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:49,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:49,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:49,617::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:48:49,618::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:49,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:49,623::__init__::225::IOProcess::(_processLogs) (8968) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:49,624::__init__::225::IOProcess::(_processLogs) (8968) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:49,624::__init__::225::IOProcess::(_processLogs) (8968) Building response >Thread-19::DEBUG::2014-09-09 11:48:49,625::__init__::225::IOProcess::(_processLogs) (8968) Queuing response >Thread-23::DEBUG::2014-09-09 11:48:49,626::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109793 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:49,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:49,627::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:49,628::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:49,628::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:49,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:49,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:49,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:49,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:49,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:49,631::__init__::225::IOProcess::(_processLogs) (8969) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:49,632::__init__::225::IOProcess::(_processLogs) (8969) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:49,633::__init__::225::IOProcess::(_processLogs) (8969) Building response >Thread-19::DEBUG::2014-09-09 11:48:49,633::__init__::225::IOProcess::(_processLogs) (8969) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:49,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:49,634::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:49,958::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:49,959::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4043::DEBUG::2014-09-09 11:48:49,962::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:49,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:50,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097488 s, 10.5 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:48:52,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:52,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896972 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:52,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:52,971::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4044::DEBUG::2014-09-09 11:48:52,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbd243fb-e8d7-4851-ba9d-c0eb4e6345ad`::moving from state init -> state preparing >Thread-4044::INFO::2014-09-09 11:48:52,972::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4044::INFO::2014-09-09 11:48:52,972::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109793', 'lastCheck': '3.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926859', 'lastCheck': '6.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000858953', 'lastCheck': '8.7', 'valid': True}} >Thread-4044::DEBUG::2014-09-09 11:48:52,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbd243fb-e8d7-4851-ba9d-c0eb4e6345ad`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109793', 'lastCheck': '3.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926859', 'lastCheck': '6.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000858953', 'lastCheck': '8.7', 'valid': True}} >Thread-4044::DEBUG::2014-09-09 11:48:52,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbd243fb-e8d7-4851-ba9d-c0eb4e6345ad`::moving from state preparing -> state finished >Thread-4044::DEBUG::2014-09-09 11:48:52,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4044::DEBUG::2014-09-09 11:48:52,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4044::DEBUG::2014-09-09 11:48:52,973::task::993::Storage.TaskManager.Task::(_decref) Task=`fbd243fb-e8d7-4851-ba9d-c0eb4e6345ad`::ref 0 aborting False >Thread-4044::DEBUG::2014-09-09 11:48:52,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:52,983::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:52,984::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4045::DEBUG::2014-09-09 11:48:52,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) (8970) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:54,261::__init__::225::IOProcess::(_processLogs) (8970) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:54,262::__init__::225::IOProcess::(_processLogs) (8970) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:54,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:48:54,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:54,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:48:54,271::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00171127 s, 207 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:54,271::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:48:54,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) (8971) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) (8971) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) DEBUG|(8971) Building response >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) (8971) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:54,272::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:54,273::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:54,325::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4046::DEBUG::2014-09-09 11:48:54,326::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:48:54,327::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4046::DEBUG::2014-09-09 11:48:54,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`4612ba6e-d573-411b-9a97-07e2a28c84e4`::moving from state init -> state preparing >Thread-4046::INFO::2014-09-09 11:48:54,328::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4046::INFO::2014-09-09 11:48:54,328::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4046::DEBUG::2014-09-09 11:48:54,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`4612ba6e-d573-411b-9a97-07e2a28c84e4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4046::DEBUG::2014-09-09 11:48:54,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`4612ba6e-d573-411b-9a97-07e2a28c84e4`::moving from state preparing -> state finished >Thread-4046::DEBUG::2014-09-09 11:48:54,328::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4046::DEBUG::2014-09-09 11:48:54,329::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4046::DEBUG::2014-09-09 11:48:54,329::task::993::Storage.TaskManager.Task::(_decref) Task=`4612ba6e-d573-411b-9a97-07e2a28c84e4`::ref 0 aborting False >Thread-4046::DEBUG::2014-09-09 11:48:54,329::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4046::DEBUG::2014-09-09 11:48:54,329::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:48:54,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897895 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:54,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:54,417::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4047::DEBUG::2014-09-09 11:48:54,417::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4047::DEBUG::2014-09-09 11:48:54,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcf83305-8f04-4a94-bdc0-40a036fea2d2`::moving from state init -> state preparing >Thread-4047::INFO::2014-09-09 11:48:54,418::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4047::DEBUG::2014-09-09 11:48:54,418::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3a4fcb71-6b30-41f5-80ae-de89313f6b61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4047::DEBUG::2014-09-09 11:48:54,418::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4047::DEBUG::2014-09-09 11:48:54,418::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4047::DEBUG::2014-09-09 11:48:54,418::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3a4fcb71-6b30-41f5-80ae-de89313f6b61`::Granted request >Thread-4047::DEBUG::2014-09-09 11:48:54,419::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fcf83305-8f04-4a94-bdc0-40a036fea2d2`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4047::DEBUG::2014-09-09 11:48:54,419::task::993::Storage.TaskManager.Task::(_decref) Task=`fcf83305-8f04-4a94-bdc0-40a036fea2d2`::ref 1 aborting False >Thread-4047::INFO::2014-09-09 11:48:54,421::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283606253568', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282939359232', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283606253568', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4047::DEBUG::2014-09-09 11:48:54,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcf83305-8f04-4a94-bdc0-40a036fea2d2`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283606253568', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282939359232', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283606253568', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4047::DEBUG::2014-09-09 11:48:54,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcf83305-8f04-4a94-bdc0-40a036fea2d2`::moving from state preparing -> state finished >Thread-4047::DEBUG::2014-09-09 11:48:54,421::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4047::DEBUG::2014-09-09 11:48:54,421::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4047::DEBUG::2014-09-09 11:48:54,421::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4047::DEBUG::2014-09-09 11:48:54,422::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4047::DEBUG::2014-09-09 11:48:54,422::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4047::DEBUG::2014-09-09 11:48:54,422::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4047::DEBUG::2014-09-09 11:48:54,422::task::993::Storage.TaskManager.Task::(_decref) Task=`fcf83305-8f04-4a94-bdc0-40a036fea2d2`::ref 0 aborting False >Thread-4047::DEBUG::2014-09-09 11:48:54,422::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283606253568', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282939359232', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283606253568', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4047::DEBUG::2014-09-09 11:48:54,422::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:56,055::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:56,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4048::DEBUG::2014-09-09 11:48:56,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:56,088::__init__::225::IOProcess::(_processLogs) (8972) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:56,089::__init__::225::IOProcess::(_processLogs) (8972) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:56,089::__init__::225::IOProcess::(_processLogs) DEBUG|(8972) Building response >Thread-24::DEBUG::2014-09-09 11:48:56,089::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:56,089::__init__::225::IOProcess::(_processLogs) (8972) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:56,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:56,095::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:48:56,097::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000909761 s, 602 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:56,097::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:56,097::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:48:56,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:56,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) (8973) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) (8973) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) DEBUG|(8973) Building response >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) (8973) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:56,098::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:56,099::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:48:56,099::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:56,099::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:48:56,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) (8974) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) (8974) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) (8974) Building response >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) (8974) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:56,100::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:56,101::__init__::225::IOProcess::(_processLogs) (8975) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) (8975) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) (8975) Building response >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) (8975) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:56,102::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) (8976) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) (8976) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) (8976) Building response >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) (8976) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:56,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:56,104::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:48:56,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:56,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898146 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:48:58,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:48:58,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898356 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:48:59,062::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:48:59,062::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4049::DEBUG::2014-09-09 11:48:59,063::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:48:59,633::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:59,633::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:59,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) (8977) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) (8977) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:59,634::__init__::225::IOProcess::(_processLogs) DEBUG|(8977) Building response >Thread-19::DEBUG::2014-09-09 11:48:59,635::__init__::225::IOProcess::(_processLogs) (8977) Queuing response >Thread-23::DEBUG::2014-09-09 11:48:59,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:48:59,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:48:59,640::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:48:59,643::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111094 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:48:59,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:48:59,643::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:48:59,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:48:59,643::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) (8978) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) (8978) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) DEBUG|(8978) Building response >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) (8978) Queuing response >Thread-19::DEBUG::2014-09-09 11:48:59,644::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:48:59,645::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:00,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:00,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898298 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:02,070::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:02,071::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4050::DEBUG::2014-09-09 11:49:02,071::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:02,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:02,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896891 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:04,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:04,275::__init__::225::IOProcess::(_processLogs) (8979) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:04,275::__init__::225::IOProcess::(_processLogs) (8979) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:04,275::__init__::225::IOProcess::(_processLogs) DEBUG|(8979) Building response >Thread-3443::DEBUG::2014-09-09 11:49:04,275::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:49:04,276::__init__::225::IOProcess::(_processLogs) (8979) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:04,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:04,281::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:49:04,283::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000977676 s, 363 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:04,283::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:04,283::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:04,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) (8980) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) (8980) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) DEBUG|(8980) Building response >Thread-19::DEBUG::2014-09-09 11:49:04,284::__init__::225::IOProcess::(_processLogs) (8980) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:04,285::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:04,285::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:04,535::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:04,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4051::DEBUG::2014-09-09 11:49:04,536::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4051::DEBUG::2014-09-09 11:49:04,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`090d20f6-6486-4ec1-8a19-1c3bf6968943`::moving from state init -> state preparing >Thread-4051::INFO::2014-09-09 11:49:04,537::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4051::INFO::2014-09-09 11:49:04,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4051::DEBUG::2014-09-09 11:49:04,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`090d20f6-6486-4ec1-8a19-1c3bf6968943`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4051::DEBUG::2014-09-09 11:49:04,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`090d20f6-6486-4ec1-8a19-1c3bf6968943`::moving from state preparing -> state finished >Thread-4051::DEBUG::2014-09-09 11:49:04,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4051::DEBUG::2014-09-09 11:49:04,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4051::DEBUG::2014-09-09 11:49:04,537::task::993::Storage.TaskManager.Task::(_decref) Task=`090d20f6-6486-4ec1-8a19-1c3bf6968943`::ref 0 aborting False >Thread-4051::DEBUG::2014-09-09 11:49:04,537::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4051::DEBUG::2014-09-09 11:49:04,538::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:04,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:04,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896402 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:05,078::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:05,078::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4052::DEBUG::2014-09-09 11:49:05,079::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:05,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:05,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4053::DEBUG::2014-09-09 11:49:05,085::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4053::DEBUG::2014-09-09 11:49:05,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`94a62413-c414-4554-a5c5-0af242c597dc`::moving from state init -> state preparing >Thread-4053::INFO::2014-09-09 11:49:05,086::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4053::DEBUG::2014-09-09 11:49:05,086::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0d99b376-9c1c-47ae-9591-dd79cec0e7b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4053::DEBUG::2014-09-09 11:49:05,086::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4053::DEBUG::2014-09-09 11:49:05,086::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4053::DEBUG::2014-09-09 11:49:05,087::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0d99b376-9c1c-47ae-9591-dd79cec0e7b1`::Granted request >Thread-4053::DEBUG::2014-09-09 11:49:05,088::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94a62413-c414-4554-a5c5-0af242c597dc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4053::DEBUG::2014-09-09 11:49:05,088::task::993::Storage.TaskManager.Task::(_decref) Task=`94a62413-c414-4554-a5c5-0af242c597dc`::ref 1 aborting False >Thread-4053::INFO::2014-09-09 11:49:05,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283107131392', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283399684096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282919436288', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4053::DEBUG::2014-09-09 11:49:05,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`94a62413-c414-4554-a5c5-0af242c597dc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283107131392', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283399684096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282919436288', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4053::DEBUG::2014-09-09 11:49:05,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`94a62413-c414-4554-a5c5-0af242c597dc`::moving from state preparing -> state finished >Thread-4053::DEBUG::2014-09-09 11:49:05,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4053::DEBUG::2014-09-09 11:49:05,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4053::DEBUG::2014-09-09 11:49:05,090::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4053::DEBUG::2014-09-09 11:49:05,090::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4053::DEBUG::2014-09-09 11:49:05,090::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4053::DEBUG::2014-09-09 11:49:05,090::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4053::DEBUG::2014-09-09 11:49:05,090::task::993::Storage.TaskManager.Task::(_decref) Task=`94a62413-c414-4554-a5c5-0af242c597dc`::ref 0 aborting False >Thread-4053::DEBUG::2014-09-09 11:49:05,090::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283107131392', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283399684096', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282919436288', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4053::DEBUG::2014-09-09 11:49:05,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:06,103::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:06,103::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) (8981) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) (8981) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:06,104::__init__::225::IOProcess::(_processLogs) DEBUG|(8981) Building response >Thread-19::DEBUG::2014-09-09 11:49:06,105::__init__::225::IOProcess::(_processLogs) (8981) Queuing response >Thread-24::DEBUG::2014-09-09 11:49:06,105::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:49:06,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:06,110::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:49:06,112::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000924778 s, 593 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:06,113::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:06,113::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:06,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:06,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:06,113::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:06,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:06,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:06,114::__init__::225::IOProcess::(_processLogs) (8982) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:06,114::__init__::225::IOProcess::(_processLogs) (8982) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:06,114::__init__::225::IOProcess::(_processLogs) DEBUG|(8982) Building response >Thread-19::DEBUG::2014-09-09 11:49:06,114::__init__::225::IOProcess::(_processLogs) (8982) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:06,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:06,115::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:49:06,115::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:06,115::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:49:06,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:06,115::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) (8983) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) (8983) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) (8983) Building response >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) (8983) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:06,116::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) (8984) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) (8984) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) (8984) Building response >Thread-19::DEBUG::2014-09-09 11:49:06,117::__init__::225::IOProcess::(_processLogs) (8984) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) (8985) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:06,118::__init__::225::IOProcess::(_processLogs) (8985) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:06,119::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8985) Building response >Thread-19::DEBUG::2014-09-09 11:49:06,119::__init__::225::IOProcess::(_processLogs) (8985) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:06,119::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:06,119::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:49:06,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:06,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899269 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:08,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:08,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4054::DEBUG::2014-09-09 11:49:08,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b8c64fa-3abd-43a0-a7e6-28ccb3670ef4`::moving from state init -> state preparing >Thread-4054::INFO::2014-09-09 11:49:08,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4054::INFO::2014-09-09 11:49:08,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111094', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000924778', 'lastCheck': '2.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000977676', 'lastCheck': '3.8', 'valid': True}} >Thread-4054::DEBUG::2014-09-09 11:49:08,087::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b8c64fa-3abd-43a0-a7e6-28ccb3670ef4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111094', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000924778', 'lastCheck': '2.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000977676', 'lastCheck': '3.8', 'valid': True}} >Thread-4054::DEBUG::2014-09-09 11:49:08,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b8c64fa-3abd-43a0-a7e6-28ccb3670ef4`::moving from state preparing -> state finished >Thread-4054::DEBUG::2014-09-09 11:49:08,087::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4054::DEBUG::2014-09-09 11:49:08,087::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4054::DEBUG::2014-09-09 11:49:08,087::task::993::Storage.TaskManager.Task::(_decref) Task=`8b8c64fa-3abd-43a0-a7e6-28ccb3670ef4`::ref 0 aborting False >Thread-4054::DEBUG::2014-09-09 11:49:08,088::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:08,097::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:08,098::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4055::DEBUG::2014-09-09 11:49:08,099::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:08,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:09,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897845 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:09,645::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:09,646::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:09,646::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:09,646::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:09,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:09,646::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:09,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:09,647::__init__::225::IOProcess::(_processLogs) (8986) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:09,647::__init__::225::IOProcess::(_processLogs) (8986) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:09,647::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8986) Building response >Thread-19::DEBUG::2014-09-09 11:49:09,647::__init__::225::IOProcess::(_processLogs) (8986) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:09,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:09,647::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:49:09,648::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:49:09,655::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107245 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) (8987) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) (8987) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:09,656::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8987) Building response >Thread-19::DEBUG::2014-09-09 11:49:09,657::__init__::225::IOProcess::(_processLogs) (8987) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:09,657::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:09,657::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:11,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:11,173::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:11,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4056::DEBUG::2014-09-09 11:49:11,175::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:11,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899785 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:49:13,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:13,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897168 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:14,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:14,184::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4057::DEBUG::2014-09-09 11:49:14,185::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) (8988) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) (8988) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8988) Building response >Thread-19::DEBUG::2014-09-09 11:49:14,286::__init__::225::IOProcess::(_processLogs) (8988) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:14,287::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:14,287::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:49:14,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:49:14,295::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00097161 s, 365 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:14,295::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:14,295::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:14,295::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) (8989) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) (8989) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8989) Building response >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) (8989) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:14,296::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:14,297::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:15,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:15,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897352 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:15,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:15,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4058::DEBUG::2014-09-09 11:49:15,722::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4058::DEBUG::2014-09-09 11:49:15,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`0208c083-e6b6-4bc3-bd39-1a7025050342`::moving from state init -> state preparing >Thread-4058::INFO::2014-09-09 11:49:15,723::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4058::INFO::2014-09-09 11:49:15,723::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4058::DEBUG::2014-09-09 11:49:15,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`0208c083-e6b6-4bc3-bd39-1a7025050342`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4058::DEBUG::2014-09-09 11:49:15,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`0208c083-e6b6-4bc3-bd39-1a7025050342`::moving from state preparing -> state finished >Thread-4058::DEBUG::2014-09-09 11:49:15,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4058::DEBUG::2014-09-09 11:49:15,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4058::DEBUG::2014-09-09 11:49:15,724::task::993::Storage.TaskManager.Task::(_decref) Task=`0208c083-e6b6-4bc3-bd39-1a7025050342`::ref 0 aborting False >Thread-4058::DEBUG::2014-09-09 11:49:15,724::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4058::DEBUG::2014-09-09 11:49:15,724::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:15,850::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:15,851::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4059::DEBUG::2014-09-09 11:49:15,851::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4059::DEBUG::2014-09-09 11:49:15,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a058f91-2759-4836-96d5-5890924db8d4`::moving from state init -> state preparing >Thread-4059::INFO::2014-09-09 11:49:15,851::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4059::DEBUG::2014-09-09 11:49:15,852::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6d2cc6f0-17cc-4df1-b084-4227be77d67c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4059::DEBUG::2014-09-09 11:49:15,852::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4059::DEBUG::2014-09-09 11:49:15,852::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4059::DEBUG::2014-09-09 11:49:15,852::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6d2cc6f0-17cc-4df1-b084-4227be77d67c`::Granted request >Thread-4059::DEBUG::2014-09-09 11:49:15,852::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6a058f91-2759-4836-96d5-5890924db8d4`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4059::DEBUG::2014-09-09 11:49:15,852::task::993::Storage.TaskManager.Task::(_decref) Task=`6a058f91-2759-4836-96d5-5890924db8d4`::ref 1 aborting False >Thread-4059::INFO::2014-09-09 11:49:15,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283602059264', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282919436288', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283551727616', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4059::DEBUG::2014-09-09 11:49:15,854::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a058f91-2759-4836-96d5-5890924db8d4`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283602059264', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282919436288', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283551727616', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4059::DEBUG::2014-09-09 11:49:15,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a058f91-2759-4836-96d5-5890924db8d4`::moving from state preparing -> state finished >Thread-4059::DEBUG::2014-09-09 11:49:15,854::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4059::DEBUG::2014-09-09 11:49:15,854::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4059::DEBUG::2014-09-09 11:49:15,854::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4059::DEBUG::2014-09-09 11:49:15,855::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4059::DEBUG::2014-09-09 11:49:15,855::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4059::DEBUG::2014-09-09 11:49:15,855::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4059::DEBUG::2014-09-09 11:49:15,855::task::993::Storage.TaskManager.Task::(_decref) Task=`6a058f91-2759-4836-96d5-5890924db8d4`::ref 0 aborting False >Thread-4059::DEBUG::2014-09-09 11:49:15,855::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283602059264', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282919436288', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283551727616', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4059::DEBUG::2014-09-09 11:49:15,855::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) (8990) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) (8990) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:16,120::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8990) Building response >Thread-19::DEBUG::2014-09-09 11:49:16,121::__init__::225::IOProcess::(_processLogs) (8990) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:16,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:16,121::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:49:16,121::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:49:16,129::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000915661 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) (8991) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) (8991) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:16,130::__init__::225::IOProcess::(_processLogs) (8982) Queuing responseDEBUG|(8991) Building response >Thread-19::DEBUG::2014-09-09 11:49:16,131::__init__::225::IOProcess::(_processLogs) (8991) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:16,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:16,131::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:49:16,131::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:16,132::__init__::225::IOProcess::(_processLogs) (8992) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) (8992) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) (8992) Building response >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) (8992) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:16,133::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) (8993) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) (8993) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) (8993) Building response >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) (8993) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:16,134::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:16,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:16,136::__init__::225::IOProcess::(_processLogs) (8994) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:16,136::__init__::225::IOProcess::(_processLogs) (8994) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:16,136::__init__::225::IOProcess::(_processLogs) (8994) Building response >Thread-19::DEBUG::2014-09-09 11:49:16,136::__init__::225::IOProcess::(_processLogs) (8994) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:16,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:16,136::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:17,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:17,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4060::DEBUG::2014-09-09 11:49:17,194::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:17,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:17,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896853 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:49:19,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:19,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0952002 s, 10.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:19,659::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:19,660::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:19,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:19,661::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:19,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:19,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:19,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:19,664::__init__::225::IOProcess::(_processLogs) (8995) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:19,665::__init__::225::IOProcess::(_processLogs) (8995) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:19,667::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(8995) Building response >Thread-23::DEBUG::2014-09-09 11:49:19,668::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:49:19,668::__init__::225::IOProcess::(_processLogs) (8995) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:19,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:19,674::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:49:19,676::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104844 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:19,677::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:19,678::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:19,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:19,680::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:19,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:19,682::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:19,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:19,683::__init__::225::IOProcess::(_processLogs) (8996) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:19,684::__init__::225::IOProcess::(_processLogs) (8996) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:19,685::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(8996) Building response >Thread-19::DEBUG::2014-09-09 11:49:19,687::__init__::225::IOProcess::(_processLogs) (8996) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:19,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:19,688::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:20,202::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:20,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4061::DEBUG::2014-09-09 11:49:20,208::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:21,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:21,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897916 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:23,215::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:23,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4062::DEBUG::2014-09-09 11:49:23,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2d1dc51-a534-4279-8abf-0c5b004be696`::moving from state init -> state preparing >Thread-4062::INFO::2014-09-09 11:49:23,217::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4062::INFO::2014-09-09 11:49:23,217::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104844', 'lastCheck': '3.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000915661', 'lastCheck': '7.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00097161', 'lastCheck': '8.9', 'valid': True}} >Thread-4062::DEBUG::2014-09-09 11:49:23,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2d1dc51-a534-4279-8abf-0c5b004be696`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104844', 'lastCheck': '3.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000915661', 'lastCheck': '7.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00097161', 'lastCheck': '8.9', 'valid': True}} >Thread-4062::DEBUG::2014-09-09 11:49:23,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2d1dc51-a534-4279-8abf-0c5b004be696`::moving from state preparing -> state finished >Thread-4062::DEBUG::2014-09-09 11:49:23,218::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4062::DEBUG::2014-09-09 11:49:23,218::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4062::DEBUG::2014-09-09 11:49:23,218::task::993::Storage.TaskManager.Task::(_decref) Task=`f2d1dc51-a534-4279-8abf-0c5b004be696`::ref 0 aborting False >Thread-4062::DEBUG::2014-09-09 11:49:23,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:23,225::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:23,226::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4063::DEBUG::2014-09-09 11:49:23,227::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:23,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:23,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898883 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) (8997) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:24,298::__init__::225::IOProcess::(_processLogs) (8997) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:24,299::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(8997) Building response >Thread-19::DEBUG::2014-09-09 11:49:24,299::__init__::225::IOProcess::(_processLogs) (8997) Queuing response >Thread-3443::DEBUG::2014-09-09 11:49:24,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:49:24,300::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:24,304::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:49:24,306::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000915166 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:24,306::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:24,306::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) (8998) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) (8998) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(8998) Building response >Thread-19::DEBUG::2014-09-09 11:49:24,307::__init__::225::IOProcess::(_processLogs) (8998) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:24,308::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:24,308::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:25,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:26,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896514 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) (8999) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:26,136::__init__::225::IOProcess::(_processLogs) (8999) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:26,137::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(8999) Building response >Thread-19::DEBUG::2014-09-09 11:49:26,137::__init__::225::IOProcess::(_processLogs) (8999) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:26,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:26,137::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:49:26,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:49:26,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00089491 s, 612 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:26,145::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:26,145::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:26,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:26,145::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:26,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:26,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) (9000) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) (9000) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9000) Building response >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) (9000) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:26,146::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:49:26,147::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:26,147::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:49:26,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:26,147::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) (9001) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) (9001) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) (9001) Building response >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) (9001) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:26,148::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) (9002) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) (9002) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:26,149::__init__::225::IOProcess::(_processLogs) (9002) Building response >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) (9002) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:26,150::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) (9003) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) (9003) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) (9003) Building response >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) (9003) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:26,151::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:26,322::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4064::DEBUG::2014-09-09 11:49:26,323::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:49:26,322::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4064::DEBUG::2014-09-09 11:49:26,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e5043e-40d1-478d-bea4-bcf07d2e9c85`::moving from state init -> state preparing >Thread-4064::INFO::2014-09-09 11:49:26,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4064::INFO::2014-09-09 11:49:26,324::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4064::DEBUG::2014-09-09 11:49:26,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`80e5043e-40d1-478d-bea4-bcf07d2e9c85`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4064::DEBUG::2014-09-09 11:49:26,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e5043e-40d1-478d-bea4-bcf07d2e9c85`::moving from state preparing -> state finished >Thread-4064::DEBUG::2014-09-09 11:49:26,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4064::DEBUG::2014-09-09 11:49:26,324::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4064::DEBUG::2014-09-09 11:49:26,324::task::993::Storage.TaskManager.Task::(_decref) Task=`80e5043e-40d1-478d-bea4-bcf07d2e9c85`::ref 0 aborting False >Thread-4064::DEBUG::2014-09-09 11:49:26,324::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4064::DEBUG::2014-09-09 11:49:26,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:26,451::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:26,451::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4065::DEBUG::2014-09-09 11:49:26,451::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4065::DEBUG::2014-09-09 11:49:26,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75b19c4-b0cd-48a0-b596-c1a0a4a57acc`::moving from state init -> state preparing >Thread-4065::INFO::2014-09-09 11:49:26,452::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4065::DEBUG::2014-09-09 11:49:26,453::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0eac70c4-b870-4238-9685-b09d5467f44c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4065::DEBUG::2014-09-09 11:49:26,453::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4065::DEBUG::2014-09-09 11:49:26,453::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4065::DEBUG::2014-09-09 11:49:26,453::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0eac70c4-b870-4238-9685-b09d5467f44c`::Granted request >Thread-4065::DEBUG::2014-09-09 11:49:26,453::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f75b19c4-b0cd-48a0-b596-c1a0a4a57acc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4065::DEBUG::2014-09-09 11:49:26,453::task::993::Storage.TaskManager.Task::(_decref) Task=`f75b19c4-b0cd-48a0-b596-c1a0a4a57acc`::ref 1 aborting False >Thread-4065::INFO::2014-09-09 11:49:26,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283042119680', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282944602112', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282971865088', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4065::DEBUG::2014-09-09 11:49:26,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`f75b19c4-b0cd-48a0-b596-c1a0a4a57acc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283042119680', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282944602112', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282971865088', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4065::DEBUG::2014-09-09 11:49:26,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75b19c4-b0cd-48a0-b596-c1a0a4a57acc`::moving from state preparing -> state finished >Thread-4065::DEBUG::2014-09-09 11:49:26,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4065::DEBUG::2014-09-09 11:49:26,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4065::DEBUG::2014-09-09 11:49:26,455::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4065::DEBUG::2014-09-09 11:49:26,455::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4065::DEBUG::2014-09-09 11:49:26,455::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4065::DEBUG::2014-09-09 11:49:26,456::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4065::DEBUG::2014-09-09 11:49:26,456::task::993::Storage.TaskManager.Task::(_decref) Task=`f75b19c4-b0cd-48a0-b596-c1a0a4a57acc`::ref 0 aborting False >Thread-4065::DEBUG::2014-09-09 11:49:26,456::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283042119680', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282944602112', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282971865088', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4065::DEBUG::2014-09-09 11:49:26,456::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:26,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:26,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4066::DEBUG::2014-09-09 11:49:26,567::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:28,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:28,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896746 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:29,575::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:29,575::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4067::DEBUG::2014-09-09 11:49:29,576::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:29,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:29,688::__init__::225::IOProcess::(_processLogs) (9004) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:29,688::__init__::225::IOProcess::(_processLogs) (9004) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:29,688::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9004) Building response >Thread-19::DEBUG::2014-09-09 11:49:29,688::__init__::225::IOProcess::(_processLogs) (9004) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:29,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:29,688::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:49:29,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:49:29,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114146 s, 984 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:29,695::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:29,695::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:29,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) (9005) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) (9005) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:29,696::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9005) Building response >Thread-19::DEBUG::2014-09-09 11:49:29,697::__init__::225::IOProcess::(_processLogs) (9005) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:29,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:29,697::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:30,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:30,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090188 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:49:32,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:32,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896755 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:32,582::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:32,582::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4068::DEBUG::2014-09-09 11:49:32,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) (9006) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:34,309::__init__::225::IOProcess::(_processLogs) (9006) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:34,311::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9006) Building response >Thread-19::DEBUG::2014-09-09 11:49:34,311::__init__::225::IOProcess::(_processLogs) (9006) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:34,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:34,311::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:49:34,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:49:34,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000980909 s, 362 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:34,320::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:34,320::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:34,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:34,320::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) (9007) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) (9007) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9007) Building response >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) (9007) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:34,321::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:34,322::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:34,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:34,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897789 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:35,589::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:35,590::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4069::DEBUG::2014-09-09 11:49:35,591::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:36,151::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:36,151::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:36,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:36,151::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:36,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:36,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:36,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:36,152::__init__::225::IOProcess::(_processLogs) (9008) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:36,152::__init__::225::IOProcess::(_processLogs) (9008) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:36,152::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9008) Building response >Thread-24::DEBUG::2014-09-09 11:49:36,153::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:49:36,153::__init__::225::IOProcess::(_processLogs) (9008) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:36,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:36,158::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:49:36,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000925982 s, 592 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:36,160::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:36,160::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:36,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) (9009) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) (9009) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9009) Building response >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) (9009) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:36,161::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:49:36,162::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:36,162::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:49:36,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) (9010) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) (9010) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) (9010) Building response >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) (9010) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:36,163::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) (9011) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:36,164::__init__::225::IOProcess::(_processLogs) (9011) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) (9011) Building response >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) (9011) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:36,165::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) (9012) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) (9012) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) (9012) Building response >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) (9012) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:36,166::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:49:36,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:36,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905607 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:37,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4070::DEBUG::2014-09-09 11:49:37,225::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:49:37,225::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4070::DEBUG::2014-09-09 11:49:37,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`6aeff0d1-0b2b-4737-bd80-18aba27b8833`::moving from state init -> state preparing >Thread-4070::INFO::2014-09-09 11:49:37,226::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4070::INFO::2014-09-09 11:49:37,226::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4070::DEBUG::2014-09-09 11:49:37,226::task::1191::Storage.TaskManager.Task::(prepare) Task=`6aeff0d1-0b2b-4737-bd80-18aba27b8833`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4070::DEBUG::2014-09-09 11:49:37,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`6aeff0d1-0b2b-4737-bd80-18aba27b8833`::moving from state preparing -> state finished >Thread-4070::DEBUG::2014-09-09 11:49:37,227::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4070::DEBUG::2014-09-09 11:49:37,227::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4070::DEBUG::2014-09-09 11:49:37,227::task::993::Storage.TaskManager.Task::(_decref) Task=`6aeff0d1-0b2b-4737-bd80-18aba27b8833`::ref 0 aborting False >Thread-4070::DEBUG::2014-09-09 11:49:37,227::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4070::DEBUG::2014-09-09 11:49:37,227::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:37,258::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:37,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4071::DEBUG::2014-09-09 11:49:37,258::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4071::DEBUG::2014-09-09 11:49:37,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`be288e27-b5d5-40f6-b7bb-cb8ce9765d18`::moving from state init -> state preparing >Thread-4071::INFO::2014-09-09 11:49:37,259::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4071::DEBUG::2014-09-09 11:49:37,259::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b49db580-6a03-4b44-9d8e-ca56febb269a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4071::DEBUG::2014-09-09 11:49:37,259::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4071::DEBUG::2014-09-09 11:49:37,260::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4071::DEBUG::2014-09-09 11:49:37,260::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b49db580-6a03-4b44-9d8e-ca56febb269a`::Granted request >Thread-4071::DEBUG::2014-09-09 11:49:37,260::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`be288e27-b5d5-40f6-b7bb-cb8ce9765d18`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4071::DEBUG::2014-09-09 11:49:37,260::task::993::Storage.TaskManager.Task::(_decref) Task=`be288e27-b5d5-40f6-b7bb-cb8ce9765d18`::ref 1 aborting False >Thread-4071::INFO::2014-09-09 11:49:37,261::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282911047680', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283597864960', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283602059264', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4071::DEBUG::2014-09-09 11:49:37,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`be288e27-b5d5-40f6-b7bb-cb8ce9765d18`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282911047680', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283597864960', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283602059264', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4071::DEBUG::2014-09-09 11:49:37,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`be288e27-b5d5-40f6-b7bb-cb8ce9765d18`::moving from state preparing -> state finished >Thread-4071::DEBUG::2014-09-09 11:49:37,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4071::DEBUG::2014-09-09 11:49:37,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4071::DEBUG::2014-09-09 11:49:37,262::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4071::DEBUG::2014-09-09 11:49:37,262::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4071::DEBUG::2014-09-09 11:49:37,262::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4071::DEBUG::2014-09-09 11:49:37,262::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4071::DEBUG::2014-09-09 11:49:37,262::task::993::Storage.TaskManager.Task::(_decref) Task=`be288e27-b5d5-40f6-b7bb-cb8ce9765d18`::ref 0 aborting False >Thread-4071::DEBUG::2014-09-09 11:49:37,263::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282911047680', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283597864960', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283602059264', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4071::DEBUG::2014-09-09 11:49:37,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:38,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:38,607::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:38,609::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4072::DEBUG::2014-09-09 11:49:38,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f9dfb39-fa32-4fec-89ce-a6e59e8553ee`::moving from state init -> state preparing >Thread-4072::INFO::2014-09-09 11:49:38,614::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4072::INFO::2014-09-09 11:49:38,615::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114146', 'lastCheck': '8.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000925982', 'lastCheck': '2.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000980909', 'lastCheck': '4.3', 'valid': True}} >Thread-4072::DEBUG::2014-09-09 11:49:38,616::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f9dfb39-fa32-4fec-89ce-a6e59e8553ee`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114146', 'lastCheck': '8.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000925982', 'lastCheck': '2.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000980909', 'lastCheck': '4.3', 'valid': True}} >Thread-4072::DEBUG::2014-09-09 11:49:38,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f9dfb39-fa32-4fec-89ce-a6e59e8553ee`::moving from state preparing -> state finished >Thread-4072::DEBUG::2014-09-09 11:49:38,617::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4072::DEBUG::2014-09-09 11:49:38,617::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4072::DEBUG::2014-09-09 11:49:38,618::task::993::Storage.TaskManager.Task::(_decref) Task=`5f9dfb39-fa32-4fec-89ce-a6e59e8553ee`::ref 0 aborting False >Thread-4072::DEBUG::2014-09-09 11:49:38,621::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:38,640::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:38,641::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4073::DEBUG::2014-09-09 11:49:38,643::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:38,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0936807 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:39,697::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:39,697::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:39,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:39,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:39,698::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:39,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:39,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:39,698::__init__::225::IOProcess::(_processLogs) (9013) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:39,699::__init__::225::IOProcess::(_processLogs) (9013) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:39,699::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9013) Building response >Thread-19::DEBUG::2014-09-09 11:49:39,699::__init__::225::IOProcess::(_processLogs) (9013) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:39,699::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:39,700::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:49:39,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:49:39,707::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106475 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:39,708::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:39,708::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:39,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:39,708::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:39,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) (9014) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) (9014) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9014) Building response >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) (9014) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:39,709::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:40,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:40,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901264 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:41,742::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:41,743::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4074::DEBUG::2014-09-09 11:49:41,744::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:42,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:42,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897998 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:44,322::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:44,322::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) (9015) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) (9015) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9015) Building response >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) (9015) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:44,323::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:49:44,324::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:49:44,330::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000853633 s, 416 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) (9016) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:44,331::__init__::225::IOProcess::(_processLogs) (9016) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:44,332::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9016) Building response >Thread-19::DEBUG::2014-09-09 11:49:44,332::__init__::225::IOProcess::(_processLogs) (9016) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:44,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:44,332::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:44,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:44,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896443 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:46,166::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:46,166::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:46,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:46,167::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:46,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:46,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:46,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:46,167::__init__::225::IOProcess::(_processLogs) (9017) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:46,167::__init__::225::IOProcess::(_processLogs) (9017) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:46,168::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9017) Building response >Thread-19::DEBUG::2014-09-09 11:49:46,168::__init__::225::IOProcess::(_processLogs) (9017) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:46,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:46,168::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:49:46,169::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:49:46,176::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000953815 s, 575 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:46,176::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:46,176::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) (9018) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) (9018) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9018) Building response >Thread-19::DEBUG::2014-09-09 11:49:46,177::__init__::225::IOProcess::(_processLogs) (9018) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:46,178::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:46,178::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:49:46,178::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:46,178::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:49:46,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) (9019) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) (9019) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9019) Building response >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) (9019) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:46,179::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) (9020) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:46,180::__init__::225::IOProcess::(_processLogs) (9020) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9020) Building response >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) (9020) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:49:46,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) (9021) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) (9021) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) (9021) Building response >Thread-19::DEBUG::2014-09-09 11:49:46,182::__init__::225::IOProcess::(_processLogs) (9021) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:46,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:46,183::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:49:46,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:47,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896545 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:47,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:47,101::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4075::DEBUG::2014-09-09 11:49:47,102::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:47,465::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:47,466::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4076::DEBUG::2014-09-09 11:49:47,466::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4076::DEBUG::2014-09-09 11:49:47,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`71cccc8a-03c3-4e50-aa8d-23e3f75dc5ef`::moving from state init -> state preparing >Thread-4076::INFO::2014-09-09 11:49:47,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4076::INFO::2014-09-09 11:49:47,467::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4076::DEBUG::2014-09-09 11:49:47,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`71cccc8a-03c3-4e50-aa8d-23e3f75dc5ef`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4076::DEBUG::2014-09-09 11:49:47,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`71cccc8a-03c3-4e50-aa8d-23e3f75dc5ef`::moving from state preparing -> state finished >Thread-4076::DEBUG::2014-09-09 11:49:47,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4076::DEBUG::2014-09-09 11:49:47,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4076::DEBUG::2014-09-09 11:49:47,467::task::993::Storage.TaskManager.Task::(_decref) Task=`71cccc8a-03c3-4e50-aa8d-23e3f75dc5ef`::ref 0 aborting False >Thread-4076::DEBUG::2014-09-09 11:49:47,467::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4076::DEBUG::2014-09-09 11:49:47,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:48,729::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:48,730::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4077::DEBUG::2014-09-09 11:49:48,730::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4077::DEBUG::2014-09-09 11:49:48,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`f42bca27-4402-4f2b-9c45-86a36a00f473`::moving from state init -> state preparing >Thread-4077::INFO::2014-09-09 11:49:48,731::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4077::DEBUG::2014-09-09 11:49:48,731::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ba1b8614-43f7-48aa-ba45-1decb8cd3026`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4077::DEBUG::2014-09-09 11:49:48,731::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4077::DEBUG::2014-09-09 11:49:48,732::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4077::DEBUG::2014-09-09 11:49:48,732::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ba1b8614-43f7-48aa-ba45-1decb8cd3026`::Granted request >Thread-4077::DEBUG::2014-09-09 11:49:48,732::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f42bca27-4402-4f2b-9c45-86a36a00f473`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4077::DEBUG::2014-09-09 11:49:48,732::task::993::Storage.TaskManager.Task::(_decref) Task=`f42bca27-4402-4f2b-9c45-86a36a00f473`::ref 1 aborting False >Thread-4077::INFO::2014-09-09 11:49:48,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283597864960', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4077::DEBUG::2014-09-09 11:49:48,734::task::1191::Storage.TaskManager.Task::(prepare) Task=`f42bca27-4402-4f2b-9c45-86a36a00f473`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283597864960', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4077::DEBUG::2014-09-09 11:49:48,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`f42bca27-4402-4f2b-9c45-86a36a00f473`::moving from state preparing -> state finished >Thread-4077::DEBUG::2014-09-09 11:49:48,734::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4077::DEBUG::2014-09-09 11:49:48,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4077::DEBUG::2014-09-09 11:49:48,734::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4077::DEBUG::2014-09-09 11:49:48,734::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4077::DEBUG::2014-09-09 11:49:48,735::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4077::DEBUG::2014-09-09 11:49:48,735::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4077::DEBUG::2014-09-09 11:49:48,735::task::993::Storage.TaskManager.Task::(_decref) Task=`f42bca27-4402-4f2b-9c45-86a36a00f473`::ref 0 aborting False >Thread-4077::DEBUG::2014-09-09 11:49:48,735::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283597864960', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4077::DEBUG::2014-09-09 11:49:48,735::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:49,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:49,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897229 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:49,711::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:49,711::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:49,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:49,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:49,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:49,714::__init__::225::IOProcess::(_processLogs) (9022) Finding callback 'statvfs'... >Thread-23::DEBUG::2014-09-09 11:49:49,714::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:49:49,715::__init__::225::IOProcess::(_processLogs) (9022) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:49,720::__init__::225::IOProcess::(_processLogs) (9022) Building response >Thread-19::DEBUG::2014-09-09 11:49:49,721::__init__::225::IOProcess::(_processLogs) (9022) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:49,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:49,722::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:49:49,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108138 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:49,724::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:49,724::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:49,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:49,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:49,726::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:49,726::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:49,727::__init__::225::IOProcess::(_processLogs) (9023) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:49,727::__init__::225::IOProcess::(_processLogs) (9023) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:49,728::__init__::225::IOProcess::(_processLogs) (9023) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:49,729::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:49,730::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:50,108::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:50,110::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4078::DEBUG::2014-09-09 11:49:50,113::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:51,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:51,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.09247 s, 11.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:53,121::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:53,122::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4079::DEBUG::2014-09-09 11:49:53,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:49:53,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:53,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896404 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:54,333::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:54,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:54,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:54,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:54,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:54,334::__init__::225::IOProcess::(_processLogs) (9024) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:54,334::__init__::225::IOProcess::(_processLogs) (9024) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:54,334::__init__::225::IOProcess::(_processLogs) (9024) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:54,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:49:54,335::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:49:54,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000955135 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:54,341::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) (9025) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) (9025) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:54,342::__init__::225::IOProcess::(_processLogs) (9025) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:54,343::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:49:55,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:55,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089903 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:56,128::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:56,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4080::DEBUG::2014-09-09 11:49:56,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`673e9250-be53-4a10-9b76-755fe1fa578c`::moving from state init -> state preparing >Thread-4080::INFO::2014-09-09 11:49:56,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4080::INFO::2014-09-09 11:49:56,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108138', 'lastCheck': '6.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000953815', 'lastCheck': '9.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955135', 'lastCheck': '1.8', 'valid': True}} >Thread-4080::DEBUG::2014-09-09 11:49:56,131::task::1191::Storage.TaskManager.Task::(prepare) Task=`673e9250-be53-4a10-9b76-755fe1fa578c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108138', 'lastCheck': '6.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000953815', 'lastCheck': '9.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955135', 'lastCheck': '1.8', 'valid': True}} >Thread-4080::DEBUG::2014-09-09 11:49:56,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`673e9250-be53-4a10-9b76-755fe1fa578c`::moving from state preparing -> state finished >Thread-4080::DEBUG::2014-09-09 11:49:56,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4080::DEBUG::2014-09-09 11:49:56,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4080::DEBUG::2014-09-09 11:49:56,131::task::993::Storage.TaskManager.Task::(_decref) Task=`673e9250-be53-4a10-9b76-755fe1fa578c`::ref 0 aborting False >Thread-4080::DEBUG::2014-09-09 11:49:56,132::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:49:56,140::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:49:56,141::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4081::DEBUG::2014-09-09 11:49:56,142::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) (9026) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:56,183::__init__::225::IOProcess::(_processLogs) (9026) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:56,184::__init__::225::IOProcess::(_processLogs) (9026) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:56,184::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:49:56,184::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:49:56,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000998129 s, 549 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) (9027) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) (9027) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:56,193::__init__::225::IOProcess::(_processLogs) (9027) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:56,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:56,194::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:49:56,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:56,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) (9028) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) (9028) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) (9028) Building response >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) (9028) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:56,195::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) (9029) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) (9029) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) (9029) Building response >Thread-19::DEBUG::2014-09-09 11:49:56,196::__init__::225::IOProcess::(_processLogs) (9029) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:56,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:56,197::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:49:56,197::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:49:56,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:56,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:56,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) (9030) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) (9030) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) (9030) Building response >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) (9030) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:49:56,198::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:49:57,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:57,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896947 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:49:59,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:49:59,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089736 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:59,729::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) (9031) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) (9031) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:59,730::__init__::225::IOProcess::(_processLogs) (9031) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:59,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:49:59,731::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:49:59,738::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011522 s, 975 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) (9032) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:49:59,739::__init__::225::IOProcess::(_processLogs) (9032) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:49:59,740::__init__::225::IOProcess::(_processLogs) (9032) Queuing response >Thread-19::DEBUG::2014-09-09 11:49:59,740::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:50:01,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:01,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896664 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:02,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:02,591::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4082::DEBUG::2014-09-09 11:50:02,591::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4082::DEBUG::2014-09-09 11:50:02,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`14723fd8-7a6e-4805-976d-3760fefcaf70`::moving from state init -> state preparing >Thread-4082::INFO::2014-09-09 11:50:02,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4082::INFO::2014-09-09 11:50:02,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4082::DEBUG::2014-09-09 11:50:02,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`14723fd8-7a6e-4805-976d-3760fefcaf70`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4082::DEBUG::2014-09-09 11:50:02,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`14723fd8-7a6e-4805-976d-3760fefcaf70`::moving from state preparing -> state finished >Thread-4082::DEBUG::2014-09-09 11:50:02,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4082::DEBUG::2014-09-09 11:50:02,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4082::DEBUG::2014-09-09 11:50:02,593::task::993::Storage.TaskManager.Task::(_decref) Task=`14723fd8-7a6e-4805-976d-3760fefcaf70`::ref 0 aborting False >Thread-4082::DEBUG::2014-09-09 11:50:02,593::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4082::DEBUG::2014-09-09 11:50:02,594::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:03,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:03,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4083::DEBUG::2014-09-09 11:50:03,529::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4083::DEBUG::2014-09-09 11:50:03,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d93f501-000d-4e48-8607-561ad6979f4f`::moving from state init -> state preparing >Thread-4083::INFO::2014-09-09 11:50:03,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4083::DEBUG::2014-09-09 11:50:03,530::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`435005d1-5965-4e91-b2af-354aa3de2b41`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4083::DEBUG::2014-09-09 11:50:03,531::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4083::DEBUG::2014-09-09 11:50:03,531::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4083::DEBUG::2014-09-09 11:50:03,531::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`435005d1-5965-4e91-b2af-354aa3de2b41`::Granted request >Thread-4083::DEBUG::2014-09-09 11:50:03,531::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6d93f501-000d-4e48-8607-561ad6979f4f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4083::DEBUG::2014-09-09 11:50:03,531::task::993::Storage.TaskManager.Task::(_decref) Task=`6d93f501-000d-4e48-8607-561ad6979f4f`::ref 1 aborting False >Thread-4083::INFO::2014-09-09 11:50:03,533::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4083::DEBUG::2014-09-09 11:50:03,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d93f501-000d-4e48-8607-561ad6979f4f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4083::DEBUG::2014-09-09 11:50:03,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d93f501-000d-4e48-8607-561ad6979f4f`::moving from state preparing -> state finished >Thread-4083::DEBUG::2014-09-09 11:50:03,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4083::DEBUG::2014-09-09 11:50:03,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4083::DEBUG::2014-09-09 11:50:03,533::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4083::DEBUG::2014-09-09 11:50:03,533::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4083::DEBUG::2014-09-09 11:50:03,533::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4083::DEBUG::2014-09-09 11:50:03,534::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4083::DEBUG::2014-09-09 11:50:03,534::task::993::Storage.TaskManager.Task::(_decref) Task=`6d93f501-000d-4e48-8607-561ad6979f4f`::ref 0 aborting False >Thread-4083::DEBUG::2014-09-09 11:50:03,534::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4083::DEBUG::2014-09-09 11:50:03,534::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:03,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:03,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898843 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) (9033) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:04,344::__init__::225::IOProcess::(_processLogs) (9033) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:04,345::__init__::225::IOProcess::(_processLogs) (9033) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:04,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:50:04,345::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:50:04,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000916717 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) (9034) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:04,353::__init__::225::IOProcess::(_processLogs) (9034) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:04,354::__init__::225::IOProcess::(_processLogs) (9034) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:04,354::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:50:05,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:06,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898204 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) (9035) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:06,198::__init__::225::IOProcess::(_processLogs) (9035) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:06,199::__init__::225::IOProcess::(_processLogs) (9035) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:06,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:50:06,199::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:50:06,206::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00102764 s, 533 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) (9036) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:06,207::__init__::225::IOProcess::(_processLogs) (9036) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:06,208::__init__::225::IOProcess::(_processLogs) (9036) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:06,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:06,208::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) (9037) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) (9037) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) (9037) Building response >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) (9037) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:06,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:06,210::__init__::225::IOProcess::(_processLogs) (9038) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) (9038) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) (9038) Building response >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) (9038) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:06,211::__init__::225::IOProcess::(_processLogs) (9039) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:06,212::__init__::225::IOProcess::(_processLogs) (9039) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:06,212::__init__::225::IOProcess::(_processLogs) (9039) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:06,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:06,212::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:06,452::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:06,453::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4084::DEBUG::2014-09-09 11:50:06,454::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:08,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:08,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898023 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:09,460::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:09,461::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4085::DEBUG::2014-09-09 11:50:09,462::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) (9040) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:09,741::__init__::225::IOProcess::(_processLogs) (9040) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:09,742::__init__::225::IOProcess::(_processLogs) DEBUG|(9040) Building response >Thread-19::DEBUG::2014-09-09 11:50:09,742::__init__::225::IOProcess::(_processLogs) (9040) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:09,742::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:50:09,743::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:50:09,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:50:09,750::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104484 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:09,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:09,752::__init__::225::IOProcess::(_processLogs) (9041) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:09,752::__init__::225::IOProcess::(_processLogs) (9041) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:09,752::__init__::225::IOProcess::(_processLogs) DEBUG|(9041) Building response >Thread-19::DEBUG::2014-09-09 11:50:09,752::__init__::225::IOProcess::(_processLogs) (9041) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:09,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:09,752::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:50:10,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:10,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898377 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:50:12,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:12,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089941 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:12,468::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:12,469::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4086::DEBUG::2014-09-09 11:50:12,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:14,091::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:14,092::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4087::DEBUG::2014-09-09 11:50:14,092::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4087::DEBUG::2014-09-09 11:50:14,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebf73a6a-3c55-437c-a42c-90d7f332e62b`::moving from state init -> state preparing >Thread-4087::INFO::2014-09-09 11:50:14,093::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4087::INFO::2014-09-09 11:50:14,093::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4087::DEBUG::2014-09-09 11:50:14,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebf73a6a-3c55-437c-a42c-90d7f332e62b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4087::DEBUG::2014-09-09 11:50:14,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebf73a6a-3c55-437c-a42c-90d7f332e62b`::moving from state preparing -> state finished >Thread-4087::DEBUG::2014-09-09 11:50:14,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4087::DEBUG::2014-09-09 11:50:14,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4087::DEBUG::2014-09-09 11:50:14,094::task::993::Storage.TaskManager.Task::(_decref) Task=`ebf73a6a-3c55-437c-a42c-90d7f332e62b`::ref 0 aborting False >Thread-4087::DEBUG::2014-09-09 11:50:14,094::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4087::DEBUG::2014-09-09 11:50:14,094::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:14,256::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4088::DEBUG::2014-09-09 11:50:14,257::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:50:14,257::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4088::DEBUG::2014-09-09 11:50:14,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2111b85-9d8f-4555-acd8-eaa751b4aae9`::moving from state init -> state preparing >Thread-4088::INFO::2014-09-09 11:50:14,258::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4088::DEBUG::2014-09-09 11:50:14,259::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4e93299e-e5fd-42ee-92e2-2294a8334816`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4088::DEBUG::2014-09-09 11:50:14,259::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4088::DEBUG::2014-09-09 11:50:14,259::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4088::DEBUG::2014-09-09 11:50:14,259::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4e93299e-e5fd-42ee-92e2-2294a8334816`::Granted request >Thread-4088::DEBUG::2014-09-09 11:50:14,259::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a2111b85-9d8f-4555-acd8-eaa751b4aae9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4088::DEBUG::2014-09-09 11:50:14,259::task::993::Storage.TaskManager.Task::(_decref) Task=`a2111b85-9d8f-4555-acd8-eaa751b4aae9`::ref 1 aborting False >Thread-4088::INFO::2014-09-09 11:50:14,261::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4088::DEBUG::2014-09-09 11:50:14,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2111b85-9d8f-4555-acd8-eaa751b4aae9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4088::DEBUG::2014-09-09 11:50:14,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2111b85-9d8f-4555-acd8-eaa751b4aae9`::moving from state preparing -> state finished >Thread-4088::DEBUG::2014-09-09 11:50:14,261::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4088::DEBUG::2014-09-09 11:50:14,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4088::DEBUG::2014-09-09 11:50:14,262::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4088::DEBUG::2014-09-09 11:50:14,262::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4088::DEBUG::2014-09-09 11:50:14,262::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4088::DEBUG::2014-09-09 11:50:14,262::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4088::DEBUG::2014-09-09 11:50:14,262::task::993::Storage.TaskManager.Task::(_decref) Task=`a2111b85-9d8f-4555-acd8-eaa751b4aae9`::ref 0 aborting False >Thread-4088::DEBUG::2014-09-09 11:50:14,262::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4088::DEBUG::2014-09-09 11:50:14,262::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:14,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:14,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:14,356::__init__::225::IOProcess::(_processLogs) (9042) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:14,356::__init__::225::IOProcess::(_processLogs) (9042) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:14,426::__init__::225::IOProcess::(_processLogs) DEBUG|(9042) Building response >Thread-19::DEBUG::2014-09-09 11:50:14,427::__init__::225::IOProcess::(_processLogs) (9042) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:14,427::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:14,428::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:50:14,429::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:14,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970484 s, 10.6 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 11:50:14,436::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000882323 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:14,438::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:14,438::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:14,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:14,439::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:14,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:14,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:14,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:14,441::__init__::225::IOProcess::(_processLogs) (9043) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:14,441::__init__::225::IOProcess::(_processLogs) (9043) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:14,442::__init__::225::IOProcess::(_processLogs) DEBUG|(9043) Building response >Thread-19::DEBUG::2014-09-09 11:50:14,443::__init__::225::IOProcess::(_processLogs) (9043) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:14,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:14,444::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:15,476::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:15,477::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4089::DEBUG::2014-09-09 11:50:15,478::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:16,213::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:16,213::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:16,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:16,213::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:16,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:16,214::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:16,214::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:16,214::__init__::225::IOProcess::(_processLogs) (9044) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:16,214::__init__::225::IOProcess::(_processLogs) (9044) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:16,214::__init__::225::IOProcess::(_processLogs) DEBUG|(9044) Building response >Thread-19::DEBUG::2014-09-09 11:50:16,215::__init__::225::IOProcess::(_processLogs) (9044) Queuing response >Thread-24::DEBUG::2014-09-09 11:50:16,215::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:16,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:16,220::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:50:16,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000906478 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:16,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:16,223::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) (9045) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) (9045) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:16,224::__init__::225::IOProcess::(_processLogs) DEBUG|(9045) Building response >Thread-19::DEBUG::2014-09-09 11:50:16,225::__init__::225::IOProcess::(_processLogs) (9045) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:16,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:16,225::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:16,225::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:16,225::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:50:16,225::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) (9046) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) (9046) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) (9046) Building response >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) (9046) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:16,226::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:16,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) (9047) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) (9047) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) (9047) Building response >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) (9047) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:50:16,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) (9048) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) (9048) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) (9048) Building response >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) (9048) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:16,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:16,230::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:50:16,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:16,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898351 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:18,483::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:18,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4090::DEBUG::2014-09-09 11:50:18,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3a6ebfd-42c8-4f80-ba6a-29d29d62e6be`::moving from state init -> state preparing >Thread-4090::INFO::2014-09-09 11:50:18,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4090::INFO::2014-09-09 11:50:18,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104484', 'lastCheck': '8.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000906478', 'lastCheck': '2.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882323', 'lastCheck': '4.0', 'valid': True}} >Thread-4090::DEBUG::2014-09-09 11:50:18,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3a6ebfd-42c8-4f80-ba6a-29d29d62e6be`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104484', 'lastCheck': '8.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000906478', 'lastCheck': '2.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882323', 'lastCheck': '4.0', 'valid': True}} >Thread-4090::DEBUG::2014-09-09 11:50:18,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3a6ebfd-42c8-4f80-ba6a-29d29d62e6be`::moving from state preparing -> state finished >Thread-4090::DEBUG::2014-09-09 11:50:18,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4090::DEBUG::2014-09-09 11:50:18,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4090::DEBUG::2014-09-09 11:50:18,486::task::993::Storage.TaskManager.Task::(_decref) Task=`f3a6ebfd-42c8-4f80-ba6a-29d29d62e6be`::ref 0 aborting False >Thread-4090::DEBUG::2014-09-09 11:50:18,487::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:18,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:18,498::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4091::DEBUG::2014-09-09 11:50:18,499::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:18,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:18,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089717 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:19,754::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:19,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:19,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-23::DEBUG::2014-09-09 11:50:19,756::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:19,756::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:19,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:19,762::__init__::225::IOProcess::(_processLogs) (9049) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:19,763::__init__::225::IOProcess::(_processLogs) (9049) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:19,763::__init__::225::IOProcess::(_processLogs) (9049) Building response >Thread-23::DEBUG::2014-09-09 11:50:19,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116463 s, 964 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:19,765::__init__::225::IOProcess::(_processLogs) (9049) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:19,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:19,766::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:19,767::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:19,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:19,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:19,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:19,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:19,770::__init__::225::IOProcess::(_processLogs) (9050) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:19,771::__init__::225::IOProcess::(_processLogs) (9050) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:19,772::__init__::225::IOProcess::(_processLogs) (9050) Building response >Thread-19::DEBUG::2014-09-09 11:50:19,772::__init__::225::IOProcess::(_processLogs) (9050) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:19,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:19,773::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:50:20,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:20,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897905 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:21,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4092::DEBUG::2014-09-09 11:50:21,428::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.getFileStats' in bridge with {u'caseSensitive': False, u'pattern': u'*.iso', u'storagedomainID': u'e453999e-ec9f-420b-941c-a9f9cc4432bb'} >JsonRpcServer::DEBUG::2014-09-09 11:50:21,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4092::DEBUG::2014-09-09 11:50:21,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cc7da06-baff-4331-a12b-1aa187b1992f`::moving from state init -> state preparing >Thread-4092::INFO::2014-09-09 11:50:21,429::logUtils::44::dispatcher::(wrapper) Run and protect: getFileStats(sdUUID=u'e453999e-ec9f-420b-941c-a9f9cc4432bb', pattern=u'*.iso', caseSensitive=False, options=None) >Thread-4092::DEBUG::2014-09-09 11:50:21,430::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb`ReqID=`6f08c02c-4589-4cb2-a7c8-6b30688ad86c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2301' at 'getFileStats' >Thread-4092::DEBUG::2014-09-09 11:50:21,430::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb' for lock type 'shared' >Thread-4092::DEBUG::2014-09-09 11:50:21,430::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb' is free. Now locking as 'shared' (1 active user) >Thread-4092::DEBUG::2014-09-09 11:50:21,430::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb`ReqID=`6f08c02c-4589-4cb2-a7c8-6b30688ad86c`::Granted request >Thread-4092::DEBUG::2014-09-09 11:50:21,430::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8cc7da06-baff-4331-a12b-1aa187b1992f`::_resourcesAcquired: Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb (shared) >Thread-4092::DEBUG::2014-09-09 11:50:21,430::task::993::Storage.TaskManager.Task::(_decref) Task=`8cc7da06-baff-4331-a12b-1aa187b1992f`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) (9051) Finding callback 'listdir'... >Thread-19::DEBUG::2014-09-09 11:50:21,431::__init__::225::IOProcess::(_processLogs) (9051) Got request for method 'listdir' >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:21,748::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:21,749::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4093::DEBUG::2014-09-09 11:50:21,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:21,981::__init__::225::IOProcess::(_processLogs) (9051) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,982::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:50:21,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:21,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) (9052) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) (9052) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) (9052) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) (9052) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:50:21,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) (9053) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) (9053) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) (9053) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) (9053) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,984::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) (9054) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) (9054) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) (9054) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) (9054) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,985::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) Message size is 231 >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) (9055) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) (9055) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) (9055) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,986::__init__::225::IOProcess::(_processLogs) (9055) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Message size is 224 >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) (9056) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) (9056) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) (9056) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) (9056) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) (9057) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) (9057) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) (9057) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) (9057) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-09-09 11:50:21,989::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) (9058) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) (9058) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) (9058) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) (9058) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,990::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) (9059) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) (9059) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) (9059) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) (9059) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,991::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) (9060) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) (9060) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) (9060) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) (9060) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,992::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,993::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-19::DEBUG::2014-09-09 11:50:21,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:21,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,994::__init__::225::IOProcess::(_processLogs) (9061) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,994::__init__::225::IOProcess::(_processLogs) (9061) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,994::__init__::225::IOProcess::(_processLogs) (9061) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) (9061) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) (9062) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) (9062) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,995::__init__::225::IOProcess::(_processLogs) (9062) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) (9062) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) (9063) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) (9063) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) (9063) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) (9063) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:21,997::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) (9064) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) (9064) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) (9064) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) (9064) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:50:21,998::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) (9065) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) (9065) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) (9065) Building response >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) (9065) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:21,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) (9066) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) (9066) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) (9066) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) (9066) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,000::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,001::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,001::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,001::__init__::225::IOProcess::(_processLogs) Message size is 219 >Thread-19::DEBUG::2014-09-09 11:50:22,001::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,001::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) (9067) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) (9067) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) (9067) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) (9067) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,002::__init__::225::IOProcess::(_processLogs) Message size is 231 >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) (9068) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) (9068) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) (9068) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,003::__init__::225::IOProcess::(_processLogs) (9068) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) Message size is 231 >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) (9069) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) (9069) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) (9069) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) (9069) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) Message size is 224 >Thread-19::DEBUG::2014-09-09 11:50:22,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) (9070) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) (9070) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) (9070) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,006::__init__::225::IOProcess::(_processLogs) (9070) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) Message size is 224 >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) (9071) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) (9071) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) (9071) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) (9071) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,008::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) (9072) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) (9072) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) (9072) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) (9072) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) (9073) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) (9073) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) (9073) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) (9073) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) Sending response sized 246 >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-09-09 11:50:22,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) (9074) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) (9074) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) (9074) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) (9074) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,012::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,013::__init__::225::IOProcess::(_processLogs) (9075) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) (9075) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) (9075) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) (9075) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:50:22,014::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) (9076) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) (9076) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) (9076) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) (9076) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,015::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) (9077) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,016::__init__::225::IOProcess::(_processLogs) (9077) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) (9077) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) (9077) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:50:22,017::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) (9078) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) (9078) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) (9078) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) (9078) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:22,018::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) Message size is 209 >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) (9079) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) (9079) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) (9079) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,019::__init__::225::IOProcess::(_processLogs) (9079) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,020::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:22,020::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,020::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-19::DEBUG::2014-09-09 11:50:22,020::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:22,020::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) (9080) Finding callback 'stat'... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) (9080) Got request for method 'stat' >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) (9080) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) (9080) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:22,021::__init__::225::IOProcess::(_processLogs) Message size is 230 >Thread-19::DEBUG::2014-09-09 11:50:22,022::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-4092::INFO::2014-09-09 11:50:22,022::logUtils::47::dispatcher::(wrapper) Run and protect: getFileStats, Return response: {'fileStats': {u'turnkey-openldap-13.0-wheezy-amd64.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '166459392'}, u'Fedora-20-x86_64-DVD.iso': {'status': 0, 'ctime': '1407943446.0', 'size': '4603248640'}, u'rhel-7-public-beta-x86_64-dvd.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '4693426176'}, u'CentOS-7.0-1406-x86_64-DVD.iso': {'status': 0, 'ctime': '1404762959.0', 'size': '4148166656'}, u'TinyCore-current.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '14680064'}, u'RHEL6.5-20131024.1-Server-x86_64-DVD1.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '3827302400'}, u'RHEL-7.0-20140507.0-Server-x86_64-dvd1.iso': {'status': 0, 'ctime': '1409336738.0', 'size': '3743416320'}, u'CentOS-6.5-x86_64-netinstall.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '254803968'}, u'CorePlus-current.iso': {'status': 0, 'ctime': '1398113011.0', 'size': '75497472'}, u'FreeBSD-9.2-RELEASE-amd64-disc1.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '686858240'}}} >Thread-19::DEBUG::2014-09-09 11:50:22,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-4092::DEBUG::2014-09-09 11:50:22,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cc7da06-baff-4331-a12b-1aa187b1992f`::finished: {'fileStats': {u'turnkey-openldap-13.0-wheezy-amd64.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '166459392'}, u'Fedora-20-x86_64-DVD.iso': {'status': 0, 'ctime': '1407943446.0', 'size': '4603248640'}, u'rhel-7-public-beta-x86_64-dvd.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '4693426176'}, u'CentOS-7.0-1406-x86_64-DVD.iso': {'status': 0, 'ctime': '1404762959.0', 'size': '4148166656'}, u'TinyCore-current.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '14680064'}, u'RHEL6.5-20131024.1-Server-x86_64-DVD1.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '3827302400'}, u'RHEL-7.0-20140507.0-Server-x86_64-dvd1.iso': {'status': 0, 'ctime': '1409336738.0', 'size': '3743416320'}, u'CentOS-6.5-x86_64-netinstall.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '254803968'}, u'CorePlus-current.iso': {'status': 0, 'ctime': '1398113011.0', 'size': '75497472'}, u'FreeBSD-9.2-RELEASE-amd64-disc1.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '686858240'}}} >Thread-19::DEBUG::2014-09-09 11:50:22,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-4092::DEBUG::2014-09-09 11:50:22,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cc7da06-baff-4331-a12b-1aa187b1992f`::moving from state preparing -> state finished >Thread-4092::DEBUG::2014-09-09 11:50:22,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb': < ResourceRef 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-09-09 11:50:22,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-4092::DEBUG::2014-09-09 11:50:22,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 11:50:22,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-4092::DEBUG::2014-09-09 11:50:22,024::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb' >Thread-19::DEBUG::2014-09-09 11:50:22,025::__init__::225::IOProcess::(_processLogs) (9081) Finding callback 'stat'... >Thread-4092::DEBUG::2014-09-09 11:50:22,025::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb' (0 active users) >Thread-19::DEBUG::2014-09-09 11:50:22,025::__init__::225::IOProcess::(_processLogs) (9081) Got request for method 'stat' >Thread-4092::DEBUG::2014-09-09 11:50:22,025::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb' is free, finding out if anyone is waiting for it. >Thread-4092::DEBUG::2014-09-09 11:50:22,026::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.e453999e-ec9f-420b-941c-a9f9cc4432bb', Clearing records. >Thread-19::DEBUG::2014-09-09 11:50:22,026::__init__::225::IOProcess::(_processLogs) (9081) Building response >Thread-19::DEBUG::2014-09-09 11:50:22,027::__init__::225::IOProcess::(_processLogs) (9081) Queuing response >Thread-4092::DEBUG::2014-09-09 11:50:22,027::task::993::Storage.TaskManager.Task::(_decref) Task=`8cc7da06-baff-4331-a12b-1aa187b1992f`::ref 0 aborting False >Thread-4092::DEBUG::2014-09-09 11:50:22,027::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.getFileStats' in bridge with {u'turnkey-openldap-13.0-wheezy-amd64.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '166459392'}, u'Fedora-20-x86_64-DVD.iso': {'status': 0, 'ctime': '1407943446.0', 'size': '4603248640'}, u'rhel-7-public-beta-x86_64-dvd.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '4693426176'}, u'CentOS-7.0-1406-x86_64-DVD.iso': {'status': 0, 'ctime': '1404762959.0', 'size': '4148166656'}, u'TinyCore-current.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '14680064'}, u'RHEL6.5-20131024.1-Server-x86_64-DVD1.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '3827302400'}, u'RHEL-7.0-20140507.0-Server-x86_64-dvd1.iso': {'status': 0, 'ctime': '1409336738.0', 'size': '3743416320'}, u'CentOS-6.5-x86_64-netinstall.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '254803968'}, u'CorePlus-current.iso': {'status': 0, 'ctime': '1398113011.0', 'size': '75497472'}, u'FreeBSD-9.2-RELEASE-amd64-disc1.iso': {'status': 0, 'ctime': '1396552602.0', 'size': '686858240'}} >Thread-19::DEBUG::2014-09-09 11:50:22,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-4092::DEBUG::2014-09-09 11:50:22,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:22,028::__init__::225::IOProcess::(_processLogs) Sending response sized 248 >Dummy-97::DEBUG::2014-09-09 11:50:22,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:22,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898978 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:24,443::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:24,443::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) (9082) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) (9082) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:24,444::__init__::225::IOProcess::(_processLogs) DEBUG|(9082) Building response >Thread-3443::DEBUG::2014-09-09 11:50:24,445::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:24,445::__init__::225::IOProcess::(_processLogs) (9082) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:24,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:24,450::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:24,451::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:24,452::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4094::DEBUG::2014-09-09 11:50:24,452::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-3443::DEBUG::2014-09-09 11:50:24,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000873609 s, 406 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:24,455::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:24,455::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-4094::DEBUG::2014-09-09 11:50:24,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`51ecb5fe-3906-487a-b23a-b058fcc31551`::moving from state init -> state preparing >Thread-19::DEBUG::2014-09-09 11:50:24,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-4094::INFO::2014-09-09 11:50:24,456::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-19::DEBUG::2014-09-09 11:50:24,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-4094::INFO::2014-09-09 11:50:24,457::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-19::DEBUG::2014-09-09 11:50:24,457::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-4094::DEBUG::2014-09-09 11:50:24,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`51ecb5fe-3906-487a-b23a-b058fcc31551`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-19::DEBUG::2014-09-09 11:50:24,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-4094::DEBUG::2014-09-09 11:50:24,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`51ecb5fe-3906-487a-b23a-b058fcc31551`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-09-09 11:50:24,459::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-4094::DEBUG::2014-09-09 11:50:24,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-09-09 11:50:24,460::__init__::225::IOProcess::(_processLogs) (9083) Finding callback 'statvfs'... >Thread-4094::DEBUG::2014-09-09 11:50:24,460::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 11:50:24,461::__init__::225::IOProcess::(_processLogs) (9083) Got request for method 'statvfs' >Thread-4094::DEBUG::2014-09-09 11:50:24,461::task::993::Storage.TaskManager.Task::(_decref) Task=`51ecb5fe-3906-487a-b23a-b058fcc31551`::ref 0 aborting False >Thread-19::DEBUG::2014-09-09 11:50:24,461::__init__::225::IOProcess::(_processLogs) (9083) Building response >Thread-4094::DEBUG::2014-09-09 11:50:24,462::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-19::DEBUG::2014-09-09 11:50:24,462::__init__::225::IOProcess::(_processLogs) (9083) Queuing response >Thread-4094::DEBUG::2014-09-09 11:50:24,463::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:24,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:24,463::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:24,595::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4095::DEBUG::2014-09-09 11:50:24,596::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:50:24,596::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4095::DEBUG::2014-09-09 11:50:24,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a540258-2f08-4470-bddf-ff921182d23d`::moving from state init -> state preparing >Thread-4095::INFO::2014-09-09 11:50:24,597::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4095::DEBUG::2014-09-09 11:50:24,597::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4c3ba0af-a8f2-442d-a7d0-b2c9c96cc98f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4095::DEBUG::2014-09-09 11:50:24,597::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4095::DEBUG::2014-09-09 11:50:24,597::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4095::DEBUG::2014-09-09 11:50:24,597::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4c3ba0af-a8f2-442d-a7d0-b2c9c96cc98f`::Granted request >Thread-4095::DEBUG::2014-09-09 11:50:24,598::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1a540258-2f08-4470-bddf-ff921182d23d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4095::DEBUG::2014-09-09 11:50:24,598::task::993::Storage.TaskManager.Task::(_decref) Task=`1a540258-2f08-4470-bddf-ff921182d23d`::ref 1 aborting False >Thread-4095::INFO::2014-09-09 11:50:24,599::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4095::DEBUG::2014-09-09 11:50:24,599::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a540258-2f08-4470-bddf-ff921182d23d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4095::DEBUG::2014-09-09 11:50:24,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a540258-2f08-4470-bddf-ff921182d23d`::moving from state preparing -> state finished >Thread-4095::DEBUG::2014-09-09 11:50:24,599::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4095::DEBUG::2014-09-09 11:50:24,600::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4095::DEBUG::2014-09-09 11:50:24,600::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4095::DEBUG::2014-09-09 11:50:24,600::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4095::DEBUG::2014-09-09 11:50:24,600::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4095::DEBUG::2014-09-09 11:50:24,600::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4095::DEBUG::2014-09-09 11:50:24,600::task::993::Storage.TaskManager.Task::(_decref) Task=`1a540258-2f08-4470-bddf-ff921182d23d`::ref 0 aborting False >Thread-4095::DEBUG::2014-09-09 11:50:24,600::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4095::DEBUG::2014-09-09 11:50:24,600::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:24,760::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:24,761::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4096::DEBUG::2014-09-09 11:50:24,762::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:24,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:24,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897413 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:26,229::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) (9084) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) (9084) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:26,230::__init__::225::IOProcess::(_processLogs) DEBUG|(9084) Building response >Thread-24::DEBUG::2014-09-09 11:50:26,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:26,231::__init__::225::IOProcess::(_processLogs) (9084) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:26,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:26,236::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:50:26,238::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000936515 s, 585 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) (9085) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:26,239::__init__::225::IOProcess::(_processLogs) (9085) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:26,240::__init__::225::IOProcess::(_processLogs) DEBUG|(9085) Building response >Thread-19::DEBUG::2014-09-09 11:50:26,240::__init__::225::IOProcess::(_processLogs) (9085) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:26,240::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:50:26,240::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:26,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) (9086) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) (9086) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) (9086) Building response >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) (9086) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:50:26,242::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) (9087) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) (9087) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) (9087) Building response >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) (9087) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:26,243::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:26,244::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:26,244::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:50:26,244::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:26,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:26,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) (9088) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) (9088) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) (9088) Building response >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) (9088) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:26,245::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:50:26,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:27,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901436 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:27,769::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:27,769::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4097::DEBUG::2014-09-09 11:50:27,770::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:29,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:29,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897694 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:29,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) (9089) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) (9089) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:29,772::__init__::225::IOProcess::(_processLogs) DEBUG|(9089) Building response >Thread-19::DEBUG::2014-09-09 11:50:29,773::__init__::225::IOProcess::(_processLogs) (9089) Queuing response >Thread-23::DEBUG::2014-09-09 11:50:29,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:29,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:29,778::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:50:29,780::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105567 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) (9090) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) (9090) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:29,781::__init__::225::IOProcess::(_processLogs) DEBUG|(9090) Building response >Thread-19::DEBUG::2014-09-09 11:50:29,782::__init__::225::IOProcess::(_processLogs) (9090) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:29,782::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:50:29,782::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:30,775::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:30,776::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4098::DEBUG::2014-09-09 11:50:30,777::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:31,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:31,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897787 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:50:33,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:33,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899228 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:33,785::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:33,786::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4099::DEBUG::2014-09-09 11:50:33,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`15eef8b8-a29c-4a5d-a7b2-678db19a258e`::moving from state init -> state preparing >Thread-4099::INFO::2014-09-09 11:50:33,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4099::INFO::2014-09-09 11:50:33,787::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105567', 'lastCheck': '4.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000936515', 'lastCheck': '7.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873609', 'lastCheck': '9.3', 'valid': True}} >Thread-4099::DEBUG::2014-09-09 11:50:33,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`15eef8b8-a29c-4a5d-a7b2-678db19a258e`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105567', 'lastCheck': '4.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000936515', 'lastCheck': '7.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873609', 'lastCheck': '9.3', 'valid': True}} >Thread-4099::DEBUG::2014-09-09 11:50:33,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`15eef8b8-a29c-4a5d-a7b2-678db19a258e`::moving from state preparing -> state finished >Thread-4099::DEBUG::2014-09-09 11:50:33,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4099::DEBUG::2014-09-09 11:50:33,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4099::DEBUG::2014-09-09 11:50:33,788::task::993::Storage.TaskManager.Task::(_decref) Task=`15eef8b8-a29c-4a5d-a7b2-678db19a258e`::ref 0 aborting False >Thread-4099::DEBUG::2014-09-09 11:50:33,789::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:33,794::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:33,795::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4100::DEBUG::2014-09-09 11:50:33,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:34,461::__init__::225::IOProcess::(_processLogs) (9091) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:34,462::__init__::225::IOProcess::(_processLogs) (9091) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:34,463::__init__::225::IOProcess::(_processLogs) DEBUG|(9091) Building response >Thread-19::DEBUG::2014-09-09 11:50:34,463::__init__::225::IOProcess::(_processLogs) (9091) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:34,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:34,463::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:50:34,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:50:34,471::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000897116 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) (9092) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) (9092) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) DEBUG|(9092) Building response >Thread-19::DEBUG::2014-09-09 11:50:34,472::__init__::225::IOProcess::(_processLogs) (9092) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:34,473::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:50:34,473::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:34,901::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4101::DEBUG::2014-09-09 11:50:34,902::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:50:34,902::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4101::DEBUG::2014-09-09 11:50:34,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`d873bc09-60ec-4889-ba37-a492cc9dea82`::moving from state init -> state preparing >Thread-4101::INFO::2014-09-09 11:50:34,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4101::INFO::2014-09-09 11:50:34,903::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4101::DEBUG::2014-09-09 11:50:34,903::task::1191::Storage.TaskManager.Task::(prepare) Task=`d873bc09-60ec-4889-ba37-a492cc9dea82`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4101::DEBUG::2014-09-09 11:50:34,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`d873bc09-60ec-4889-ba37-a492cc9dea82`::moving from state preparing -> state finished >Thread-4101::DEBUG::2014-09-09 11:50:34,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4101::DEBUG::2014-09-09 11:50:34,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4101::DEBUG::2014-09-09 11:50:34,904::task::993::Storage.TaskManager.Task::(_decref) Task=`d873bc09-60ec-4889-ba37-a492cc9dea82`::ref 0 aborting False >Thread-4101::DEBUG::2014-09-09 11:50:34,904::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4101::DEBUG::2014-09-09 11:50:34,904::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:34,958::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4102::DEBUG::2014-09-09 11:50:34,959::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:50:34,959::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4102::DEBUG::2014-09-09 11:50:34,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`97bdf7c3-41fe-4b99-bce1-0f676ced8b8c`::moving from state init -> state preparing >Thread-4102::INFO::2014-09-09 11:50:34,960::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4102::DEBUG::2014-09-09 11:50:34,960::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2ac70f7e-37ce-4e74-8b2e-e9d72c8186a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4102::DEBUG::2014-09-09 11:50:34,960::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4102::DEBUG::2014-09-09 11:50:34,960::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4102::DEBUG::2014-09-09 11:50:34,961::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2ac70f7e-37ce-4e74-8b2e-e9d72c8186a6`::Granted request >Thread-4102::DEBUG::2014-09-09 11:50:34,961::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`97bdf7c3-41fe-4b99-bce1-0f676ced8b8c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4102::DEBUG::2014-09-09 11:50:34,961::task::993::Storage.TaskManager.Task::(_decref) Task=`97bdf7c3-41fe-4b99-bce1-0f676ced8b8c`::ref 1 aborting False >Thread-4102::INFO::2014-09-09 11:50:34,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4102::DEBUG::2014-09-09 11:50:34,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`97bdf7c3-41fe-4b99-bce1-0f676ced8b8c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4102::DEBUG::2014-09-09 11:50:34,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`97bdf7c3-41fe-4b99-bce1-0f676ced8b8c`::moving from state preparing -> state finished >Thread-4102::DEBUG::2014-09-09 11:50:34,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4102::DEBUG::2014-09-09 11:50:34,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4102::DEBUG::2014-09-09 11:50:34,963::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4102::DEBUG::2014-09-09 11:50:34,963::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4102::DEBUG::2014-09-09 11:50:34,963::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4102::DEBUG::2014-09-09 11:50:34,963::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4102::DEBUG::2014-09-09 11:50:34,963::task::993::Storage.TaskManager.Task::(_decref) Task=`97bdf7c3-41fe-4b99-bce1-0f676ced8b8c`::ref 0 aborting False >Thread-4102::DEBUG::2014-09-09 11:50:34,963::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4102::DEBUG::2014-09-09 11:50:34,964::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:35,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:35,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896818 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:36,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:36,246::__init__::225::IOProcess::(_processLogs) (9093) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:36,246::__init__::225::IOProcess::(_processLogs) (9093) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:36,246::__init__::225::IOProcess::(_processLogs) (9093) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:36,246::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:50:36,247::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:36,247::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:50:36,254::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000916892 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:36,254::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) (9094) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) (9094) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|(9094) Building response >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) (9094) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:36,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:36,256::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:36,256::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:36,256::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) (9095) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) (9095) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:36,257::__init__::225::IOProcess::(_processLogs) (9095) Building response >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) (9095) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:36,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) (9096) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) (9096) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) (9096) Building response >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) (9096) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:36,259::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) (9097) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:36,260::__init__::225::IOProcess::(_processLogs) (9097) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:36,261::__init__::225::IOProcess::(_processLogs) (9097) Building response >Thread-19::DEBUG::2014-09-09 11:50:36,261::__init__::225::IOProcess::(_processLogs) (9097) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:36,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:36,261::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:37,230::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:37,231::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4103::DEBUG::2014-09-09 11:50:37,232::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:37,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:37,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896693 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:50:39,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:39,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899621 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:39,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:39,784::__init__::225::IOProcess::(_processLogs) (9098) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:39,784::__init__::225::IOProcess::(_processLogs) (9098) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:39,785::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|(9098) Building response >Thread-19::DEBUG::2014-09-09 11:50:39,785::__init__::225::IOProcess::(_processLogs) (9098) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:39,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:39,785::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:50:39,786::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:50:39,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105719 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:39,793::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) (9099) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) (9099) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|(9099) Building response >Thread-19::DEBUG::2014-09-09 11:50:39,794::__init__::225::IOProcess::(_processLogs) (9099) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:39,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:39,795::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:40,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:40,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4104::DEBUG::2014-09-09 11:50:40,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:41,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:41,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897577 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:43,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:43,379::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4105::DEBUG::2014-09-09 11:50:43,380::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:43,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:43,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897149 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:44,474::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:44,474::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:44,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:44,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:44,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:44,474::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:44,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:44,475::__init__::225::IOProcess::(_processLogs) (9100) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:44,475::__init__::225::IOProcess::(_processLogs) (9100) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:44,475::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|(9100) Building response >Thread-19::DEBUG::2014-09-09 11:50:44,475::__init__::225::IOProcess::(_processLogs) (9100) Queuing response >Thread-3443::DEBUG::2014-09-09 11:50:44,476::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:44,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:44,481::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:50:44,482::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000871498 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) (9093) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:44,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:44,484::__init__::225::IOProcess::(_processLogs) (9101) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:44,484::__init__::225::IOProcess::(_processLogs) (9101) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:44,484::__init__::225::IOProcess::(_processLogs) (9101) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:44,484::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:45,204::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:45,205::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4106::DEBUG::2014-09-09 11:50:45,205::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4106::DEBUG::2014-09-09 11:50:45,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`afa86490-4880-488b-aac5-1a0329bd4601`::moving from state init -> state preparing >Thread-4106::INFO::2014-09-09 11:50:45,206::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4106::INFO::2014-09-09 11:50:45,206::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4106::DEBUG::2014-09-09 11:50:45,206::task::1191::Storage.TaskManager.Task::(prepare) Task=`afa86490-4880-488b-aac5-1a0329bd4601`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4106::DEBUG::2014-09-09 11:50:45,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`afa86490-4880-488b-aac5-1a0329bd4601`::moving from state preparing -> state finished >Thread-4106::DEBUG::2014-09-09 11:50:45,206::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4106::DEBUG::2014-09-09 11:50:45,206::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4106::DEBUG::2014-09-09 11:50:45,206::task::993::Storage.TaskManager.Task::(_decref) Task=`afa86490-4880-488b-aac5-1a0329bd4601`::ref 0 aborting False >Thread-4106::DEBUG::2014-09-09 11:50:45,207::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4106::DEBUG::2014-09-09 11:50:45,207::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:45,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:45,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4107::DEBUG::2014-09-09 11:50:45,243::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4107::DEBUG::2014-09-09 11:50:45,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff6a6cbc-5c20-4120-b788-a15a033267e8`::moving from state init -> state preparing >Thread-4107::INFO::2014-09-09 11:50:45,244::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4107::DEBUG::2014-09-09 11:50:45,244::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3403301c-6640-43d0-a532-6b29821a0745`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4107::DEBUG::2014-09-09 11:50:45,245::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4107::DEBUG::2014-09-09 11:50:45,245::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4107::DEBUG::2014-09-09 11:50:45,245::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3403301c-6640-43d0-a532-6b29821a0745`::Granted request >Thread-4107::DEBUG::2014-09-09 11:50:45,245::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff6a6cbc-5c20-4120-b788-a15a033267e8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4107::DEBUG::2014-09-09 11:50:45,245::task::993::Storage.TaskManager.Task::(_decref) Task=`ff6a6cbc-5c20-4120-b788-a15a033267e8`::ref 1 aborting False >Thread-4107::INFO::2014-09-09 11:50:45,247::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4107::DEBUG::2014-09-09 11:50:45,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff6a6cbc-5c20-4120-b788-a15a033267e8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4107::DEBUG::2014-09-09 11:50:45,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff6a6cbc-5c20-4120-b788-a15a033267e8`::moving from state preparing -> state finished >Thread-4107::DEBUG::2014-09-09 11:50:45,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4107::DEBUG::2014-09-09 11:50:45,247::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4107::DEBUG::2014-09-09 11:50:45,247::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4107::DEBUG::2014-09-09 11:50:45,247::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4107::DEBUG::2014-09-09 11:50:45,247::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4107::DEBUG::2014-09-09 11:50:45,247::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4107::DEBUG::2014-09-09 11:50:45,248::task::993::Storage.TaskManager.Task::(_decref) Task=`ff6a6cbc-5c20-4120-b788-a15a033267e8`::ref 0 aborting False >Thread-4107::DEBUG::2014-09-09 11:50:45,248::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4107::DEBUG::2014-09-09 11:50:45,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:45,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:46,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897971 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:46,260::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:46,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:46,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:46,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:46,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:46,261::__init__::225::IOProcess::(_processLogs) (9102) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:46,261::__init__::225::IOProcess::(_processLogs) (9102) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:46,262::__init__::225::IOProcess::(_processLogs) (9102) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:46,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:50:46,263::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:50:46,270::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000933276 s, 587 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:46,270::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:46,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:46,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:46,270::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:46,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:46,271::__init__::225::IOProcess::(_processLogs) (9103) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:46,271::__init__::225::IOProcess::(_processLogs) (9103) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:46,271::__init__::225::IOProcess::(_processLogs) (9103) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:46,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) (9104) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:46,272::__init__::225::IOProcess::(_processLogs) (9104) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:46,273::__init__::225::IOProcess::(_processLogs) (9104) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:46,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:46,273::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:50:46,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:46,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:46,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:46,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:46,274::__init__::225::IOProcess::(_processLogs) (9105) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:46,274::__init__::225::IOProcess::(_processLogs) (9105) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:46,274::__init__::225::IOProcess::(_processLogs) (9105) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:46,274::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:46,275::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:50:46,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:46,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:46,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) (9106) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) (9106) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) (9106) Building response >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) (9106) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:46,276::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:46,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:46,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4108::DEBUG::2014-09-09 11:50:46,387::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:48,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:48,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897872 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:49,393::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:49,396::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4109::DEBUG::2014-09-09 11:50:49,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`eda32028-7603-4f07-8d04-b8fda107deb7`::moving from state init -> state preparing >Thread-4109::INFO::2014-09-09 11:50:49,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4109::INFO::2014-09-09 11:50:49,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105719', 'lastCheck': '9.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933276', 'lastCheck': '3.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000871498', 'lastCheck': '4.9', 'valid': True}} >Thread-4109::DEBUG::2014-09-09 11:50:49,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`eda32028-7603-4f07-8d04-b8fda107deb7`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105719', 'lastCheck': '9.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933276', 'lastCheck': '3.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000871498', 'lastCheck': '4.9', 'valid': True}} >Thread-4109::DEBUG::2014-09-09 11:50:49,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`eda32028-7603-4f07-8d04-b8fda107deb7`::moving from state preparing -> state finished >Thread-4109::DEBUG::2014-09-09 11:50:49,405::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4109::DEBUG::2014-09-09 11:50:49,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4109::DEBUG::2014-09-09 11:50:49,407::task::993::Storage.TaskManager.Task::(_decref) Task=`eda32028-7603-4f07-8d04-b8fda107deb7`::ref 0 aborting False >Thread-4109::DEBUG::2014-09-09 11:50:49,413::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:49,421::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:49,422::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4110::DEBUG::2014-09-09 11:50:49,426::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:49,796::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:49,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:49,797::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:49,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:49,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:49,799::__init__::225::IOProcess::(_processLogs) (9107) Finding callback 'statvfs'... >Thread-23::DEBUG::2014-09-09 11:50:49,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:49,800::__init__::225::IOProcess::(_processLogs) (9107) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:49,806::__init__::225::IOProcess::(_processLogs) (9107) Building response >Thread-19::DEBUG::2014-09-09 11:50:49,806::__init__::225::IOProcess::(_processLogs) (9107) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:49,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:49,807::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:50:49,808::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107789 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:49,810::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:49,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:49,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:49,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:49,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:49,813::__init__::225::IOProcess::(_processLogs) (9108) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:49,814::__init__::225::IOProcess::(_processLogs) (9108) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:49,814::__init__::225::IOProcess::(_processLogs) (9108) Building response >Thread-19::DEBUG::2014-09-09 11:50:49,815::__init__::225::IOProcess::(_processLogs) (9108) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:49,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:49,816::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:50:50,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:50,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0947225 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:50:52,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:52,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899057 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:52,640::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:52,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4111::DEBUG::2014-09-09 11:50:52,641::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:54,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:54,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898181 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:54,486::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:54,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:54,487::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:54,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:54,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-3443::DEBUG::2014-09-09 11:50:54,489::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:54,489::__init__::225::IOProcess::(_processLogs) (9109) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:54,494::__init__::225::IOProcess::(_processLogs) (9109) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:54,495::__init__::225::IOProcess::(_processLogs) (9109) Building response >Thread-19::DEBUG::2014-09-09 11:50:54,495::__init__::225::IOProcess::(_processLogs) (9109) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:54,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:50:54,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000797301 s, 445 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:54,497::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:54,498::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:50:54,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:54,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:54,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:54,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:54,501::__init__::225::IOProcess::(_processLogs) (9110) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:54,501::__init__::225::IOProcess::(_processLogs) (9110) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:54,502::__init__::225::IOProcess::(_processLogs) (9110) Building response >Thread-19::DEBUG::2014-09-09 11:50:54,502::__init__::225::IOProcess::(_processLogs) (9110) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:54,502::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:54,503::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:55,496::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:55,496::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4112::DEBUG::2014-09-09 11:50:55,496::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4112::DEBUG::2014-09-09 11:50:55,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`40140d25-4de3-4005-bd06-8917786585c8`::moving from state init -> state preparing >Thread-4112::INFO::2014-09-09 11:50:55,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4112::INFO::2014-09-09 11:50:55,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4112::DEBUG::2014-09-09 11:50:55,498::task::1191::Storage.TaskManager.Task::(prepare) Task=`40140d25-4de3-4005-bd06-8917786585c8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4112::DEBUG::2014-09-09 11:50:55,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`40140d25-4de3-4005-bd06-8917786585c8`::moving from state preparing -> state finished >Thread-4112::DEBUG::2014-09-09 11:50:55,498::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4112::DEBUG::2014-09-09 11:50:55,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4112::DEBUG::2014-09-09 11:50:55,498::task::993::Storage.TaskManager.Task::(_decref) Task=`40140d25-4de3-4005-bd06-8917786585c8`::ref 0 aborting False >Thread-4112::DEBUG::2014-09-09 11:50:55,498::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4112::DEBUG::2014-09-09 11:50:55,498::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:55,527::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:55,527::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4113::DEBUG::2014-09-09 11:50:55,527::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4113::DEBUG::2014-09-09 11:50:55,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`05cb77f7-788e-4f95-a9fa-3bdba3885f58`::moving from state init -> state preparing >Thread-4113::INFO::2014-09-09 11:50:55,528::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4113::DEBUG::2014-09-09 11:50:55,529::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b39bd726-2121-4cb1-a321-12faea4d94ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4113::DEBUG::2014-09-09 11:50:55,529::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4113::DEBUG::2014-09-09 11:50:55,529::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4113::DEBUG::2014-09-09 11:50:55,529::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b39bd726-2121-4cb1-a321-12faea4d94ff`::Granted request >Thread-4113::DEBUG::2014-09-09 11:50:55,529::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`05cb77f7-788e-4f95-a9fa-3bdba3885f58`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4113::DEBUG::2014-09-09 11:50:55,529::task::993::Storage.TaskManager.Task::(_decref) Task=`05cb77f7-788e-4f95-a9fa-3bdba3885f58`::ref 1 aborting False >Thread-4113::INFO::2014-09-09 11:50:55,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4113::DEBUG::2014-09-09 11:50:55,531::task::1191::Storage.TaskManager.Task::(prepare) Task=`05cb77f7-788e-4f95-a9fa-3bdba3885f58`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4113::DEBUG::2014-09-09 11:50:55,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`05cb77f7-788e-4f95-a9fa-3bdba3885f58`::moving from state preparing -> state finished >Thread-4113::DEBUG::2014-09-09 11:50:55,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4113::DEBUG::2014-09-09 11:50:55,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4113::DEBUG::2014-09-09 11:50:55,531::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4113::DEBUG::2014-09-09 11:50:55,531::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4113::DEBUG::2014-09-09 11:50:55,531::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4113::DEBUG::2014-09-09 11:50:55,532::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4113::DEBUG::2014-09-09 11:50:55,532::task::993::Storage.TaskManager.Task::(_decref) Task=`05cb77f7-788e-4f95-a9fa-3bdba3885f58`::ref 0 aborting False >Thread-4113::DEBUG::2014-09-09 11:50:55,532::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4113::DEBUG::2014-09-09 11:50:55,532::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:55,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:55,648::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4114::DEBUG::2014-09-09 11:50:55,649::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) (9111) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:56,276::__init__::225::IOProcess::(_processLogs) (9111) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:56,277::__init__::225::IOProcess::(_processLogs) (9111) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:56,277::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:50:56,277::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:50:56,284::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000908315 s, 603 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) (9112) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:56,285::__init__::225::IOProcess::(_processLogs) (9112) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:56,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9112) Building response >Thread-19::DEBUG::2014-09-09 11:50:56,286::__init__::225::IOProcess::(_processLogs) (9112) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:56,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:50:56,286::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:56,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) (9113) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) (9113) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) (9113) Building response >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) (9113) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:56,288::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) (9114) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) (9114) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) (9114) Building response >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) (9114) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:56,289::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:50:56,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:56,290::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:50:56,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:56,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:56,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:56,290::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) (9115) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) (9115) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) (9115) Building response >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) (9115) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:56,291::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:50:56,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:50:56,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899688 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:50:58,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:50:58,664::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:50:58,665::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4115::DEBUG::2014-09-09 11:50:58,666::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:50:58,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896063 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) (9116) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:59,814::__init__::225::IOProcess::(_processLogs) (9116) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:59,815::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9116) Building response >Thread-23::DEBUG::2014-09-09 11:50:59,815::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:50:59,815::__init__::225::IOProcess::(_processLogs) (9116) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:59,820::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:50:59,820::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:50:59,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104899 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:50:59,823::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:50:59,823::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:50:59,823::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) (9117) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) (9117) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9117) Building response >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) (9117) Queuing response >Thread-19::DEBUG::2014-09-09 11:50:59,824::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:50:59,825::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:51:00,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:00,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897335 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:01,673::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:01,674::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4116::DEBUG::2014-09-09 11:51:01,675::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:02,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:02,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897268 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:04,501::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:04,501::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:04,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:04,501::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:04,501::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:04,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:04,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:04,502::__init__::225::IOProcess::(_processLogs) (9118) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:04,502::__init__::225::IOProcess::(_processLogs) (9118) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:04,502::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9118) Building response >Thread-3443::DEBUG::2014-09-09 11:51:04,503::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:04,504::__init__::225::IOProcess::(_processLogs) (9118) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:04,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:04,509::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:51:04,511::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000824511 s, 431 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:04,511::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:04,511::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:04,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:04,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:04,511::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:04,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) (9119) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) (9119) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9119) Building response >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) (9119) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:04,512::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:04,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:04,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4117::DEBUG::2014-09-09 11:51:04,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7d9ad58-a634-4526-af0f-515d227debc6`::moving from state init -> state preparing >Thread-4117::INFO::2014-09-09 11:51:04,681::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4117::INFO::2014-09-09 11:51:04,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104899', 'lastCheck': '4.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000908315', 'lastCheck': '8.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000824511', 'lastCheck': '0.2', 'valid': True}} >Thread-4117::DEBUG::2014-09-09 11:51:04,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7d9ad58-a634-4526-af0f-515d227debc6`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104899', 'lastCheck': '4.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000908315', 'lastCheck': '8.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000824511', 'lastCheck': '0.2', 'valid': True}} >Thread-4117::DEBUG::2014-09-09 11:51:04,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7d9ad58-a634-4526-af0f-515d227debc6`::moving from state preparing -> state finished >Thread-4117::DEBUG::2014-09-09 11:51:04,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4117::DEBUG::2014-09-09 11:51:04,682::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4117::DEBUG::2014-09-09 11:51:04,682::task::993::Storage.TaskManager.Task::(_decref) Task=`d7d9ad58-a634-4526-af0f-515d227debc6`::ref 0 aborting False >Thread-4117::DEBUG::2014-09-09 11:51:04,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:04,692::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:04,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4118::DEBUG::2014-09-09 11:51:04,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:04,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:05,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899925 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:05,764::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:05,764::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4119::DEBUG::2014-09-09 11:51:05,764::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4119::DEBUG::2014-09-09 11:51:05,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`2449c5ed-8314-4a3f-9382-83bb9bdb65ca`::moving from state init -> state preparing >Thread-4119::INFO::2014-09-09 11:51:05,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4119::INFO::2014-09-09 11:51:05,766::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4119::DEBUG::2014-09-09 11:51:05,766::task::1191::Storage.TaskManager.Task::(prepare) Task=`2449c5ed-8314-4a3f-9382-83bb9bdb65ca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4119::DEBUG::2014-09-09 11:51:05,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`2449c5ed-8314-4a3f-9382-83bb9bdb65ca`::moving from state preparing -> state finished >Thread-4119::DEBUG::2014-09-09 11:51:05,766::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4119::DEBUG::2014-09-09 11:51:05,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4119::DEBUG::2014-09-09 11:51:05,766::task::993::Storage.TaskManager.Task::(_decref) Task=`2449c5ed-8314-4a3f-9382-83bb9bdb65ca`::ref 0 aborting False >Thread-4119::DEBUG::2014-09-09 11:51:05,766::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4119::DEBUG::2014-09-09 11:51:05,766::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:05,828::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:05,829::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4120::DEBUG::2014-09-09 11:51:05,829::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4120::DEBUG::2014-09-09 11:51:05,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`237191f3-ffb7-4c90-afa2-1d714e570bba`::moving from state init -> state preparing >Thread-4120::INFO::2014-09-09 11:51:05,829::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4120::DEBUG::2014-09-09 11:51:05,831::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`5bff804b-831d-4035-af71-9bb582072d94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4120::DEBUG::2014-09-09 11:51:05,831::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4120::DEBUG::2014-09-09 11:51:05,831::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4120::DEBUG::2014-09-09 11:51:05,831::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`5bff804b-831d-4035-af71-9bb582072d94`::Granted request >Thread-4120::DEBUG::2014-09-09 11:51:05,831::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`237191f3-ffb7-4c90-afa2-1d714e570bba`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4120::DEBUG::2014-09-09 11:51:05,831::task::993::Storage.TaskManager.Task::(_decref) Task=`237191f3-ffb7-4c90-afa2-1d714e570bba`::ref 1 aborting False >Thread-4120::INFO::2014-09-09 11:51:05,833::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4120::DEBUG::2014-09-09 11:51:05,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`237191f3-ffb7-4c90-afa2-1d714e570bba`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4120::DEBUG::2014-09-09 11:51:05,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`237191f3-ffb7-4c90-afa2-1d714e570bba`::moving from state preparing -> state finished >Thread-4120::DEBUG::2014-09-09 11:51:05,833::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4120::DEBUG::2014-09-09 11:51:05,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4120::DEBUG::2014-09-09 11:51:05,833::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4120::DEBUG::2014-09-09 11:51:05,833::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4120::DEBUG::2014-09-09 11:51:05,834::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4120::DEBUG::2014-09-09 11:51:05,834::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4120::DEBUG::2014-09-09 11:51:05,834::task::993::Storage.TaskManager.Task::(_decref) Task=`237191f3-ffb7-4c90-afa2-1d714e570bba`::ref 0 aborting False >Thread-4120::DEBUG::2014-09-09 11:51:05,834::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4120::DEBUG::2014-09-09 11:51:05,834::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) (9120) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) (9120) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:06,291::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|(9120) Building response >Thread-19::DEBUG::2014-09-09 11:51:06,292::__init__::225::IOProcess::(_processLogs) (9120) Queuing response >Thread-24::DEBUG::2014-09-09 11:51:06,292::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:06,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:06,297::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:51:06,300::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000953713 s, 575 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Sending response sized 244DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) (9121) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) (9121) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) (9121) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:06,301::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:06,302::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:51:06,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:06,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) (9122) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) (9122) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) (9122) Building response >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) (9122) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:06,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) (9123) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) (9123) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) (9123) Building response >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) (9123) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:06,304::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) (9124) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) (9124) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) (9124) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:06,305::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:51:07,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:07,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090569 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:08,225::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:08,226::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4121::DEBUG::2014-09-09 11:51:08,227::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:09,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:09,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899882 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) (9125) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:09,826::__init__::225::IOProcess::(_processLogs) (9125) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:09,827::__init__::225::IOProcess::(_processLogs) (9125) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:09,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:51:09,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:51:09,835::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109795 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:09,835::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:09,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:09,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) (9126) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) (9126) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) DEBUG|(9126) Building response >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) (9126) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:09,836::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:09,837::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:11,234::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:11,235::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4122::DEBUG::2014-09-09 11:51:11,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:11,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:11,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896396 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:51:13,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:13,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896056 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:14,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:14,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4123::DEBUG::2014-09-09 11:51:14,244::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:14,513::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:14,513::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:14,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) (9127) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) (9127) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:14,514::__init__::225::IOProcess::(_processLogs) DEBUG|(9127) Building response >Thread-3443::DEBUG::2014-09-09 11:51:14,515::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:14,515::__init__::225::IOProcess::(_processLogs) (9127) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:14,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:14,520::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:51:14,522::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000847836 s, 419 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:14,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:14,522::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) (9128) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) (9128) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) DEBUG|(9128) Building response >Thread-19::DEBUG::2014-09-09 11:51:14,523::__init__::225::IOProcess::(_processLogs) (9128) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:14,524::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:14,524::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:51:15,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:15,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897724 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:16,214::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4124::DEBUG::2014-09-09 11:51:16,214::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:51:16,215::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4124::DEBUG::2014-09-09 11:51:16,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`91b85aa4-5b6a-4b9c-8e7e-751564ce5a17`::moving from state init -> state preparing >Thread-4124::INFO::2014-09-09 11:51:16,216::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4124::INFO::2014-09-09 11:51:16,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4124::DEBUG::2014-09-09 11:51:16,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`91b85aa4-5b6a-4b9c-8e7e-751564ce5a17`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4124::DEBUG::2014-09-09 11:51:16,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`91b85aa4-5b6a-4b9c-8e7e-751564ce5a17`::moving from state preparing -> state finished >Thread-4124::DEBUG::2014-09-09 11:51:16,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4124::DEBUG::2014-09-09 11:51:16,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4124::DEBUG::2014-09-09 11:51:16,217::task::993::Storage.TaskManager.Task::(_decref) Task=`91b85aa4-5b6a-4b9c-8e7e-751564ce5a17`::ref 0 aborting False >Thread-4124::DEBUG::2014-09-09 11:51:16,217::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4124::DEBUG::2014-09-09 11:51:16,217::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:16,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:16,246::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4125::DEBUG::2014-09-09 11:51:16,246::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4125::DEBUG::2014-09-09 11:51:16,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4a54cd0-1da3-468b-950d-12deecc20607`::moving from state init -> state preparing >Thread-4125::INFO::2014-09-09 11:51:16,247::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4125::DEBUG::2014-09-09 11:51:16,247::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c8f01100-1f03-4b89-8f95-062b8fd26d8d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4125::DEBUG::2014-09-09 11:51:16,247::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4125::DEBUG::2014-09-09 11:51:16,247::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4125::DEBUG::2014-09-09 11:51:16,247::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c8f01100-1f03-4b89-8f95-062b8fd26d8d`::Granted request >Thread-4125::DEBUG::2014-09-09 11:51:16,248::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a4a54cd0-1da3-468b-950d-12deecc20607`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4125::DEBUG::2014-09-09 11:51:16,248::task::993::Storage.TaskManager.Task::(_decref) Task=`a4a54cd0-1da3-468b-950d-12deecc20607`::ref 1 aborting False >Thread-4125::INFO::2014-09-09 11:51:16,249::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4125::DEBUG::2014-09-09 11:51:16,249::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4a54cd0-1da3-468b-950d-12deecc20607`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4125::DEBUG::2014-09-09 11:51:16,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4a54cd0-1da3-468b-950d-12deecc20607`::moving from state preparing -> state finished >Thread-4125::DEBUG::2014-09-09 11:51:16,250::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4125::DEBUG::2014-09-09 11:51:16,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4125::DEBUG::2014-09-09 11:51:16,250::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4125::DEBUG::2014-09-09 11:51:16,250::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4125::DEBUG::2014-09-09 11:51:16,250::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4125::DEBUG::2014-09-09 11:51:16,250::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4125::DEBUG::2014-09-09 11:51:16,250::task::993::Storage.TaskManager.Task::(_decref) Task=`a4a54cd0-1da3-468b-950d-12deecc20607`::ref 0 aborting False >Thread-4125::DEBUG::2014-09-09 11:51:16,250::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4125::DEBUG::2014-09-09 11:51:16,251::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:16,306::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:16,306::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:16,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:16,307::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:16,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:16,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:16,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:16,307::__init__::225::IOProcess::(_processLogs) (9129) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:16,307::__init__::225::IOProcess::(_processLogs) (9129) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:16,308::__init__::225::IOProcess::(_processLogs) DEBUG|(9129) Building response >Thread-19::DEBUG::2014-09-09 11:51:16,308::__init__::225::IOProcess::(_processLogs) (9129) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:16,308::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:51:16,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:16,309::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:51:16,318::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000912577 s, 600 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:16,318::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:16,318::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:16,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:16,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) (9130) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) (9130) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) DEBUG|(9130) Building response >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) (9130) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:16,319::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:16,320::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:51:16,320::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:16,320::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:51:16,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:16,320::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) (9131) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) (9131) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) (9131) Building response >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) (9131) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:16,321::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) (9132) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:16,322::__init__::225::IOProcess::(_processLogs) (9132) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) (9132) Building response >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) (9132) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:16,323::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) (9133) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) (9133) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) (9133) Building response >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) (9133) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:16,324::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:17,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:17,253::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4126::DEBUG::2014-09-09 11:51:17,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:17,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:17,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898888 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:51:19,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:19,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0954949 s, 10.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:19,838::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:19,839::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:19,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:19,840::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:19,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:19,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:19,841::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-23::DEBUG::2014-09-09 11:51:19,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:19,842::__init__::225::IOProcess::(_processLogs) (9134) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:19,848::__init__::225::IOProcess::(_processLogs) (9134) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:19,848::__init__::225::IOProcess::(_processLogs) (9134) Building response >Thread-19::DEBUG::2014-09-09 11:51:19,849::__init__::225::IOProcess::(_processLogs) (9134) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:19,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:19,850::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:51:19,850::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112805 s, 996 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:19,852::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:19,852::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:19,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:19,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:19,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:19,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:19,855::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:19,856::__init__::225::IOProcess::(_processLogs) (9135) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:19,857::__init__::225::IOProcess::(_processLogs) (9135) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:19,857::__init__::225::IOProcess::(_processLogs) (9135) Building response >Thread-19::DEBUG::2014-09-09 11:51:19,858::__init__::225::IOProcess::(_processLogs) (9135) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:19,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:19,859::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:20,261::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:20,262::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4127::DEBUG::2014-09-09 11:51:20,266::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1359cbf-7345-40f4-b38b-87f2699aa2f5`::moving from state init -> state preparing >Thread-4127::INFO::2014-09-09 11:51:20,266::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4127::INFO::2014-09-09 11:51:20,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112805', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000912577', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000847836', 'lastCheck': '5.7', 'valid': True}} >Thread-4127::DEBUG::2014-09-09 11:51:20,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1359cbf-7345-40f4-b38b-87f2699aa2f5`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112805', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000912577', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000847836', 'lastCheck': '5.7', 'valid': True}} >Thread-4127::DEBUG::2014-09-09 11:51:20,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1359cbf-7345-40f4-b38b-87f2699aa2f5`::moving from state preparing -> state finished >Thread-4127::DEBUG::2014-09-09 11:51:20,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4127::DEBUG::2014-09-09 11:51:20,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4127::DEBUG::2014-09-09 11:51:20,269::task::993::Storage.TaskManager.Task::(_decref) Task=`e1359cbf-7345-40f4-b38b-87f2699aa2f5`::ref 0 aborting False >Thread-4127::DEBUG::2014-09-09 11:51:20,273::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:20,280::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:20,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4128::DEBUG::2014-09-09 11:51:20,284::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:21,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:21,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895668 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:23,361::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:23,361::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4129::DEBUG::2014-09-09 11:51:23,362::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:23,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:24,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089745 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) (9136) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:24,525::__init__::225::IOProcess::(_processLogs) (9136) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:24,526::__init__::225::IOProcess::(_processLogs) DEBUG|(9136) Building response >Thread-19::DEBUG::2014-09-09 11:51:24,526::__init__::225::IOProcess::(_processLogs) (9136) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:24,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:24,526::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:51:24,526::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:51:24,533::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00087015 s, 408 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:24,533::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:24,533::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:24,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:24,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) (9137) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) (9137) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) DEBUG|(9137) Building response >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) (9137) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:24,534::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:24,535::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:51:26,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:26,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089704 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:26,324::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:26,324::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:26,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) (9138) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) (9138) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) DEBUG|(9138) Building response >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) (9138) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:26,325::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:51:26,326::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:51:26,333::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000941811 s, 582 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:26,334::__init__::225::IOProcess::(_processLogs) (9139) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:26,335::__init__::225::IOProcess::(_processLogs) (9139) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:26,335::__init__::225::IOProcess::(_processLogs) DEBUG|(9139) Building response >Thread-19::DEBUG::2014-09-09 11:51:26,335::__init__::225::IOProcess::(_processLogs) (9139) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:26,335::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:26,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) (9140) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) (9140) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) (9140) Building response >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) (9140) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:51:26,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) (9141) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) (9141) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) (9141) Building response >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) (9141) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:26,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:26,339::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:26,339::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:26,339::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:51:26,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:26,339::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) (9142) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) (9142) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) (9142) Building response >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) (9142) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:26,340::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:26,356::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:26,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4130::DEBUG::2014-09-09 11:51:26,357::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4130::DEBUG::2014-09-09 11:51:26,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`48005514-caa8-4de7-b5bc-2bdb37bc6926`::moving from state init -> state preparing >Thread-4130::INFO::2014-09-09 11:51:26,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4130::INFO::2014-09-09 11:51:26,358::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4130::DEBUG::2014-09-09 11:51:26,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`48005514-caa8-4de7-b5bc-2bdb37bc6926`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4130::DEBUG::2014-09-09 11:51:26,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`48005514-caa8-4de7-b5bc-2bdb37bc6926`::moving from state preparing -> state finished >Thread-4130::DEBUG::2014-09-09 11:51:26,359::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4130::DEBUG::2014-09-09 11:51:26,359::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4130::DEBUG::2014-09-09 11:51:26,359::task::993::Storage.TaskManager.Task::(_decref) Task=`48005514-caa8-4de7-b5bc-2bdb37bc6926`::ref 0 aborting False >Thread-4130::DEBUG::2014-09-09 11:51:26,359::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4130::DEBUG::2014-09-09 11:51:26,359::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:26,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:26,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4131::DEBUG::2014-09-09 11:51:26,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:26,396::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:26,396::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4132::DEBUG::2014-09-09 11:51:26,397::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4132::DEBUG::2014-09-09 11:51:26,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ab27900-6dd0-46e4-a9ee-538fa1258249`::moving from state init -> state preparing >Thread-4132::INFO::2014-09-09 11:51:26,397::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4132::DEBUG::2014-09-09 11:51:26,398::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8aa8e191-7ec6-45d6-8e11-7d8f21c3eb1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4132::DEBUG::2014-09-09 11:51:26,398::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4132::DEBUG::2014-09-09 11:51:26,398::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4132::DEBUG::2014-09-09 11:51:26,398::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8aa8e191-7ec6-45d6-8e11-7d8f21c3eb1d`::Granted request >Thread-4132::DEBUG::2014-09-09 11:51:26,398::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6ab27900-6dd0-46e4-a9ee-538fa1258249`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4132::DEBUG::2014-09-09 11:51:26,398::task::993::Storage.TaskManager.Task::(_decref) Task=`6ab27900-6dd0-46e4-a9ee-538fa1258249`::ref 1 aborting False >Thread-4132::INFO::2014-09-09 11:51:26,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4132::DEBUG::2014-09-09 11:51:26,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ab27900-6dd0-46e4-a9ee-538fa1258249`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4132::DEBUG::2014-09-09 11:51:26,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ab27900-6dd0-46e4-a9ee-538fa1258249`::moving from state preparing -> state finished >Thread-4132::DEBUG::2014-09-09 11:51:26,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4132::DEBUG::2014-09-09 11:51:26,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4132::DEBUG::2014-09-09 11:51:26,400::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4132::DEBUG::2014-09-09 11:51:26,400::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4132::DEBUG::2014-09-09 11:51:26,400::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4132::DEBUG::2014-09-09 11:51:26,401::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4132::DEBUG::2014-09-09 11:51:26,401::task::993::Storage.TaskManager.Task::(_decref) Task=`6ab27900-6dd0-46e4-a9ee-538fa1258249`::ref 0 aborting False >Thread-4132::DEBUG::2014-09-09 11:51:26,401::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4132::DEBUG::2014-09-09 11:51:26,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:28,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:28,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898333 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:29,377::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:29,378::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4133::DEBUG::2014-09-09 11:51:29,379::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:29,856::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) (9143) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) (9143) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) DEBUG|(9143) Building response >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) (9143) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:29,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:29,858::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:51:29,858::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:51:29,865::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110349 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:29,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:29,865::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:29,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) (9144) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) (9144) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) DEBUG|(9144) Building response >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) (9144) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:29,866::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:29,867::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:51:30,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:30,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896956 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:51:32,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:32,393::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:32,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4134::DEBUG::2014-09-09 11:51:32,394::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:32,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089727 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:51:34,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) (9145) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:34,536::__init__::225::IOProcess::(_processLogs) (9145) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:34,550::__init__::225::IOProcess::(_processLogs) DEBUG|(9145) Building response >Dummy-97::DEBUG::2014-09-09 11:51:34,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897592 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:34,551::__init__::225::IOProcess::(_processLogs) (9145) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:34,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:34,552::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:51:34,553::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:51:34,560::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000860104 s, 413 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:34,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:34,562::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:34,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:34,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:34,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:34,564::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:34,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:34,566::__init__::225::IOProcess::(_processLogs) (9146) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:34,566::__init__::225::IOProcess::(_processLogs) (9146) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:34,566::__init__::225::IOProcess::(_processLogs) (9146) Building response >Thread-19::DEBUG::2014-09-09 11:51:34,567::__init__::225::IOProcess::(_processLogs) (9146) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:34,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:34,567::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:35,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:35,400::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4135::DEBUG::2014-09-09 11:51:35,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`1909860f-b4ee-4266-83bd-bed483a9cb2c`::moving from state init -> state preparing >Thread-4135::INFO::2014-09-09 11:51:35,401::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4135::INFO::2014-09-09 11:51:35,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110349', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000941811', 'lastCheck': '9.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000860104', 'lastCheck': '0.8', 'valid': True}} >Thread-4135::DEBUG::2014-09-09 11:51:35,402::task::1191::Storage.TaskManager.Task::(prepare) Task=`1909860f-b4ee-4266-83bd-bed483a9cb2c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110349', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000941811', 'lastCheck': '9.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000860104', 'lastCheck': '0.8', 'valid': True}} >Thread-4135::DEBUG::2014-09-09 11:51:35,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`1909860f-b4ee-4266-83bd-bed483a9cb2c`::moving from state preparing -> state finished >Thread-4135::DEBUG::2014-09-09 11:51:35,402::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4135::DEBUG::2014-09-09 11:51:35,402::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4135::DEBUG::2014-09-09 11:51:35,402::task::993::Storage.TaskManager.Task::(_decref) Task=`1909860f-b4ee-4266-83bd-bed483a9cb2c`::ref 0 aborting False >Thread-4135::DEBUG::2014-09-09 11:51:35,403::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:35,410::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:35,411::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4136::DEBUG::2014-09-09 11:51:35,411::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:36,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:36,341::__init__::225::IOProcess::(_processLogs) (9147) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:36,341::__init__::225::IOProcess::(_processLogs) (9147) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:36,341::__init__::225::IOProcess::(_processLogs) DEBUG|(9147) Building response >Thread-24::DEBUG::2014-09-09 11:51:36,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:36,342::__init__::225::IOProcess::(_processLogs) (9147) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:36,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:36,347::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:51:36,349::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000916618 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:36,349::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:36,349::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) (9148) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) (9148) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) DEBUG|(9148) Building response >Thread-19::DEBUG::2014-09-09 11:51:36,350::__init__::225::IOProcess::(_processLogs) (9148) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:36,351::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:51:36,351::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:51:36,351::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:36,351::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:51:36,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) (9149) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) (9149) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) (9149) Building response >Thread-19::DEBUG::2014-09-09 11:51:36,352::__init__::225::IOProcess::(_processLogs) (9149) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:36,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) (9150) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) (9150) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) (9150) Building response >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) (9150) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:51:36,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) (9151) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) (9151) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) (9151) Building response >Thread-19::DEBUG::2014-09-09 11:51:36,355::__init__::225::IOProcess::(_processLogs) (9151) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:36,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:36,356::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:36,447::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4137::DEBUG::2014-09-09 11:51:36,447::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:51:36,447::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4137::DEBUG::2014-09-09 11:51:36,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e1cad1-c9f7-4737-aceb-e601724c03cf`::moving from state init -> state preparing >Thread-4137::INFO::2014-09-09 11:51:36,449::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4137::INFO::2014-09-09 11:51:36,449::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4137::DEBUG::2014-09-09 11:51:36,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`80e1cad1-c9f7-4737-aceb-e601724c03cf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4137::DEBUG::2014-09-09 11:51:36,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`80e1cad1-c9f7-4737-aceb-e601724c03cf`::moving from state preparing -> state finished >Thread-4137::DEBUG::2014-09-09 11:51:36,449::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4137::DEBUG::2014-09-09 11:51:36,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4137::DEBUG::2014-09-09 11:51:36,449::task::993::Storage.TaskManager.Task::(_decref) Task=`80e1cad1-c9f7-4737-aceb-e601724c03cf`::ref 0 aborting False >Thread-4137::DEBUG::2014-09-09 11:51:36,449::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4137::DEBUG::2014-09-09 11:51:36,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:36,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4138::DEBUG::2014-09-09 11:51:36,464::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:51:36,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4138::DEBUG::2014-09-09 11:51:36,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a323713-d3b1-4d6f-b16d-d1b35d87bb58`::moving from state init -> state preparing >Thread-4138::INFO::2014-09-09 11:51:36,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4138::DEBUG::2014-09-09 11:51:36,465::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`84a51dfd-0993-4e1a-9c54-987ee976b053`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4138::DEBUG::2014-09-09 11:51:36,465::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4138::DEBUG::2014-09-09 11:51:36,466::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4138::DEBUG::2014-09-09 11:51:36,466::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`84a51dfd-0993-4e1a-9c54-987ee976b053`::Granted request >Thread-4138::DEBUG::2014-09-09 11:51:36,466::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5a323713-d3b1-4d6f-b16d-d1b35d87bb58`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4138::DEBUG::2014-09-09 11:51:36,466::task::993::Storage.TaskManager.Task::(_decref) Task=`5a323713-d3b1-4d6f-b16d-d1b35d87bb58`::ref 1 aborting False >Thread-4138::INFO::2014-09-09 11:51:36,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4138::DEBUG::2014-09-09 11:51:36,468::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a323713-d3b1-4d6f-b16d-d1b35d87bb58`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4138::DEBUG::2014-09-09 11:51:36,468::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a323713-d3b1-4d6f-b16d-d1b35d87bb58`::moving from state preparing -> state finished >Thread-4138::DEBUG::2014-09-09 11:51:36,468::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4138::DEBUG::2014-09-09 11:51:36,468::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4138::DEBUG::2014-09-09 11:51:36,468::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4138::DEBUG::2014-09-09 11:51:36,468::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4138::DEBUG::2014-09-09 11:51:36,468::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4138::DEBUG::2014-09-09 11:51:36,468::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4138::DEBUG::2014-09-09 11:51:36,468::task::993::Storage.TaskManager.Task::(_decref) Task=`5a323713-d3b1-4d6f-b16d-d1b35d87bb58`::ref 0 aborting False >Thread-4138::DEBUG::2014-09-09 11:51:36,469::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283249737728', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4138::DEBUG::2014-09-09 11:51:36,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:36,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:36,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896066 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:38,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:38,489::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4139::DEBUG::2014-09-09 11:51:38,490::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:38,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:38,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897986 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) (9152) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:39,868::__init__::225::IOProcess::(_processLogs) (9152) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:39,869::__init__::225::IOProcess::(_processLogs) DEBUG|(9152) Building response >Thread-19::DEBUG::2014-09-09 11:51:39,869::__init__::225::IOProcess::(_processLogs) (9152) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:39,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:51:39,870::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:39,870::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:51:39,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0012231 s, 918 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:39,879::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:39,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:39,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:39,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:39,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:39,880::__init__::225::IOProcess::(_processLogs) (9153) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:39,880::__init__::225::IOProcess::(_processLogs) (9153) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:39,880::__init__::225::IOProcess::(_processLogs) (9153) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:39,881::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:51:40,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:40,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089761 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:41,535::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:41,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4140::DEBUG::2014-09-09 11:51:41,536::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:42,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:42,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904988 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:44,543::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:44,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4141::DEBUG::2014-09-09 11:51:44,545::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) (9154) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:44,566::__init__::225::IOProcess::(_processLogs) (9154) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:44,567::__init__::225::IOProcess::(_processLogs) (9154) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:44,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:51:44,567::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:51:44,573::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000892267 s, 398 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) (9155) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:44,574::__init__::225::IOProcess::(_processLogs) (9155) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:44,575::__init__::225::IOProcess::(_processLogs) (9155) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:44,575::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:51:44,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:45,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897016 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:46,355::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:46,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:46,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:46,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:46,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:46,356::__init__::225::IOProcess::(_processLogs) (9156) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:46,356::__init__::225::IOProcess::(_processLogs) (9156) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:46,357::__init__::225::IOProcess::(_processLogs) (9156) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:46,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:51:46,357::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:51:46,365::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00108654 s, 504 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) (9157) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:46,366::__init__::225::IOProcess::(_processLogs) (9157) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:46,367::__init__::225::IOProcess::(_processLogs) (9157) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:46,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:46,367::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:51:46,367::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:46,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:46,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:46,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:46,368::__init__::225::IOProcess::(_processLogs) (9158) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:46,368::__init__::225::IOProcess::(_processLogs) (9158) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:46,368::__init__::225::IOProcess::(_processLogs) (9158) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:46,368::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) (9159) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:46,369::__init__::225::IOProcess::(_processLogs) (9159) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:46,370::__init__::225::IOProcess::(_processLogs) (9159) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:46,370::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:46,370::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:51:46,370::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) (9160) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) (9160) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) (9160) Building response >Thread-19::DEBUG::2014-09-09 11:51:46,371::__init__::225::IOProcess::(_processLogs) (9160) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:46,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:46,372::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:46,508::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:46,509::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4142::DEBUG::2014-09-09 11:51:46,509::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4142::DEBUG::2014-09-09 11:51:46,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b7faec2-88d7-4493-94f6-0d7d9d8ba05d`::moving from state init -> state preparing >Thread-4142::INFO::2014-09-09 11:51:46,510::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4142::INFO::2014-09-09 11:51:46,510::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4142::DEBUG::2014-09-09 11:51:46,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b7faec2-88d7-4493-94f6-0d7d9d8ba05d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4142::DEBUG::2014-09-09 11:51:46,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b7faec2-88d7-4493-94f6-0d7d9d8ba05d`::moving from state preparing -> state finished >Thread-4142::DEBUG::2014-09-09 11:51:46,510::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4142::DEBUG::2014-09-09 11:51:46,510::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4142::DEBUG::2014-09-09 11:51:46,510::task::993::Storage.TaskManager.Task::(_decref) Task=`9b7faec2-88d7-4493-94f6-0d7d9d8ba05d`::ref 0 aborting False >Thread-4142::DEBUG::2014-09-09 11:51:46,511::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4142::DEBUG::2014-09-09 11:51:46,511::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:46,616::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:46,617::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4143::DEBUG::2014-09-09 11:51:46,617::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4143::DEBUG::2014-09-09 11:51:46,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ccf1a8c-382d-4934-a9c7-a4858f9aff0e`::moving from state init -> state preparing >Thread-4143::INFO::2014-09-09 11:51:46,617::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4143::DEBUG::2014-09-09 11:51:46,618::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`508dfc98-6b03-4690-9660-38c6d22a8e0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4143::DEBUG::2014-09-09 11:51:46,618::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4143::DEBUG::2014-09-09 11:51:46,618::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4143::DEBUG::2014-09-09 11:51:46,618::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`508dfc98-6b03-4690-9660-38c6d22a8e0e`::Granted request >Thread-4143::DEBUG::2014-09-09 11:51:46,618::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7ccf1a8c-382d-4934-a9c7-a4858f9aff0e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4143::DEBUG::2014-09-09 11:51:46,618::task::993::Storage.TaskManager.Task::(_decref) Task=`7ccf1a8c-382d-4934-a9c7-a4858f9aff0e`::ref 1 aborting False >Thread-4143::INFO::2014-09-09 11:51:46,620::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4143::DEBUG::2014-09-09 11:51:46,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ccf1a8c-382d-4934-a9c7-a4858f9aff0e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4143::DEBUG::2014-09-09 11:51:46,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ccf1a8c-382d-4934-a9c7-a4858f9aff0e`::moving from state preparing -> state finished >Thread-4143::DEBUG::2014-09-09 11:51:46,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4143::DEBUG::2014-09-09 11:51:46,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4143::DEBUG::2014-09-09 11:51:46,620::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4143::DEBUG::2014-09-09 11:51:46,621::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4143::DEBUG::2014-09-09 11:51:46,621::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4143::DEBUG::2014-09-09 11:51:46,621::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4143::DEBUG::2014-09-09 11:51:46,621::task::993::Storage.TaskManager.Task::(_decref) Task=`7ccf1a8c-382d-4934-a9c7-a4858f9aff0e`::ref 0 aborting False >Thread-4143::DEBUG::2014-09-09 11:51:46,621::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4143::DEBUG::2014-09-09 11:51:46,621::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:47,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:47,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903406 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:47,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:47,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4144::DEBUG::2014-09-09 11:51:47,553::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:49,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:49,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896364 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:49,882::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:49,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:49,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:49,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-23::DEBUG::2014-09-09 11:51:49,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:51:49,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:49,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:49,891::__init__::225::IOProcess::(_processLogs) (9161) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:49,892::__init__::225::IOProcess::(_processLogs) (9161) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:49,892::__init__::225::IOProcess::(_processLogs) (9161) Building response >Thread-19::DEBUG::2014-09-09 11:51:49,893::__init__::225::IOProcess::(_processLogs) (9161) Queuing response >Thread-23::DEBUG::2014-09-09 11:51:49,893::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0012558 s, 894 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:49,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:49,895::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:51:49,896::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:49,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:49,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:49,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:49,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:49,898::__init__::225::IOProcess::(_processLogs) (9162) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:49,900::__init__::225::IOProcess::(_processLogs) (9162) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:49,900::__init__::225::IOProcess::(_processLogs) (9162) Building response >Thread-19::DEBUG::2014-09-09 11:51:49,900::__init__::225::IOProcess::(_processLogs) (9162) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:49,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:49,901::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:50,564::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:50,565::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4145::DEBUG::2014-09-09 11:51:50,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`8475410f-0643-4968-9201-db02df537305`::moving from state init -> state preparing >Thread-4145::INFO::2014-09-09 11:51:50,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4145::INFO::2014-09-09 11:51:50,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0012558', 'lastCheck': '0.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108654', 'lastCheck': '4.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000892267', 'lastCheck': '6.0', 'valid': True}} >Thread-4145::DEBUG::2014-09-09 11:51:50,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`8475410f-0643-4968-9201-db02df537305`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0012558', 'lastCheck': '0.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108654', 'lastCheck': '4.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000892267', 'lastCheck': '6.0', 'valid': True}} >Thread-4145::DEBUG::2014-09-09 11:51:50,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`8475410f-0643-4968-9201-db02df537305`::moving from state preparing -> state finished >Thread-4145::DEBUG::2014-09-09 11:51:50,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4145::DEBUG::2014-09-09 11:51:50,567::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4145::DEBUG::2014-09-09 11:51:50,567::task::993::Storage.TaskManager.Task::(_decref) Task=`8475410f-0643-4968-9201-db02df537305`::ref 0 aborting False >Thread-4145::DEBUG::2014-09-09 11:51:50,567::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:50,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:50,584::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4146::DEBUG::2014-09-09 11:51:50,584::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:51,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:51,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901848 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:51:53,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:53,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897634 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:53,656::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:53,657::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4147::DEBUG::2014-09-09 11:51:53,658::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) (9163) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:54,576::__init__::225::IOProcess::(_processLogs) (9163) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:54,577::__init__::225::IOProcess::(_processLogs) (9163) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:54,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:51:54,577::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:51:54,584::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00103472 s, 343 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) (9164) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:54,585::__init__::225::IOProcess::(_processLogs) (9164) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:54,586::__init__::225::IOProcess::(_processLogs) (9164) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:54,586::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:51:55,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:55,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904398 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) (9165) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) (9165) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:56,372::__init__::225::IOProcess::(_processLogs) (9165) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:56,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:51:56,373::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:51:56,380::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104987 s, 522 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) (9166) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:56,381::__init__::225::IOProcess::(_processLogs) (9166) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:56,382::__init__::225::IOProcess::(_processLogs) (9166) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:56,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:56,382::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:51:56,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) (9167) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) (9167) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) (9167) Building response >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) (9167) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:56,383::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:56,384::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:51:56,384::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:56,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:56,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:56,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:56,384::__init__::225::IOProcess::(_processLogs) (9168) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) (9168) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) (9168) Building response >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) (9168) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:56,385::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) (9169) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) (9169) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) (9169) Building response >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) (9169) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:56,386::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:56,669::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:56,670::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4148::DEBUG::2014-09-09 11:51:56,671::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:56,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:56,884::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4149::DEBUG::2014-09-09 11:51:56,884::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4149::DEBUG::2014-09-09 11:51:56,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`a73dc548-476e-480e-b231-e11e7297be54`::moving from state init -> state preparing >Thread-4149::INFO::2014-09-09 11:51:56,885::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4149::INFO::2014-09-09 11:51:56,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4149::DEBUG::2014-09-09 11:51:56,886::task::1191::Storage.TaskManager.Task::(prepare) Task=`a73dc548-476e-480e-b231-e11e7297be54`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4149::DEBUG::2014-09-09 11:51:56,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`a73dc548-476e-480e-b231-e11e7297be54`::moving from state preparing -> state finished >Thread-4149::DEBUG::2014-09-09 11:51:56,886::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4149::DEBUG::2014-09-09 11:51:56,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4149::DEBUG::2014-09-09 11:51:56,886::task::993::Storage.TaskManager.Task::(_decref) Task=`a73dc548-476e-480e-b231-e11e7297be54`::ref 0 aborting False >Thread-4149::DEBUG::2014-09-09 11:51:56,886::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4149::DEBUG::2014-09-09 11:51:56,886::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:56,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4150::DEBUG::2014-09-09 11:51:56,933::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:51:56,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4150::DEBUG::2014-09-09 11:51:56,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`caa30533-dccc-499c-bcb2-b1467877dd75`::moving from state init -> state preparing >Thread-4150::INFO::2014-09-09 11:51:56,934::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4150::DEBUG::2014-09-09 11:51:56,934::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ba32258f-6c2b-4607-93ba-0e53af24cf83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4150::DEBUG::2014-09-09 11:51:56,934::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4150::DEBUG::2014-09-09 11:51:56,935::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4150::DEBUG::2014-09-09 11:51:56,935::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ba32258f-6c2b-4607-93ba-0e53af24cf83`::Granted request >Thread-4150::DEBUG::2014-09-09 11:51:56,935::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`caa30533-dccc-499c-bcb2-b1467877dd75`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4150::DEBUG::2014-09-09 11:51:56,935::task::993::Storage.TaskManager.Task::(_decref) Task=`caa30533-dccc-499c-bcb2-b1467877dd75`::ref 1 aborting False >Thread-4150::INFO::2014-09-09 11:51:56,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4150::DEBUG::2014-09-09 11:51:56,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`caa30533-dccc-499c-bcb2-b1467877dd75`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4150::DEBUG::2014-09-09 11:51:56,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`caa30533-dccc-499c-bcb2-b1467877dd75`::moving from state preparing -> state finished >Thread-4150::DEBUG::2014-09-09 11:51:56,937::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4150::DEBUG::2014-09-09 11:51:56,937::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4150::DEBUG::2014-09-09 11:51:56,937::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4150::DEBUG::2014-09-09 11:51:56,937::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4150::DEBUG::2014-09-09 11:51:56,937::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4150::DEBUG::2014-09-09 11:51:56,937::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4150::DEBUG::2014-09-09 11:51:56,937::task::993::Storage.TaskManager.Task::(_decref) Task=`caa30533-dccc-499c-bcb2-b1467877dd75`::ref 0 aborting False >Thread-4150::DEBUG::2014-09-09 11:51:56,938::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4150::DEBUG::2014-09-09 11:51:56,938::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:57,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:57,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904012 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:51:59,683::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:51:59,684::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4151::DEBUG::2014-09-09 11:51:59,685::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:51:59,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:51:59,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896557 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) (9170) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:59,900::__init__::225::IOProcess::(_processLogs) (9170) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:59,901::__init__::225::IOProcess::(_processLogs) (9170) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:59,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:51:59,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:51:59,909::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116549 s, 964 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:51:59,909::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:51:59,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:51:59,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:51:59,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:51:59,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:51:59,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:51:59,910::__init__::225::IOProcess::(_processLogs) (9171) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:51:59,910::__init__::225::IOProcess::(_processLogs) (9171) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:51:59,910::__init__::225::IOProcess::(_processLogs) DEBUG|(9171) Building response >Thread-19::DEBUG::2014-09-09 11:51:59,910::__init__::225::IOProcess::(_processLogs) (9171) Queuing response >Thread-19::DEBUG::2014-09-09 11:51:59,910::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:51:59,911::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:01,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:01,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904713 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:02,691::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:02,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4152::DEBUG::2014-09-09 11:52:02,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:03,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:04,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897187 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:04,587::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:04,587::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:04,587::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:04,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:04,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:04,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) (9172) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) (9172) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) DEBUG|(9172) Building response >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) (9172) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:04,588::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:52:04,588::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:52:04,596::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000969065 s, 366 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) (9173) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:04,597::__init__::225::IOProcess::(_processLogs) (9173) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:04,598::__init__::225::IOProcess::(_processLogs) DEBUG|(9173) Building response >Thread-19::DEBUG::2014-09-09 11:52:04,598::__init__::225::IOProcess::(_processLogs) (9173) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:04,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:04,598::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:05,703::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:05,704::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4153::DEBUG::2014-09-09 11:52:05,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`2724a7ca-253c-459a-8bfd-11979da673c2`::moving from state init -> state preparing >Thread-4153::INFO::2014-09-09 11:52:05,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4153::INFO::2014-09-09 11:52:05,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116549', 'lastCheck': '5.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104987', 'lastCheck': '9.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000969065', 'lastCheck': '1.1', 'valid': True}} >Thread-4153::DEBUG::2014-09-09 11:52:05,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`2724a7ca-253c-459a-8bfd-11979da673c2`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116549', 'lastCheck': '5.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104987', 'lastCheck': '9.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000969065', 'lastCheck': '1.1', 'valid': True}} >Thread-4153::DEBUG::2014-09-09 11:52:05,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`2724a7ca-253c-459a-8bfd-11979da673c2`::moving from state preparing -> state finished >Thread-4153::DEBUG::2014-09-09 11:52:05,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4153::DEBUG::2014-09-09 11:52:05,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4153::DEBUG::2014-09-09 11:52:05,706::task::993::Storage.TaskManager.Task::(_decref) Task=`2724a7ca-253c-459a-8bfd-11979da673c2`::ref 0 aborting False >Thread-4153::DEBUG::2014-09-09 11:52:05,707::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:05,717::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:05,718::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4154::DEBUG::2014-09-09 11:52:05,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:06,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:06,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.09017 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:06,386::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:06,386::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:06,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) (9174) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) (9174) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:06,387::__init__::225::IOProcess::(_processLogs) DEBUG|(9174) Building response >Thread-19::DEBUG::2014-09-09 11:52:06,388::__init__::225::IOProcess::(_processLogs) (9174) Queuing response >Thread-24::DEBUG::2014-09-09 11:52:06,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:52:06,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:06,393::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:52:06,395::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000926897 s, 591 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:06,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:06,397::__init__::225::IOProcess::(_processLogs) (9175) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:06,397::__init__::225::IOProcess::(_processLogs) (9175) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:06,397::__init__::225::IOProcess::(_processLogs) DEBUG|(9175) Building response >Thread-19::DEBUG::2014-09-09 11:52:06,397::__init__::225::IOProcess::(_processLogs) (9175) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:06,397::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:06,398::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:06,398::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:06,398::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:52:06,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:06,398::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:06,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) (9176) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) (9176) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) (9176) Building response >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) (9176) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:52:06,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) (9177) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) (9177) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) (9177) Building response >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) (9177) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:06,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) (9178) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:06,401::__init__::225::IOProcess::(_processLogs) (9178) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:06,402::__init__::225::IOProcess::(_processLogs) DEBUG|(9178) Building response >Thread-19::DEBUG::2014-09-09 11:52:06,402::__init__::225::IOProcess::(_processLogs) (9178) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:06,402::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:06,402::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:06,978::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:06,979::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4155::DEBUG::2014-09-09 11:52:06,979::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4155::DEBUG::2014-09-09 11:52:06,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`e348c37b-1e14-48d0-8823-cd91d427be06`::moving from state init -> state preparing >Thread-4155::INFO::2014-09-09 11:52:06,980::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4155::INFO::2014-09-09 11:52:06,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4155::DEBUG::2014-09-09 11:52:06,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`e348c37b-1e14-48d0-8823-cd91d427be06`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4155::DEBUG::2014-09-09 11:52:06,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`e348c37b-1e14-48d0-8823-cd91d427be06`::moving from state preparing -> state finished >Thread-4155::DEBUG::2014-09-09 11:52:06,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4155::DEBUG::2014-09-09 11:52:06,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4155::DEBUG::2014-09-09 11:52:06,981::task::993::Storage.TaskManager.Task::(_decref) Task=`e348c37b-1e14-48d0-8823-cd91d427be06`::ref 0 aborting False >Thread-4155::DEBUG::2014-09-09 11:52:06,981::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4155::DEBUG::2014-09-09 11:52:06,981::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:07,075::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4156::DEBUG::2014-09-09 11:52:07,075::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:52:07,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4156::DEBUG::2014-09-09 11:52:07,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`147396e8-8c74-47d9-8f56-a0f3c6dc7d52`::moving from state init -> state preparing >Thread-4156::INFO::2014-09-09 11:52:07,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4156::DEBUG::2014-09-09 11:52:07,076::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2882141b-3a4a-444c-a495-9a94de65216f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4156::DEBUG::2014-09-09 11:52:07,077::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4156::DEBUG::2014-09-09 11:52:07,077::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4156::DEBUG::2014-09-09 11:52:07,077::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2882141b-3a4a-444c-a495-9a94de65216f`::Granted request >Thread-4156::DEBUG::2014-09-09 11:52:07,077::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`147396e8-8c74-47d9-8f56-a0f3c6dc7d52`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4156::DEBUG::2014-09-09 11:52:07,077::task::993::Storage.TaskManager.Task::(_decref) Task=`147396e8-8c74-47d9-8f56-a0f3c6dc7d52`::ref 1 aborting False >Thread-4156::INFO::2014-09-09 11:52:07,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4156::DEBUG::2014-09-09 11:52:07,079::task::1191::Storage.TaskManager.Task::(prepare) Task=`147396e8-8c74-47d9-8f56-a0f3c6dc7d52`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4156::DEBUG::2014-09-09 11:52:07,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`147396e8-8c74-47d9-8f56-a0f3c6dc7d52`::moving from state preparing -> state finished >Thread-4156::DEBUG::2014-09-09 11:52:07,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4156::DEBUG::2014-09-09 11:52:07,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4156::DEBUG::2014-09-09 11:52:07,079::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4156::DEBUG::2014-09-09 11:52:07,079::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4156::DEBUG::2014-09-09 11:52:07,079::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4156::DEBUG::2014-09-09 11:52:07,079::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4156::DEBUG::2014-09-09 11:52:07,080::task::993::Storage.TaskManager.Task::(_decref) Task=`147396e8-8c74-47d9-8f56-a0f3c6dc7d52`::ref 0 aborting False >Thread-4156::DEBUG::2014-09-09 11:52:07,080::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4156::DEBUG::2014-09-09 11:52:07,080::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:08,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:08,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898092 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:08,780::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:08,780::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4157::DEBUG::2014-09-09 11:52:08,781::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) (9179) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:09,912::__init__::225::IOProcess::(_processLogs) (9179) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:09,914::__init__::225::IOProcess::(_processLogs) DEBUG|(9179) Building response >Thread-19::DEBUG::2014-09-09 11:52:09,914::__init__::225::IOProcess::(_processLogs) (9179) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:09,914::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:09,914::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:52:09,915::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:52:09,922::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110578 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:09,922::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) (9180) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:09,923::__init__::225::IOProcess::(_processLogs) (9180) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:09,924::__init__::225::IOProcess::(_processLogs) DEBUG|(9180) Building response >Thread-19::DEBUG::2014-09-09 11:52:09,924::__init__::225::IOProcess::(_processLogs) (9180) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:09,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:09,924::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:10,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:10,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903848 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:11,792::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:11,793::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4158::DEBUG::2014-09-09 11:52:11,794::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:12,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:12,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896664 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:52:14,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:14,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900274 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:14,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) (9181) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) (9181) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:14,600::__init__::225::IOProcess::(_processLogs) DEBUG|(9181) Building response >Thread-19::DEBUG::2014-09-09 11:52:14,601::__init__::225::IOProcess::(_processLogs) (9181) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:14,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:14,601::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:52:14,601::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:52:14,609::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000874083 s, 406 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:14,609::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:14,609::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) (9182) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) (9182) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) DEBUG|(9182) Building response >Thread-19::DEBUG::2014-09-09 11:52:14,610::__init__::225::IOProcess::(_processLogs) (9182) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:14,611::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:14,611::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:14,800::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:14,800::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4159::DEBUG::2014-09-09 11:52:14,801::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) (9183) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:16,403::__init__::225::IOProcess::(_processLogs) (9183) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:16,404::__init__::225::IOProcess::(_processLogs) DEBUG|(9183) Building response >Thread-19::DEBUG::2014-09-09 11:52:16,404::__init__::225::IOProcess::(_processLogs) (9183) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:16,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:16,405::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:52:16,405::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:52:16,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000970617 s, 565 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:16,414::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) (9184) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) (9184) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:16,415::__init__::225::IOProcess::(_processLogs) DEBUG|(9184) Building response >Thread-19::DEBUG::2014-09-09 11:52:16,416::__init__::225::IOProcess::(_processLogs) (9184) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:16,416::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:16,416::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:16,417::__init__::225::IOProcess::(_processLogs) (9185) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) (9185) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) (9185) Building response >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) (9185) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:16,418::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) (9186) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) (9186) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) (9186) Building response >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) (9186) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:16,420::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:16,421::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:52:16,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:16,421::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:16,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:16,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:16,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:16,422::__init__::225::IOProcess::(_processLogs) (9187) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:16,422::__init__::225::IOProcess::(_processLogs) (9187) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:16,422::__init__::225::IOProcess::(_processLogs) (9187) Building response >Thread-19::DEBUG::2014-09-09 11:52:16,422::__init__::225::IOProcess::(_processLogs) (9187) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:16,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:16,422::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:52:16,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:16,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895899 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:17,125::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:17,126::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4160::DEBUG::2014-09-09 11:52:17,126::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4160::DEBUG::2014-09-09 11:52:17,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4816c98-1cf5-47ad-8c4c-62dca44e5c9e`::moving from state init -> state preparing >Thread-4160::INFO::2014-09-09 11:52:17,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4160::INFO::2014-09-09 11:52:17,127::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4160::DEBUG::2014-09-09 11:52:17,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4816c98-1cf5-47ad-8c4c-62dca44e5c9e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4160::DEBUG::2014-09-09 11:52:17,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4816c98-1cf5-47ad-8c4c-62dca44e5c9e`::moving from state preparing -> state finished >Thread-4160::DEBUG::2014-09-09 11:52:17,127::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4160::DEBUG::2014-09-09 11:52:17,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4160::DEBUG::2014-09-09 11:52:17,127::task::993::Storage.TaskManager.Task::(_decref) Task=`f4816c98-1cf5-47ad-8c4c-62dca44e5c9e`::ref 0 aborting False >Thread-4160::DEBUG::2014-09-09 11:52:17,128::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4160::DEBUG::2014-09-09 11:52:17,128::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:17,168::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4161::DEBUG::2014-09-09 11:52:17,168::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:52:17,168::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4161::DEBUG::2014-09-09 11:52:17,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`450e69ad-206b-4b3d-982a-d7383296eef1`::moving from state init -> state preparing >Thread-4161::INFO::2014-09-09 11:52:17,169::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4161::DEBUG::2014-09-09 11:52:17,170::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`48419190-4fb2-41ea-bcb3-373ebeccf6ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4161::DEBUG::2014-09-09 11:52:17,170::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4161::DEBUG::2014-09-09 11:52:17,170::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4161::DEBUG::2014-09-09 11:52:17,170::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`48419190-4fb2-41ea-bcb3-373ebeccf6ed`::Granted request >Thread-4161::DEBUG::2014-09-09 11:52:17,170::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`450e69ad-206b-4b3d-982a-d7383296eef1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4161::DEBUG::2014-09-09 11:52:17,170::task::993::Storage.TaskManager.Task::(_decref) Task=`450e69ad-206b-4b3d-982a-d7383296eef1`::ref 1 aborting False >Thread-4161::INFO::2014-09-09 11:52:17,172::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4161::DEBUG::2014-09-09 11:52:17,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`450e69ad-206b-4b3d-982a-d7383296eef1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4161::DEBUG::2014-09-09 11:52:17,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`450e69ad-206b-4b3d-982a-d7383296eef1`::moving from state preparing -> state finished >Thread-4161::DEBUG::2014-09-09 11:52:17,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4161::DEBUG::2014-09-09 11:52:17,172::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4161::DEBUG::2014-09-09 11:52:17,172::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4161::DEBUG::2014-09-09 11:52:17,173::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4161::DEBUG::2014-09-09 11:52:17,173::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4161::DEBUG::2014-09-09 11:52:17,173::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4161::DEBUG::2014-09-09 11:52:17,173::task::993::Storage.TaskManager.Task::(_decref) Task=`450e69ad-206b-4b3d-982a-d7383296eef1`::ref 0 aborting False >Thread-4161::DEBUG::2014-09-09 11:52:17,173::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4161::DEBUG::2014-09-09 11:52:17,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:17,814::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:17,815::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4162::DEBUG::2014-09-09 11:52:17,816::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:18,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:18,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902812 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:19,926::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:19,926::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:19,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:19,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:19,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:19,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:19,929::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-23::DEBUG::2014-09-09 11:52:19,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:52:19,930::__init__::225::IOProcess::(_processLogs) (9188) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:19,935::__init__::225::IOProcess::(_processLogs) (9188) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:19,936::__init__::225::IOProcess::(_processLogs) (9188) Building response >Thread-19::DEBUG::2014-09-09 11:52:19,936::__init__::225::IOProcess::(_processLogs) (9188) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:19,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:19,937::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:52:19,938::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113177 s, 992 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:19,939::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:19,940::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:19,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:19,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:19,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:19,942::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:19,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:19,944::__init__::225::IOProcess::(_processLogs) (9189) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:19,944::__init__::225::IOProcess::(_processLogs) (9189) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:19,945::__init__::225::IOProcess::(_processLogs) (9189) Building response >Thread-19::DEBUG::2014-09-09 11:52:19,945::__init__::225::IOProcess::(_processLogs) (9189) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:19,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:19,946::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:20,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:20,830::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:20,831::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4163::DEBUG::2014-09-09 11:52:20,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`862b5ae8-bbcb-416d-85ed-eaccb204a457`::moving from state init -> state preparing >Thread-4163::INFO::2014-09-09 11:52:20,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4163::INFO::2014-09-09 11:52:20,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113177', 'lastCheck': '0.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000970617', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000874083', 'lastCheck': '6.2', 'valid': True}} >Thread-4163::DEBUG::2014-09-09 11:52:20,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`862b5ae8-bbcb-416d-85ed-eaccb204a457`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113177', 'lastCheck': '0.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000970617', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000874083', 'lastCheck': '6.2', 'valid': True}} >Thread-4163::DEBUG::2014-09-09 11:52:20,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`862b5ae8-bbcb-416d-85ed-eaccb204a457`::moving from state preparing -> state finished >Thread-4163::DEBUG::2014-09-09 11:52:20,833::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4163::DEBUG::2014-09-09 11:52:20,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4163::DEBUG::2014-09-09 11:52:20,833::task::993::Storage.TaskManager.Task::(_decref) Task=`862b5ae8-bbcb-416d-85ed-eaccb204a457`::ref 0 aborting False >Thread-4163::DEBUG::2014-09-09 11:52:20,834::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:20,857::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:20,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4164::DEBUG::2014-09-09 11:52:20,858::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:20,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898309 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:52:22,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:22,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900646 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:23,937::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:23,938::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4165::DEBUG::2014-09-09 11:52:23,939::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:24,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:24,613::__init__::225::IOProcess::(_processLogs) (9190) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:24,613::__init__::225::IOProcess::(_processLogs) (9190) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:24,613::__init__::225::IOProcess::(_processLogs) DEBUG|(9190) Building response >Thread-19::DEBUG::2014-09-09 11:52:24,613::__init__::225::IOProcess::(_processLogs) (9190) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:24,613::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:24,613::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:52:24,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:52:24,620::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000902107 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:24,621::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:24,621::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:24,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:24,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:24,621::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:24,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:24,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:24,622::__init__::225::IOProcess::(_processLogs) (9191) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:24,622::__init__::225::IOProcess::(_processLogs) (9191) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:24,622::__init__::225::IOProcess::(_processLogs) DEBUG|(9191) Building response >Thread-19::DEBUG::2014-09-09 11:52:24,622::__init__::225::IOProcess::(_processLogs) (9191) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:24,622::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:24,623::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:24,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:25,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900621 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) (9192) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:26,422::__init__::225::IOProcess::(_processLogs) (9192) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:26,423::__init__::225::IOProcess::(_processLogs) DEBUG|(9192) Building response >Thread-19::DEBUG::2014-09-09 11:52:26,423::__init__::225::IOProcess::(_processLogs) (9192) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:26,423::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:26,423::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:52:26,423::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:52:26,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000955026 s, 574 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:26,432::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:26,432::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:26,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:26,432::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:26,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) (9193) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) (9193) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) DEBUG|(9193) Building response >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) (9193) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:26,433::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:26,434::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:26,434::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:26,434::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:52:26,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) (9194) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) (9194) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) (9194) Building response >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) (9194) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:26,435::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:26,436::__init__::225::IOProcess::(_processLogs) (9195) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) (9195) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) (9195) Building response >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) (9195) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:26,437::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) (9196) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) (9196) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) (9196) Building response >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) (9196) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:26,438::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:26,950::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:26,950::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4166::DEBUG::2014-09-09 11:52:26,951::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:27,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:27,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897514 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:27,216::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:27,217::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4167::DEBUG::2014-09-09 11:52:27,217::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4167::DEBUG::2014-09-09 11:52:27,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`63b210aa-456a-42c4-adf9-291bd63dd510`::moving from state init -> state preparing >Thread-4167::INFO::2014-09-09 11:52:27,218::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4167::INFO::2014-09-09 11:52:27,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4167::DEBUG::2014-09-09 11:52:27,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`63b210aa-456a-42c4-adf9-291bd63dd510`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4167::DEBUG::2014-09-09 11:52:27,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`63b210aa-456a-42c4-adf9-291bd63dd510`::moving from state preparing -> state finished >Thread-4167::DEBUG::2014-09-09 11:52:27,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4167::DEBUG::2014-09-09 11:52:27,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4167::DEBUG::2014-09-09 11:52:27,219::task::993::Storage.TaskManager.Task::(_decref) Task=`63b210aa-456a-42c4-adf9-291bd63dd510`::ref 0 aborting False >Thread-4167::DEBUG::2014-09-09 11:52:27,219::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4167::DEBUG::2014-09-09 11:52:27,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:27,269::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:27,270::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4168::DEBUG::2014-09-09 11:52:27,270::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4168::DEBUG::2014-09-09 11:52:27,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7211bb-2a83-477a-b87b-b33973d89860`::moving from state init -> state preparing >Thread-4168::INFO::2014-09-09 11:52:27,271::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4168::DEBUG::2014-09-09 11:52:27,272::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1bae7fe-c4c3-4983-b346-b743c8b7f489`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4168::DEBUG::2014-09-09 11:52:27,272::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4168::DEBUG::2014-09-09 11:52:27,272::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4168::DEBUG::2014-09-09 11:52:27,272::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1bae7fe-c4c3-4983-b346-b743c8b7f489`::Granted request >Thread-4168::DEBUG::2014-09-09 11:52:27,272::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e7211bb-2a83-477a-b87b-b33973d89860`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4168::DEBUG::2014-09-09 11:52:27,272::task::993::Storage.TaskManager.Task::(_decref) Task=`3e7211bb-2a83-477a-b87b-b33973d89860`::ref 1 aborting False >Thread-4168::INFO::2014-09-09 11:52:27,274::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4168::DEBUG::2014-09-09 11:52:27,274::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e7211bb-2a83-477a-b87b-b33973d89860`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4168::DEBUG::2014-09-09 11:52:27,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7211bb-2a83-477a-b87b-b33973d89860`::moving from state preparing -> state finished >Thread-4168::DEBUG::2014-09-09 11:52:27,274::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4168::DEBUG::2014-09-09 11:52:27,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4168::DEBUG::2014-09-09 11:52:27,275::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4168::DEBUG::2014-09-09 11:52:27,275::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4168::DEBUG::2014-09-09 11:52:27,275::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4168::DEBUG::2014-09-09 11:52:27,275::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4168::DEBUG::2014-09-09 11:52:27,275::task::993::Storage.TaskManager.Task::(_decref) Task=`3e7211bb-2a83-477a-b87b-b33973d89860`::ref 0 aborting False >Thread-4168::DEBUG::2014-09-09 11:52:27,275::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4168::DEBUG::2014-09-09 11:52:27,275::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:29,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:29,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900531 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:29,943::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) (9197) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) (9197) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) DEBUG|(9197) Building response >Thread-19::DEBUG::2014-09-09 11:52:29,944::__init__::225::IOProcess::(_processLogs) (9197) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:29,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:29,945::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:52:29,945::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:52:29,952::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00120831 s, 929 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:29,953::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:29,954::__init__::225::IOProcess::(_processLogs) (9198) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:29,954::__init__::225::IOProcess::(_processLogs) (9198) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:29,954::__init__::225::IOProcess::(_processLogs) DEBUG|(9198) Building response >Thread-19::DEBUG::2014-09-09 11:52:29,954::__init__::225::IOProcess::(_processLogs) (9198) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:29,954::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:29,954::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:29,958::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:29,959::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4169::DEBUG::2014-09-09 11:52:29,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:31,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:31,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902101 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:32,973::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:32,973::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4170::DEBUG::2014-09-09 11:52:32,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:33,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:33,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901554 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:34,624::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:34,624::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:34,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:34,624::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:34,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:34,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:34,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:34,625::__init__::225::IOProcess::(_processLogs) (9199) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:34,625::__init__::225::IOProcess::(_processLogs) (9199) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:34,626::__init__::225::IOProcess::(_processLogs) DEBUG|(9199) Building response >Thread-19::DEBUG::2014-09-09 11:52:34,626::__init__::225::IOProcess::(_processLogs) (9199) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:34,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:34,627::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:52:34,627::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:52:34,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000916009 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:34,635::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:34,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:34,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:34,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:34,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:34,636::__init__::225::IOProcess::(_processLogs) (9200) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:34,636::__init__::225::IOProcess::(_processLogs) (9200) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:34,636::__init__::225::IOProcess::(_processLogs) (9200) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:34,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:34,636::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:35,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:35,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898589 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:35,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:35,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4171::DEBUG::2014-09-09 11:52:35,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`b182ebd4-7fbd-4d5f-8138-06b37745dc45`::moving from state init -> state preparing >Thread-4171::INFO::2014-09-09 11:52:35,982::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4171::INFO::2014-09-09 11:52:35,982::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120831', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955026', 'lastCheck': '9.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916009', 'lastCheck': '1.3', 'valid': True}} >Thread-4171::DEBUG::2014-09-09 11:52:35,983::task::1191::Storage.TaskManager.Task::(prepare) Task=`b182ebd4-7fbd-4d5f-8138-06b37745dc45`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120831', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955026', 'lastCheck': '9.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916009', 'lastCheck': '1.3', 'valid': True}} >Thread-4171::DEBUG::2014-09-09 11:52:35,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`b182ebd4-7fbd-4d5f-8138-06b37745dc45`::moving from state preparing -> state finished >Thread-4171::DEBUG::2014-09-09 11:52:35,983::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4171::DEBUG::2014-09-09 11:52:35,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4171::DEBUG::2014-09-09 11:52:35,983::task::993::Storage.TaskManager.Task::(_decref) Task=`b182ebd4-7fbd-4d5f-8138-06b37745dc45`::ref 0 aborting False >Thread-4171::DEBUG::2014-09-09 11:52:35,984::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:35,996::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:35,997::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4172::DEBUG::2014-09-09 11:52:35,998::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:52:36,438::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:36,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:36,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:36,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:36,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:36,439::__init__::225::IOProcess::(_processLogs) (9201) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:36,439::__init__::225::IOProcess::(_processLogs) (9201) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:36,439::__init__::225::IOProcess::(_processLogs) (9201) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:36,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:52:36,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:52:36,447::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000986232 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:36,448::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:36,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:36,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:36,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:36,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:36,448::__init__::225::IOProcess::(_processLogs) (9202) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:36,449::__init__::225::IOProcess::(_processLogs) (9202) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:36,449::__init__::225::IOProcess::(_processLogs) (9202) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:36,449::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:36,450::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:52:36,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:36,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:36,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:36,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) (9203) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) (9203) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) (9203) Building response >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) (9203) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:36,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) (9204) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) (9204) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) (9204) Building response >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) (9204) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:36,452::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:52:36,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:36,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:36,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:36,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:36,453::__init__::225::IOProcess::(_processLogs) (9205) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:36,453::__init__::225::IOProcess::(_processLogs) (9205) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:36,454::__init__::225::IOProcess::(_processLogs) (9205) Building response >Thread-19::DEBUG::2014-09-09 11:52:36,454::__init__::225::IOProcess::(_processLogs) (9205) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:36,454::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:36,454::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:37,320::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:37,321::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4173::DEBUG::2014-09-09 11:52:37,321::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4173::DEBUG::2014-09-09 11:52:37,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`81f800ef-98b8-47f6-9c43-7d2695e830ed`::moving from state init -> state preparing >Thread-4173::INFO::2014-09-09 11:52:37,322::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4173::INFO::2014-09-09 11:52:37,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4173::DEBUG::2014-09-09 11:52:37,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`81f800ef-98b8-47f6-9c43-7d2695e830ed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4173::DEBUG::2014-09-09 11:52:37,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`81f800ef-98b8-47f6-9c43-7d2695e830ed`::moving from state preparing -> state finished >Thread-4173::DEBUG::2014-09-09 11:52:37,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4173::DEBUG::2014-09-09 11:52:37,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4173::DEBUG::2014-09-09 11:52:37,322::task::993::Storage.TaskManager.Task::(_decref) Task=`81f800ef-98b8-47f6-9c43-7d2695e830ed`::ref 0 aborting False >Thread-4173::DEBUG::2014-09-09 11:52:37,323::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4173::DEBUG::2014-09-09 11:52:37,323::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:37,356::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:37,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4174::DEBUG::2014-09-09 11:52:37,357::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4174::DEBUG::2014-09-09 11:52:37,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6f50fb5-65b6-46ff-b8dc-01d9fd53ccec`::moving from state init -> state preparing >Thread-4174::INFO::2014-09-09 11:52:37,358::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4174::DEBUG::2014-09-09 11:52:37,358::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`40423b1e-0a15-4039-9199-7a2f2ad28b18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4174::DEBUG::2014-09-09 11:52:37,358::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4174::DEBUG::2014-09-09 11:52:37,358::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4174::DEBUG::2014-09-09 11:52:37,358::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`40423b1e-0a15-4039-9199-7a2f2ad28b18`::Granted request >Thread-4174::DEBUG::2014-09-09 11:52:37,358::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e6f50fb5-65b6-46ff-b8dc-01d9fd53ccec`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4174::DEBUG::2014-09-09 11:52:37,359::task::993::Storage.TaskManager.Task::(_decref) Task=`e6f50fb5-65b6-46ff-b8dc-01d9fd53ccec`::ref 1 aborting False >Thread-4174::INFO::2014-09-09 11:52:37,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4174::DEBUG::2014-09-09 11:52:37,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6f50fb5-65b6-46ff-b8dc-01d9fd53ccec`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4174::DEBUG::2014-09-09 11:52:37,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6f50fb5-65b6-46ff-b8dc-01d9fd53ccec`::moving from state preparing -> state finished >Thread-4174::DEBUG::2014-09-09 11:52:37,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4174::DEBUG::2014-09-09 11:52:37,360::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4174::DEBUG::2014-09-09 11:52:37,361::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4174::DEBUG::2014-09-09 11:52:37,361::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4174::DEBUG::2014-09-09 11:52:37,361::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4174::DEBUG::2014-09-09 11:52:37,361::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4174::DEBUG::2014-09-09 11:52:37,361::task::993::Storage.TaskManager.Task::(_decref) Task=`e6f50fb5-65b6-46ff-b8dc-01d9fd53ccec`::ref 0 aborting False >Thread-4174::DEBUG::2014-09-09 11:52:37,361::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4174::DEBUG::2014-09-09 11:52:37,361::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:37,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:37,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901001 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:39,064::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:39,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4175::DEBUG::2014-09-09 11:52:39,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:39,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:39,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900249 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) (9206) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:39,956::__init__::225::IOProcess::(_processLogs) (9206) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:39,958::__init__::225::IOProcess::(_processLogs) (9206) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:39,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:52:39,958::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:52:39,966::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117106 s, 959 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) (9207) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:39,967::__init__::225::IOProcess::(_processLogs) (9207) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:39,968::__init__::225::IOProcess::(_processLogs) (9207) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:39,968::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:41,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:41,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903666 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:42,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:42,100::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4176::DEBUG::2014-09-09 11:52:42,101::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:43,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:44,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090518 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:44,637::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:44,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:44,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:44,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:44,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:44,638::__init__::225::IOProcess::(_processLogs) (9208) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:44,638::__init__::225::IOProcess::(_processLogs) (9208) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:44,639::__init__::225::IOProcess::(_processLogs) (9208) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:44,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:52:44,639::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:52:44,646::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000989392 s, 359 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:44,646::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) (9209) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) (9209) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:44,647::__init__::225::IOProcess::(_processLogs) (9209) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:44,648::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:45,116::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:45,117::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4177::DEBUG::2014-09-09 11:52:45,118::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:46,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:46,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089697 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) (9210) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:46,454::__init__::225::IOProcess::(_processLogs) (9210) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:46,455::__init__::225::IOProcess::(_processLogs) (9210) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:46,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:52:46,456::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:52:46,463::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000998684 s, 549 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) (9211) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:46,464::__init__::225::IOProcess::(_processLogs) (9211) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:46,465::__init__::225::IOProcess::(_processLogs) (9211) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:46,465::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:46,465::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) (9212) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) (9212) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:46,466::__init__::225::IOProcess::(_processLogs) (9212) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) (9213) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:46,467::__init__::225::IOProcess::(_processLogs) (9213) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:46,468::__init__::225::IOProcess::(_processLogs) (9213) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:46,468::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:46,468::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:52:46,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:46,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:46,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:46,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:46,469::__init__::225::IOProcess::(_processLogs) (9214) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:46,469::__init__::225::IOProcess::(_processLogs) (9214) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:46,470::__init__::225::IOProcess::(_processLogs) (9214) Building response >Thread-19::DEBUG::2014-09-09 11:52:46,470::__init__::225::IOProcess::(_processLogs) (9214) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:46,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:46,470::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:47,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:47,400::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4178::DEBUG::2014-09-09 11:52:47,400::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4178::DEBUG::2014-09-09 11:52:47,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`442ccf52-5489-4b22-88d4-5f0b9b3ddbec`::moving from state init -> state preparing >Thread-4178::INFO::2014-09-09 11:52:47,401::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4178::INFO::2014-09-09 11:52:47,401::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4178::DEBUG::2014-09-09 11:52:47,401::task::1191::Storage.TaskManager.Task::(prepare) Task=`442ccf52-5489-4b22-88d4-5f0b9b3ddbec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4178::DEBUG::2014-09-09 11:52:47,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`442ccf52-5489-4b22-88d4-5f0b9b3ddbec`::moving from state preparing -> state finished >Thread-4178::DEBUG::2014-09-09 11:52:47,401::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4178::DEBUG::2014-09-09 11:52:47,401::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4178::DEBUG::2014-09-09 11:52:47,401::task::993::Storage.TaskManager.Task::(_decref) Task=`442ccf52-5489-4b22-88d4-5f0b9b3ddbec`::ref 0 aborting False >Thread-4178::DEBUG::2014-09-09 11:52:47,402::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4178::DEBUG::2014-09-09 11:52:47,402::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:47,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:47,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4179::DEBUG::2014-09-09 11:52:47,442::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4179::DEBUG::2014-09-09 11:52:47,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`58366433-8483-4a97-9ca9-7b86f4e9f0af`::moving from state init -> state preparing >Thread-4179::INFO::2014-09-09 11:52:47,442::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4179::DEBUG::2014-09-09 11:52:47,443::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f67c139d-ca35-4f33-a884-8a5d191dcede`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4179::DEBUG::2014-09-09 11:52:47,443::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4179::DEBUG::2014-09-09 11:52:47,443::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4179::DEBUG::2014-09-09 11:52:47,443::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f67c139d-ca35-4f33-a884-8a5d191dcede`::Granted request >Thread-4179::DEBUG::2014-09-09 11:52:47,443::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`58366433-8483-4a97-9ca9-7b86f4e9f0af`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4179::DEBUG::2014-09-09 11:52:47,443::task::993::Storage.TaskManager.Task::(_decref) Task=`58366433-8483-4a97-9ca9-7b86f4e9f0af`::ref 1 aborting False >Thread-4179::INFO::2014-09-09 11:52:47,445::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4179::DEBUG::2014-09-09 11:52:47,445::task::1191::Storage.TaskManager.Task::(prepare) Task=`58366433-8483-4a97-9ca9-7b86f4e9f0af`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4179::DEBUG::2014-09-09 11:52:47,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`58366433-8483-4a97-9ca9-7b86f4e9f0af`::moving from state preparing -> state finished >Thread-4179::DEBUG::2014-09-09 11:52:47,445::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4179::DEBUG::2014-09-09 11:52:47,445::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4179::DEBUG::2014-09-09 11:52:47,446::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4179::DEBUG::2014-09-09 11:52:47,446::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4179::DEBUG::2014-09-09 11:52:47,446::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4179::DEBUG::2014-09-09 11:52:47,446::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4179::DEBUG::2014-09-09 11:52:47,446::task::993::Storage.TaskManager.Task::(_decref) Task=`58366433-8483-4a97-9ca9-7b86f4e9f0af`::ref 0 aborting False >Thread-4179::DEBUG::2014-09-09 11:52:47,446::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4179::DEBUG::2014-09-09 11:52:47,446::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:48,132::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:48,133::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4180::DEBUG::2014-09-09 11:52:48,134::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:48,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:48,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904654 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:49,969::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:49,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:49,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:49,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:49,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:49,972::__init__::225::IOProcess::(_processLogs) (9215) Finding callback 'statvfs'... >Thread-23::DEBUG::2014-09-09 11:52:49,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:52:49,973::__init__::225::IOProcess::(_processLogs) (9215) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:49,979::__init__::225::IOProcess::(_processLogs) (9215) Building response >Thread-19::DEBUG::2014-09-09 11:52:49,979::__init__::225::IOProcess::(_processLogs) (9215) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:49,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:49,980::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:52:49,981::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104635 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:49,982::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:49,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:49,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:49,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:49,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:49,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:49,986::__init__::225::IOProcess::(_processLogs) (9216) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:49,987::__init__::225::IOProcess::(_processLogs) (9216) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:49,987::__init__::225::IOProcess::(_processLogs) (9216) Building response >Thread-19::DEBUG::2014-09-09 11:52:49,987::__init__::225::IOProcess::(_processLogs) (9216) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:49,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:49,988::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:52:50,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:50,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902082 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:51,142::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:51,143::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4181::DEBUG::2014-09-09 11:52:51,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc522d74-d461-472e-9279-9644d30d6d93`::moving from state init -> state preparing >Thread-4181::INFO::2014-09-09 11:52:51,144::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4181::INFO::2014-09-09 11:52:51,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104635', 'lastCheck': '1.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000998684', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989392', 'lastCheck': '6.5', 'valid': True}} >Thread-4181::DEBUG::2014-09-09 11:52:51,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc522d74-d461-472e-9279-9644d30d6d93`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104635', 'lastCheck': '1.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000998684', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989392', 'lastCheck': '6.5', 'valid': True}} >Thread-4181::DEBUG::2014-09-09 11:52:51,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc522d74-d461-472e-9279-9644d30d6d93`::moving from state preparing -> state finished >Thread-4181::DEBUG::2014-09-09 11:52:51,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4181::DEBUG::2014-09-09 11:52:51,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4181::DEBUG::2014-09-09 11:52:51,145::task::993::Storage.TaskManager.Task::(_decref) Task=`dc522d74-d461-472e-9279-9644d30d6d93`::ref 0 aborting False >Thread-4181::DEBUG::2014-09-09 11:52:51,146::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:51,155::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:51,156::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4182::DEBUG::2014-09-09 11:52:51,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:52,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:52,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901839 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:54,237::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:54,238::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4183::DEBUG::2014-09-09 11:52:54,239::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:54,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:54,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897476 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:54,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:54,650::__init__::225::IOProcess::(_processLogs) (9217) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:54,650::__init__::225::IOProcess::(_processLogs) (9217) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:54,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9217) Building response >Thread-19::DEBUG::2014-09-09 11:52:54,650::__init__::225::IOProcess::(_processLogs) (9217) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:54,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:54,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:52:54,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:52:54,658::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00106384 s, 334 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:54,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:54,658::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:52:54,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) (9218) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) (9218) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9218) Building response >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) (9218) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:54,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:54,660::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) (9219) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) (9219) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:56,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9219) Building response >Thread-19::DEBUG::2014-09-09 11:52:56,471::__init__::225::IOProcess::(_processLogs) (9219) Queuing response >Thread-24::DEBUG::2014-09-09 11:52:56,471::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:52:56,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:56,476::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:52:56,479::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000965949 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) (9220) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:56,480::__init__::225::IOProcess::(_processLogs) (9220) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:56,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9220) Building response >Thread-19::DEBUG::2014-09-09 11:52:56,481::__init__::225::IOProcess::(_processLogs) (9220) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:56,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:52:56,482::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:52:56,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) (9221) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) (9221) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:56,483::__init__::225::IOProcess::(_processLogs) (9221) Building response >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) (9221) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:56,484::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) (9222) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) (9222) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) (9222) Building response >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) (9222) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:56,485::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:52:56,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:56,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:56,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:56,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:56,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:56,486::__init__::225::IOProcess::(_processLogs) (9223) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:52:56,487::__init__::225::IOProcess::(_processLogs) (9223) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:52:56,487::__init__::225::IOProcess::(_processLogs) (9223) Building response >Thread-19::DEBUG::2014-09-09 11:52:56,487::__init__::225::IOProcess::(_processLogs) (9223) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:56,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:56,487::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:52:56,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:56,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903356 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:57,248::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:57,249::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4184::DEBUG::2014-09-09 11:52:57,250::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:57,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4185::DEBUG::2014-09-09 11:52:57,490::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:52:57,490::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4185::DEBUG::2014-09-09 11:52:57,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`08faf676-5f1e-4f22-89dc-fd9dd50ab3cc`::moving from state init -> state preparing >Thread-4185::INFO::2014-09-09 11:52:57,491::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4185::INFO::2014-09-09 11:52:57,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4185::DEBUG::2014-09-09 11:52:57,491::task::1191::Storage.TaskManager.Task::(prepare) Task=`08faf676-5f1e-4f22-89dc-fd9dd50ab3cc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4185::DEBUG::2014-09-09 11:52:57,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`08faf676-5f1e-4f22-89dc-fd9dd50ab3cc`::moving from state preparing -> state finished >Thread-4185::DEBUG::2014-09-09 11:52:57,491::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4185::DEBUG::2014-09-09 11:52:57,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4185::DEBUG::2014-09-09 11:52:57,492::task::993::Storage.TaskManager.Task::(_decref) Task=`08faf676-5f1e-4f22-89dc-fd9dd50ab3cc`::ref 0 aborting False >Thread-4185::DEBUG::2014-09-09 11:52:57,492::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4185::DEBUG::2014-09-09 11:52:57,492::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:52:57,534::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:52:57,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4186::DEBUG::2014-09-09 11:52:57,535::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4186::DEBUG::2014-09-09 11:52:57,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfac47d1-91cf-45e6-836a-4d60a3f4ffea`::moving from state init -> state preparing >Thread-4186::INFO::2014-09-09 11:52:57,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4186::DEBUG::2014-09-09 11:52:57,536::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d746e37e-efda-435d-9f39-8c3e538784f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4186::DEBUG::2014-09-09 11:52:57,536::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4186::DEBUG::2014-09-09 11:52:57,536::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4186::DEBUG::2014-09-09 11:52:57,536::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d746e37e-efda-435d-9f39-8c3e538784f9`::Granted request >Thread-4186::DEBUG::2014-09-09 11:52:57,536::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cfac47d1-91cf-45e6-836a-4d60a3f4ffea`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4186::DEBUG::2014-09-09 11:52:57,536::task::993::Storage.TaskManager.Task::(_decref) Task=`cfac47d1-91cf-45e6-836a-4d60a3f4ffea`::ref 1 aborting False >Thread-4186::INFO::2014-09-09 11:52:57,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4186::DEBUG::2014-09-09 11:52:57,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`cfac47d1-91cf-45e6-836a-4d60a3f4ffea`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4186::DEBUG::2014-09-09 11:52:57,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfac47d1-91cf-45e6-836a-4d60a3f4ffea`::moving from state preparing -> state finished >Thread-4186::DEBUG::2014-09-09 11:52:57,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4186::DEBUG::2014-09-09 11:52:57,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4186::DEBUG::2014-09-09 11:52:57,538::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4186::DEBUG::2014-09-09 11:52:57,539::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4186::DEBUG::2014-09-09 11:52:57,539::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4186::DEBUG::2014-09-09 11:52:57,539::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4186::DEBUG::2014-09-09 11:52:57,539::task::993::Storage.TaskManager.Task::(_decref) Task=`cfac47d1-91cf-45e6-836a-4d60a3f4ffea`::ref 0 aborting False >Thread-4186::DEBUG::2014-09-09 11:52:57,539::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4186::DEBUG::2014-09-09 11:52:57,539::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:52:58,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:52:58,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898831 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:59,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:59,986::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:59,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:59,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:59,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:59,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:59,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:59,987::__init__::225::IOProcess::(_processLogs) (9224) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:59,987::__init__::225::IOProcess::(_processLogs) (9224) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:59,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9224) Building response >Thread-19::DEBUG::2014-09-09 11:52:59,988::__init__::225::IOProcess::(_processLogs) (9224) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:59,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:59,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:52:59,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:52:59,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00127276 s, 882 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:52:59,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:52:59,997::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:52:59,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:52:59,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:52:59,997::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:52:59,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:52:59,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:52:59,998::__init__::225::IOProcess::(_processLogs) (9225) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:52:59,998::__init__::225::IOProcess::(_processLogs) (9225) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:52:59,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9225) Building response >Thread-19::DEBUG::2014-09-09 11:52:59,998::__init__::225::IOProcess::(_processLogs) (9225) Queuing response >Thread-19::DEBUG::2014-09-09 11:52:59,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:52:59,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:00,261::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:00,262::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4187::DEBUG::2014-09-09 11:53:00,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:00,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:00,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905508 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:53:02,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:02,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896375 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:03,278::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:03,279::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4188::DEBUG::2014-09-09 11:53:03,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:53:04,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) (9226) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) (9226) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9226) Building response >Thread-19::DEBUG::2014-09-09 11:53:04,661::__init__::225::IOProcess::(_processLogs) (9226) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:04,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:53:04,662::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:04,662::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:53:04,670::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000845864 s, 420 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) (9227) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) (9227) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:04,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9227) Building response >Thread-19::DEBUG::2014-09-09 11:53:04,672::__init__::225::IOProcess::(_processLogs) (9227) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:04,672::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:04,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:53:04,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:05,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902867 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:06,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:06,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4189::DEBUG::2014-09-09 11:53:06,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab0f6218-15e7-4b5f-bade-1d59b8fdcb54`::moving from state init -> state preparing >Thread-4189::INFO::2014-09-09 11:53:06,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4189::INFO::2014-09-09 11:53:06,296::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00127276', 'lastCheck': '6.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000965949', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000845864', 'lastCheck': '1.6', 'valid': True}} >Thread-4189::DEBUG::2014-09-09 11:53:06,296::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab0f6218-15e7-4b5f-bade-1d59b8fdcb54`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00127276', 'lastCheck': '6.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000965949', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000845864', 'lastCheck': '1.6', 'valid': True}} >Thread-4189::DEBUG::2014-09-09 11:53:06,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab0f6218-15e7-4b5f-bade-1d59b8fdcb54`::moving from state preparing -> state finished >Thread-4189::DEBUG::2014-09-09 11:53:06,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4189::DEBUG::2014-09-09 11:53:06,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4189::DEBUG::2014-09-09 11:53:06,297::task::993::Storage.TaskManager.Task::(_decref) Task=`ab0f6218-15e7-4b5f-bade-1d59b8fdcb54`::ref 0 aborting False >Thread-4189::DEBUG::2014-09-09 11:53:06,298::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:06,315::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:06,316::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4190::DEBUG::2014-09-09 11:53:06,316::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:53:06,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) (9228) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) (9228) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9228) Building response >Thread-19::DEBUG::2014-09-09 11:53:06,487::__init__::225::IOProcess::(_processLogs) (9228) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:06,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:53:06,488::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:06,488::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:53:06,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000877162 s, 625 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:06,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:06,496::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) (9229) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) (9229) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9229) Building response >Thread-19::DEBUG::2014-09-09 11:53:06,497::__init__::225::IOProcess::(_processLogs) (9229) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:06,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:06,498::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:06,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:06,498::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:53:06,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) (9230) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) (9230) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) (9230) Building response >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) (9230) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:06,499::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:06,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:06,500::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:06,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:06,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:06,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:06,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) (9231) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) (9231) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) (9231) Building response >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) (9231) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:06,501::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) (9232) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) (9232) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9232) Building response >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) (9232) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:06,502::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:06,503::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:53:07,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:07,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896055 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:07,578::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4191::DEBUG::2014-09-09 11:53:07,579::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:53:07,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4191::DEBUG::2014-09-09 11:53:07,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa4b1970-9cdb-464e-98db-050f0fcb4396`::moving from state init -> state preparing >Thread-4191::INFO::2014-09-09 11:53:07,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4191::INFO::2014-09-09 11:53:07,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4191::DEBUG::2014-09-09 11:53:07,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa4b1970-9cdb-464e-98db-050f0fcb4396`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4191::DEBUG::2014-09-09 11:53:07,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa4b1970-9cdb-464e-98db-050f0fcb4396`::moving from state preparing -> state finished >Thread-4191::DEBUG::2014-09-09 11:53:07,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4191::DEBUG::2014-09-09 11:53:07,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4191::DEBUG::2014-09-09 11:53:07,581::task::993::Storage.TaskManager.Task::(_decref) Task=`aa4b1970-9cdb-464e-98db-050f0fcb4396`::ref 0 aborting False >Thread-4191::DEBUG::2014-09-09 11:53:07,581::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4191::DEBUG::2014-09-09 11:53:07,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:07,618::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:07,618::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4192::DEBUG::2014-09-09 11:53:07,618::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4192::DEBUG::2014-09-09 11:53:07,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`2945e177-b165-4e5b-8f93-182c45d0145e`::moving from state init -> state preparing >Thread-4192::INFO::2014-09-09 11:53:07,619::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4192::DEBUG::2014-09-09 11:53:07,619::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`22934d74-80d8-46e7-b872-1d27682ad4b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4192::DEBUG::2014-09-09 11:53:07,619::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4192::DEBUG::2014-09-09 11:53:07,620::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4192::DEBUG::2014-09-09 11:53:07,620::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`22934d74-80d8-46e7-b872-1d27682ad4b3`::Granted request >Thread-4192::DEBUG::2014-09-09 11:53:07,620::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2945e177-b165-4e5b-8f93-182c45d0145e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4192::DEBUG::2014-09-09 11:53:07,620::task::993::Storage.TaskManager.Task::(_decref) Task=`2945e177-b165-4e5b-8f93-182c45d0145e`::ref 1 aborting False >Thread-4192::INFO::2014-09-09 11:53:07,622::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4192::DEBUG::2014-09-09 11:53:07,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`2945e177-b165-4e5b-8f93-182c45d0145e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4192::DEBUG::2014-09-09 11:53:07,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`2945e177-b165-4e5b-8f93-182c45d0145e`::moving from state preparing -> state finished >Thread-4192::DEBUG::2014-09-09 11:53:07,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4192::DEBUG::2014-09-09 11:53:07,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4192::DEBUG::2014-09-09 11:53:07,622::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4192::DEBUG::2014-09-09 11:53:07,622::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4192::DEBUG::2014-09-09 11:53:07,622::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4192::DEBUG::2014-09-09 11:53:07,622::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4192::DEBUG::2014-09-09 11:53:07,622::task::993::Storage.TaskManager.Task::(_decref) Task=`2945e177-b165-4e5b-8f93-182c45d0145e`::ref 0 aborting False >Thread-4192::DEBUG::2014-09-09 11:53:07,623::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4192::DEBUG::2014-09-09 11:53:07,623::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:09,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:09,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901289 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:09,412::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:09,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4193::DEBUG::2014-09-09 11:53:09,414::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-23::DEBUG::2014-09-09 11:53:09,999::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:53:10,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,002::__init__::225::IOProcess::(_processLogs) (9233) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:10,003::__init__::225::IOProcess::(_processLogs) (9233) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:10,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9233) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,003::__init__::225::IOProcess::(_processLogs) (9233) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:10,003::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:53:10,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) (9234) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) (9234) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Message size is 127 >Thread-19::DEBUG::2014-09-09 11:53:10,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) (9235) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) (9235) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:10,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9234) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,006::__init__::225::IOProcess::(_processLogs) (9234) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:10,006::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:53:10,006::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9235) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,007::__init__::225::IOProcess::(_processLogs) (9235) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:10,008::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 11:53:10,010::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,011::__init__::225::IOProcess::(_processLogs) (9236) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:53:10,011::__init__::225::IOProcess::(_processLogs) (9236) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:53:10,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9236) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,030::__init__::225::IOProcess::(_processLogs) (9236) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:53:10,031::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:53:10,031::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) (9237) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:53:10,032::__init__::225::IOProcess::(_processLogs) (9237) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:53:10,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9237) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,035::__init__::225::IOProcess::(_processLogs) (9237) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:53:10,035::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:53:10,035::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 11:53:10,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,036::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:53:10,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) (9238) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) (9238) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) (9238) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) (9238) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) (9239) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:10,038::__init__::225::IOProcess::(_processLogs) (9239) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:10,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9239) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,039::__init__::225::IOProcess::(_processLogs) (9239) Queuing response >Thread-23::DEBUG::2014-09-09 11:53:10,040::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:53:10,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-23::INFO::2014-09-09 11:53:10,040::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:53:10,040::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:53:10,040::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:53:10,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,041::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:10,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,042::__init__::225::IOProcess::(_processLogs) (9240) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:10,042::__init__::225::IOProcess::(_processLogs) (9240) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:10,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9240) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,042::__init__::225::IOProcess::(_processLogs) (9240) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:53:10,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:10,043::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:53:10,050::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110943 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) (9241) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:10,051::__init__::225::IOProcess::(_processLogs) (9241) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:10,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9241) Building response >Thread-19::DEBUG::2014-09-09 11:53:10,052::__init__::225::IOProcess::(_processLogs) (9241) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:10,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:10,053::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:53:11,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:11,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897758 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:12,424::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:12,425::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4197::DEBUG::2014-09-09 11:53:12,425::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:13,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:13,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904487 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:14,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:14,673::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) (9242) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) (9242) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:14,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9242) Building response >Thread-3443::DEBUG::2014-09-09 11:53:14,675::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:14,675::__init__::225::IOProcess::(_processLogs) (9242) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:14,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:14,680::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:53:14,682::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000869357 s, 408 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:14,683::__init__::225::IOProcess::(_processLogs) (9243) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:14,684::__init__::225::IOProcess::(_processLogs) (9243) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:14,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9243) Building response >Thread-19::DEBUG::2014-09-09 11:53:14,684::__init__::225::IOProcess::(_processLogs) (9243) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:14,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:14,685::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:15,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:15,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4198::DEBUG::2014-09-09 11:53:15,439::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:15,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:15,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895938 s, 11.4 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:53:16,503::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:53:16,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,505::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:53:16,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) (9244) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) (9244) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:16,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9244) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) (9244) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) (9245) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) (9245) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) (9246) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:16,508::__init__::225::IOProcess::(_processLogs) (9246) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:16,509::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9246) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,509::__init__::225::IOProcess::(_processLogs) (9246) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:16,509::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:53:16,510::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9245) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,510::__init__::225::IOProcess::(_processLogs) (9245) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:16,512::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-24::DEBUG::2014-09-09 11:53:16,513::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:53:16,513::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,513::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) (9247) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:53:16,514::__init__::225::IOProcess::(_processLogs) (9247) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:53:16,540::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9247) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,540::__init__::225::IOProcess::(_processLogs) (9247) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,540::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:53:16,541::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:53:16,541::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) (9248) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:53:16,542::__init__::225::IOProcess::(_processLogs) (9248) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:53:16,545::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9248) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,546::__init__::225::IOProcess::(_processLogs) (9248) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,546::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:53:16,546::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:53:16,546::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-19::DEBUG::2014-09-09 11:53:16,547::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,547::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:53:16,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,548::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,548::__init__::225::IOProcess::(_processLogs) (9249) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:16,548::__init__::225::IOProcess::(_processLogs) (9249) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:16,548::__init__::225::IOProcess::(_processLogs) (9249) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) (9250) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:16,549::__init__::225::IOProcess::(_processLogs) (9250) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:16,550::__init__::225::IOProcess::(_processLogs) (9250) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,551::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-24::DEBUG::2014-09-09 11:53:16,551::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-24::INFO::2014-09-09 11:53:16,551::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-24::INFO::2014-09-09 11:53:16,551::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:53:16,551::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) (9251) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) (9251) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:16,552::__init__::225::IOProcess::(_processLogs) (9251) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,553::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:53:16,553::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:53:16,560::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000914226 s, 599 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) (9252) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:16,561::__init__::225::IOProcess::(_processLogs) (9252) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:16,562::__init__::225::IOProcess::(_processLogs) (9252) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,562::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:16,562::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) (9253) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) (9253) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) (9253) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,563::__init__::225::IOProcess::(_processLogs) (9253) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) (9254) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) (9254) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) (9254) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) (9254) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:16,565::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) (9255) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) (9255) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) (9255) Building response >Thread-19::DEBUG::2014-09-09 11:53:16,566::__init__::225::IOProcess::(_processLogs) (9255) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:16,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:16,567::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:53:17,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:17,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:17,677::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4202::DEBUG::2014-09-09 11:53:17,677::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4202::DEBUG::2014-09-09 11:53:17,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe8a206c-41bd-4d3d-b161-7880cf231947`::moving from state init -> state preparing >Thread-4202::INFO::2014-09-09 11:53:17,678::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4202::INFO::2014-09-09 11:53:17,679::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4202::DEBUG::2014-09-09 11:53:17,679::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe8a206c-41bd-4d3d-b161-7880cf231947`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4202::DEBUG::2014-09-09 11:53:17,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe8a206c-41bd-4d3d-b161-7880cf231947`::moving from state preparing -> state finished >Thread-4202::DEBUG::2014-09-09 11:53:17,679::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4202::DEBUG::2014-09-09 11:53:17,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4202::DEBUG::2014-09-09 11:53:17,679::task::993::Storage.TaskManager.Task::(_decref) Task=`fe8a206c-41bd-4d3d-b161-7880cf231947`::ref 0 aborting False >Thread-4202::DEBUG::2014-09-09 11:53:17,679::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4202::DEBUG::2014-09-09 11:53:17,679::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:17,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904938 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:17,710::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:17,711::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4203::DEBUG::2014-09-09 11:53:17,711::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4203::DEBUG::2014-09-09 11:53:17,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`97dffa9d-54b8-465a-b383-bf59c2123261`::moving from state init -> state preparing >Thread-4203::INFO::2014-09-09 11:53:17,712::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4203::DEBUG::2014-09-09 11:53:17,712::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`51169131-3adb-4a64-ba69-9edfae3940fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4203::DEBUG::2014-09-09 11:53:17,712::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4203::DEBUG::2014-09-09 11:53:17,712::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4203::DEBUG::2014-09-09 11:53:17,712::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`51169131-3adb-4a64-ba69-9edfae3940fc`::Granted request >Thread-4203::DEBUG::2014-09-09 11:53:17,713::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`97dffa9d-54b8-465a-b383-bf59c2123261`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4203::DEBUG::2014-09-09 11:53:17,713::task::993::Storage.TaskManager.Task::(_decref) Task=`97dffa9d-54b8-465a-b383-bf59c2123261`::ref 1 aborting False >Thread-4203::INFO::2014-09-09 11:53:17,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4203::DEBUG::2014-09-09 11:53:17,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`97dffa9d-54b8-465a-b383-bf59c2123261`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4203::DEBUG::2014-09-09 11:53:17,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`97dffa9d-54b8-465a-b383-bf59c2123261`::moving from state preparing -> state finished >Thread-4203::DEBUG::2014-09-09 11:53:17,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4203::DEBUG::2014-09-09 11:53:17,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4203::DEBUG::2014-09-09 11:53:17,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4203::DEBUG::2014-09-09 11:53:17,715::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4203::DEBUG::2014-09-09 11:53:17,715::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4203::DEBUG::2014-09-09 11:53:17,715::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4203::DEBUG::2014-09-09 11:53:17,715::task::993::Storage.TaskManager.Task::(_decref) Task=`97dffa9d-54b8-465a-b383-bf59c2123261`::ref 0 aborting False >Thread-4203::DEBUG::2014-09-09 11:53:17,715::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4203::DEBUG::2014-09-09 11:53:17,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:18,455::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:18,456::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4204::DEBUG::2014-09-09 11:53:18,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:19,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:19,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0949864 s, 10.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:20,054::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:20,054::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:20,055::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:20,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:20,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:20,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:53:20,057::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:20,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:20,063::__init__::225::IOProcess::(_processLogs) (9256) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:20,064::__init__::225::IOProcess::(_processLogs) (9256) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:20,064::__init__::225::IOProcess::(_processLogs) (9256) Building response >Thread-19::DEBUG::2014-09-09 11:53:20,065::__init__::225::IOProcess::(_processLogs) (9256) Queuing response >Thread-23::DEBUG::2014-09-09 11:53:20,065::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109925 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:20,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:20,067::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:20,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:20,068::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:20,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:20,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:20,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:20,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:20,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:20,072::__init__::225::IOProcess::(_processLogs) (9257) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:20,072::__init__::225::IOProcess::(_processLogs) (9257) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:20,073::__init__::225::IOProcess::(_processLogs) (9257) Building response >Thread-19::DEBUG::2014-09-09 11:53:20,073::__init__::225::IOProcess::(_processLogs) (9257) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:20,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:20,074::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:21,471::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:21,472::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4205::DEBUG::2014-09-09 11:53:21,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2858543-6bb0-4f4d-a671-fbb2ed2237fe`::moving from state init -> state preparing >Thread-4205::INFO::2014-09-09 11:53:21,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4205::INFO::2014-09-09 11:53:21,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109925', 'lastCheck': '1.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000914226', 'lastCheck': '4.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000869357', 'lastCheck': '6.8', 'valid': True}} >Thread-4205::DEBUG::2014-09-09 11:53:21,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2858543-6bb0-4f4d-a671-fbb2ed2237fe`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109925', 'lastCheck': '1.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000914226', 'lastCheck': '4.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000869357', 'lastCheck': '6.8', 'valid': True}} >Thread-4205::DEBUG::2014-09-09 11:53:21,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2858543-6bb0-4f4d-a671-fbb2ed2237fe`::moving from state preparing -> state finished >Thread-4205::DEBUG::2014-09-09 11:53:21,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4205::DEBUG::2014-09-09 11:53:21,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4205::DEBUG::2014-09-09 11:53:21,474::task::993::Storage.TaskManager.Task::(_decref) Task=`e2858543-6bb0-4f4d-a671-fbb2ed2237fe`::ref 0 aborting False >Thread-4205::DEBUG::2014-09-09 11:53:21,475::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:21,491::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:21,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4206::DEBUG::2014-09-09 11:53:21,493::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:21,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:21,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906395 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:53:23,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:24,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898775 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:24,560::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:24,560::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4207::DEBUG::2014-09-09 11:53:24,561::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-3443::DEBUG::2014-09-09 11:53:24,685::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:53:24,686::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:53:24,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,687::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:24,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,687::__init__::225::IOProcess::(_processLogs) (9258) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:24,688::__init__::225::IOProcess::(_processLogs) (9258) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:24,689::__init__::225::IOProcess::(_processLogs) (9258) Building response >Thread-19::DEBUG::2014-09-09 11:53:24,689::__init__::225::IOProcess::(_processLogs) (9258) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,691::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:53:24,692::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:53:24,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:24,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3443::DEBUG::2014-09-09 11:53:24,694::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:53:24,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,695::__init__::225::IOProcess::(_processLogs) (9259) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:24,695::__init__::225::IOProcess::(_processLogs) (9259) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:24,695::__init__::225::IOProcess::(_processLogs) (9259) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,696::__init__::225::IOProcess::(_processLogs) (9260) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) (9260) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) (9260) Building response >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) (9260) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,697::__init__::225::IOProcess::(_processLogs) (9261) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:53:24,698::__init__::225::IOProcess::(_processLogs) (9261) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:53:24,718::__init__::225::IOProcess::(_processLogs) (9261) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,718::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-3443::DEBUG::2014-09-09 11:53:24,718::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) (9262) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:53:24,719::__init__::225::IOProcess::(_processLogs) (9262) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:53:24,722::__init__::225::IOProcess::(_processLogs) (9262) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,722::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-3443::DEBUG::2014-09-09 11:53:24,722::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) (9263) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) (9263) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:24,723::__init__::225::IOProcess::(_processLogs) (9263) Building response >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) (9263) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) (9264) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:53:24,724::__init__::225::IOProcess::(_processLogs) (9264) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:53:24,726::__init__::225::IOProcess::(_processLogs) (9264) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,726::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::DEBUG::2014-09-09 11:53:24,726::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-3443::INFO::2014-09-09 11:53:24,727::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 11:53:24,727::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) (9265) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:24,727::__init__::225::IOProcess::(_processLogs) (9265) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:24,728::__init__::225::IOProcess::(_processLogs) (9265) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,728::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:53:24,729::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:53:24,736::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000998946 s, 355 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:24,736::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:24,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:24,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:24,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:24,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:24,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:24,737::__init__::225::IOProcess::(_processLogs) (9266) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:24,737::__init__::225::IOProcess::(_processLogs) (9266) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:24,737::__init__::225::IOProcess::(_processLogs) DEBUG|(9266) Building response >Thread-19::DEBUG::2014-09-09 11:53:24,737::__init__::225::IOProcess::(_processLogs) (9266) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:24,738::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:24,738::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:53:26,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:26,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090365 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:26,566::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:26,566::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:26,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:26,567::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:26,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:26,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:26,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:26,567::__init__::225::IOProcess::(_processLogs) (9267) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:26,567::__init__::225::IOProcess::(_processLogs) (9267) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:26,568::__init__::225::IOProcess::(_processLogs) DEBUG|(9267) Building response >Thread-19::DEBUG::2014-09-09 11:53:26,568::__init__::225::IOProcess::(_processLogs) (9267) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:26,568::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:26,568::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:53:26,569::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:53:26,576::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00106444 s, 515 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) (9268) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:26,577::__init__::225::IOProcess::(_processLogs) (9268) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:26,578::__init__::225::IOProcess::(_processLogs) DEBUG|(9268) Building response >Thread-19::DEBUG::2014-09-09 11:53:26,578::__init__::225::IOProcess::(_processLogs) (9268) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:26,578::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:26,579::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:26,579::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:26,579::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:53:26,579::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:26,579::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:26,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) (9269) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) (9269) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) (9269) Building response >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) (9269) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:26,580::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) (9270) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) (9270) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) (9270) Building response >Thread-19::DEBUG::2014-09-09 11:53:26,581::__init__::225::IOProcess::(_processLogs) (9270) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:26,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:26,582::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:26,582::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:26,582::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:53:26,582::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:26,582::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) (9271) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) (9271) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) (9271) Building response >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) (9271) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:26,583::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:27,576::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:27,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4211::DEBUG::2014-09-09 11:53:27,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:27,755::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4212::DEBUG::2014-09-09 11:53:27,756::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:53:27,756::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4212::DEBUG::2014-09-09 11:53:27,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9a6335a-166c-4d44-92f4-1e0f9a3839d4`::moving from state init -> state preparing >Thread-4212::INFO::2014-09-09 11:53:27,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4212::INFO::2014-09-09 11:53:27,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4212::DEBUG::2014-09-09 11:53:27,757::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9a6335a-166c-4d44-92f4-1e0f9a3839d4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4212::DEBUG::2014-09-09 11:53:27,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9a6335a-166c-4d44-92f4-1e0f9a3839d4`::moving from state preparing -> state finished >Thread-4212::DEBUG::2014-09-09 11:53:27,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4212::DEBUG::2014-09-09 11:53:27,757::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4212::DEBUG::2014-09-09 11:53:27,757::task::993::Storage.TaskManager.Task::(_decref) Task=`b9a6335a-166c-4d44-92f4-1e0f9a3839d4`::ref 0 aborting False >Thread-4212::DEBUG::2014-09-09 11:53:27,757::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4212::DEBUG::2014-09-09 11:53:27,757::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:27,796::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:27,796::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4213::DEBUG::2014-09-09 11:53:27,796::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4213::DEBUG::2014-09-09 11:53:27,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`64651c98-b48e-4f29-bcef-7f1dc38ead6c`::moving from state init -> state preparing >Thread-4213::INFO::2014-09-09 11:53:27,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4213::DEBUG::2014-09-09 11:53:27,797::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`910e58ae-c3ad-4e54-a7f3-ee95f559acad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4213::DEBUG::2014-09-09 11:53:27,797::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4213::DEBUG::2014-09-09 11:53:27,797::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4213::DEBUG::2014-09-09 11:53:27,798::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`910e58ae-c3ad-4e54-a7f3-ee95f559acad`::Granted request >Thread-4213::DEBUG::2014-09-09 11:53:27,798::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`64651c98-b48e-4f29-bcef-7f1dc38ead6c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4213::DEBUG::2014-09-09 11:53:27,798::task::993::Storage.TaskManager.Task::(_decref) Task=`64651c98-b48e-4f29-bcef-7f1dc38ead6c`::ref 1 aborting False >Thread-4213::INFO::2014-09-09 11:53:27,799::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4213::DEBUG::2014-09-09 11:53:27,800::task::1191::Storage.TaskManager.Task::(prepare) Task=`64651c98-b48e-4f29-bcef-7f1dc38ead6c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4213::DEBUG::2014-09-09 11:53:27,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`64651c98-b48e-4f29-bcef-7f1dc38ead6c`::moving from state preparing -> state finished >Thread-4213::DEBUG::2014-09-09 11:53:27,800::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4213::DEBUG::2014-09-09 11:53:27,800::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4213::DEBUG::2014-09-09 11:53:27,800::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4213::DEBUG::2014-09-09 11:53:27,800::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4213::DEBUG::2014-09-09 11:53:27,800::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4213::DEBUG::2014-09-09 11:53:27,800::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4213::DEBUG::2014-09-09 11:53:27,800::task::993::Storage.TaskManager.Task::(_decref) Task=`64651c98-b48e-4f29-bcef-7f1dc38ead6c`::ref 0 aborting False >Thread-4213::DEBUG::2014-09-09 11:53:27,800::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283248689152', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4213::DEBUG::2014-09-09 11:53:27,801::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:28,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:28,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896752 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) (9272) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:30,072::__init__::225::IOProcess::(_processLogs) (9272) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:30,073::__init__::225::IOProcess::(_processLogs) DEBUG|(9272) Building response >Thread-19::DEBUG::2014-09-09 11:53:30,073::__init__::225::IOProcess::(_processLogs) (9272) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:30,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:30,073::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:53:30,074::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:53:30,081::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116028 s, 968 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:30,081::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:30,081::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:30,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) (9273) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) (9273) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) DEBUG|(9273) Building response >Thread-19::DEBUG::2014-09-09 11:53:30,082::__init__::225::IOProcess::(_processLogs) (9273) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:30,083::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:30,083::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:53:30,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:30,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900798 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:30,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:30,591::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4214::DEBUG::2014-09-09 11:53:30,592::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:32,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:32,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896893 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:33,606::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:33,606::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4215::DEBUG::2014-09-09 11:53:33,607::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:34,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:34,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903523 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) (9274) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:34,739::__init__::225::IOProcess::(_processLogs) (9274) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:34,741::__init__::225::IOProcess::(_processLogs) DEBUG|(9274) Building response >Thread-19::DEBUG::2014-09-09 11:53:34,741::__init__::225::IOProcess::(_processLogs) (9274) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:34,741::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:53:34,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:34,742::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:53:34,750::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00103845 s, 342 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:34,750::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:34,750::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:34,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:34,750::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) (9275) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) (9275) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) DEBUG|(9275) Building response >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) (9275) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:34,751::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:34,752::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:36,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:36,584::__init__::225::IOProcess::(_processLogs) (9276) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:36,584::__init__::225::IOProcess::(_processLogs) (9276) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:36,584::__init__::225::IOProcess::(_processLogs) DEBUG|(9276) Building response >Thread-19::DEBUG::2014-09-09 11:53:36,584::__init__::225::IOProcess::(_processLogs) (9276) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:36,584::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:36,584::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:53:36,585::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:53:36,592::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00117394 s, 467 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:36,593::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:36,593::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:36,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:36,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:36,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:36,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:36,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:36,594::__init__::225::IOProcess::(_processLogs) (9277) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:36,594::__init__::225::IOProcess::(_processLogs) (9277) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:36,594::__init__::225::IOProcess::(_processLogs) (9277) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:36,594::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) (9278) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) (9278) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:36,595::__init__::225::IOProcess::(_processLogs) (9278) Building response >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) (9278) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:36,596::__init__::225::IOProcess::(_processLogs) (9279) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) (9279) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) (9279) Building response >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) (9279) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:53:36,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) (9280) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) (9280) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) (9280) Building response >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) (9280) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:36,598::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:53:36,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:36,618::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:36,619::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4216::DEBUG::2014-09-09 11:53:36,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e19bbaf-67d1-49b5-9d95-25735577cfdb`::moving from state init -> state preparing >Thread-4216::INFO::2014-09-09 11:53:36,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4216::INFO::2014-09-09 11:53:36,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116028', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117394', 'lastCheck': '0.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103845', 'lastCheck': '1.9', 'valid': True}} >Thread-4216::DEBUG::2014-09-09 11:53:36,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e19bbaf-67d1-49b5-9d95-25735577cfdb`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116028', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117394', 'lastCheck': '0.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103845', 'lastCheck': '1.9', 'valid': True}} >Thread-4216::DEBUG::2014-09-09 11:53:36,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e19bbaf-67d1-49b5-9d95-25735577cfdb`::moving from state preparing -> state finished >Thread-4216::DEBUG::2014-09-09 11:53:36,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4216::DEBUG::2014-09-09 11:53:36,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4216::DEBUG::2014-09-09 11:53:36,621::task::993::Storage.TaskManager.Task::(_decref) Task=`4e19bbaf-67d1-49b5-9d95-25735577cfdb`::ref 0 aborting False >Thread-4216::DEBUG::2014-09-09 11:53:36,622::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:36,640::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:36,641::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4217::DEBUG::2014-09-09 11:53:36,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:36,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905884 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:37,847::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:37,848::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4218::DEBUG::2014-09-09 11:53:37,848::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4218::DEBUG::2014-09-09 11:53:37,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`007490c8-7f03-428a-aec2-f47cd6c1882e`::moving from state init -> state preparing >Thread-4218::INFO::2014-09-09 11:53:37,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4218::INFO::2014-09-09 11:53:37,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4218::DEBUG::2014-09-09 11:53:37,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`007490c8-7f03-428a-aec2-f47cd6c1882e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4218::DEBUG::2014-09-09 11:53:37,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`007490c8-7f03-428a-aec2-f47cd6c1882e`::moving from state preparing -> state finished >Thread-4218::DEBUG::2014-09-09 11:53:37,849::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4218::DEBUG::2014-09-09 11:53:37,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4218::DEBUG::2014-09-09 11:53:37,849::task::993::Storage.TaskManager.Task::(_decref) Task=`007490c8-7f03-428a-aec2-f47cd6c1882e`::ref 0 aborting False >Thread-4218::DEBUG::2014-09-09 11:53:37,850::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4218::DEBUG::2014-09-09 11:53:37,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:37,886::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:37,887::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4219::DEBUG::2014-09-09 11:53:37,887::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4219::DEBUG::2014-09-09 11:53:37,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b5ab972-d400-44f4-8c30-9bd6955da1ca`::moving from state init -> state preparing >Thread-4219::INFO::2014-09-09 11:53:37,888::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4219::DEBUG::2014-09-09 11:53:37,888::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d908b5b2-60ce-481c-a663-61bce0d81a0d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4219::DEBUG::2014-09-09 11:53:37,888::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4219::DEBUG::2014-09-09 11:53:37,888::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4219::DEBUG::2014-09-09 11:53:37,888::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d908b5b2-60ce-481c-a663-61bce0d81a0d`::Granted request >Thread-4219::DEBUG::2014-09-09 11:53:37,889::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0b5ab972-d400-44f4-8c30-9bd6955da1ca`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4219::DEBUG::2014-09-09 11:53:37,889::task::993::Storage.TaskManager.Task::(_decref) Task=`0b5ab972-d400-44f4-8c30-9bd6955da1ca`::ref 1 aborting False >Thread-4219::INFO::2014-09-09 11:53:37,890::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4219::DEBUG::2014-09-09 11:53:37,890::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b5ab972-d400-44f4-8c30-9bd6955da1ca`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4219::DEBUG::2014-09-09 11:53:37,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b5ab972-d400-44f4-8c30-9bd6955da1ca`::moving from state preparing -> state finished >Thread-4219::DEBUG::2014-09-09 11:53:37,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4219::DEBUG::2014-09-09 11:53:37,891::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4219::DEBUG::2014-09-09 11:53:37,891::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4219::DEBUG::2014-09-09 11:53:37,891::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4219::DEBUG::2014-09-09 11:53:37,891::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4219::DEBUG::2014-09-09 11:53:37,891::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4219::DEBUG::2014-09-09 11:53:37,891::task::993::Storage.TaskManager.Task::(_decref) Task=`0b5ab972-d400-44f4-8c30-9bd6955da1ca`::ref 0 aborting False >Thread-4219::DEBUG::2014-09-09 11:53:37,891::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4219::DEBUG::2014-09-09 11:53:37,891::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:38,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:38,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898345 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:39,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:39,698::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4220::DEBUG::2014-09-09 11:53:39,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) (9281) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:40,084::__init__::225::IOProcess::(_processLogs) (9281) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:40,085::__init__::225::IOProcess::(_processLogs) (9281) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:40,085::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:53:40,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:53:40,094::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119794 s, 937 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:40,094::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:40,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:40,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:40,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:40,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:40,095::__init__::225::IOProcess::(_processLogs) (9282) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:40,095::__init__::225::IOProcess::(_processLogs) (9282) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:40,095::__init__::225::IOProcess::(_processLogs) (9282) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:40,095::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:53:40,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:40,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898514 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:42,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:42,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4221::DEBUG::2014-09-09 11:53:42,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:42,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:43,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897097 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) (9283) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:44,753::__init__::225::IOProcess::(_processLogs) (9283) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:44,754::__init__::225::IOProcess::(_processLogs) (9283) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:44,754::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:53:44,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:53:44,761::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000991908 s, 358 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) (9284) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) (9284) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:44,762::__init__::225::IOProcess::(_processLogs) (9284) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:44,763::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:53:45,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:45,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897867 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:45,749::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:45,750::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4222::DEBUG::2014-09-09 11:53:45,751::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:53:46,598::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:46,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:46,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:46,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:46,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:46,599::__init__::225::IOProcess::(_processLogs) (9285) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:46,599::__init__::225::IOProcess::(_processLogs) (9285) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:46,600::__init__::225::IOProcess::(_processLogs) (9285) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:46,600::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:53:46,601::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:53:46,608::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000938428 s, 584 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) (9286) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) (9286) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:46,609::__init__::225::IOProcess::(_processLogs) (9286) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:46,610::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:46,611::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:53:46,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:46,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:46,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:46,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:46,612::__init__::225::IOProcess::(_processLogs) (9287) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:46,612::__init__::225::IOProcess::(_processLogs) (9287) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:46,612::__init__::225::IOProcess::(_processLogs) (9287) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:46,612::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:46,612::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) (9288) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) (9288) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) (9288) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:46,613::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:46,614::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:53:46,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:46,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:46,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) (9289) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) (9289) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) (9289) Building response >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) (9289) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:46,615::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:53:47,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:47,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899446 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:47,939::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4223::DEBUG::2014-09-09 11:53:47,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:53:47,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4223::DEBUG::2014-09-09 11:53:47,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`61652670-c479-4738-b802-2b5b172dac1b`::moving from state init -> state preparing >Thread-4223::INFO::2014-09-09 11:53:47,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4223::INFO::2014-09-09 11:53:47,941::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4223::DEBUG::2014-09-09 11:53:47,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`61652670-c479-4738-b802-2b5b172dac1b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4223::DEBUG::2014-09-09 11:53:47,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`61652670-c479-4738-b802-2b5b172dac1b`::moving from state preparing -> state finished >Thread-4223::DEBUG::2014-09-09 11:53:47,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4223::DEBUG::2014-09-09 11:53:47,941::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4223::DEBUG::2014-09-09 11:53:47,941::task::993::Storage.TaskManager.Task::(_decref) Task=`61652670-c479-4738-b802-2b5b172dac1b`::ref 0 aborting False >Thread-4223::DEBUG::2014-09-09 11:53:47,942::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4223::DEBUG::2014-09-09 11:53:47,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:47,969::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:47,969::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4224::DEBUG::2014-09-09 11:53:47,969::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4224::DEBUG::2014-09-09 11:53:47,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`a432776b-e61a-4fee-8dad-79154f827b18`::moving from state init -> state preparing >Thread-4224::INFO::2014-09-09 11:53:47,970::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4224::DEBUG::2014-09-09 11:53:47,970::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`35d0fd7d-fbd6-43d7-9365-80a3f59cfd37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4224::DEBUG::2014-09-09 11:53:47,971::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4224::DEBUG::2014-09-09 11:53:47,971::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4224::DEBUG::2014-09-09 11:53:47,971::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`35d0fd7d-fbd6-43d7-9365-80a3f59cfd37`::Granted request >Thread-4224::DEBUG::2014-09-09 11:53:47,971::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a432776b-e61a-4fee-8dad-79154f827b18`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4224::DEBUG::2014-09-09 11:53:47,971::task::993::Storage.TaskManager.Task::(_decref) Task=`a432776b-e61a-4fee-8dad-79154f827b18`::ref 1 aborting False >Thread-4224::INFO::2014-09-09 11:53:47,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4224::DEBUG::2014-09-09 11:53:47,973::task::1191::Storage.TaskManager.Task::(prepare) Task=`a432776b-e61a-4fee-8dad-79154f827b18`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4224::DEBUG::2014-09-09 11:53:47,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`a432776b-e61a-4fee-8dad-79154f827b18`::moving from state preparing -> state finished >Thread-4224::DEBUG::2014-09-09 11:53:47,973::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4224::DEBUG::2014-09-09 11:53:47,973::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4224::DEBUG::2014-09-09 11:53:47,973::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4224::DEBUG::2014-09-09 11:53:47,973::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4224::DEBUG::2014-09-09 11:53:47,973::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4224::DEBUG::2014-09-09 11:53:47,974::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4224::DEBUG::2014-09-09 11:53:47,974::task::993::Storage.TaskManager.Task::(_decref) Task=`a432776b-e61a-4fee-8dad-79154f827b18`::ref 0 aborting False >Thread-4224::DEBUG::2014-09-09 11:53:47,974::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4224::DEBUG::2014-09-09 11:53:47,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:48,764::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:48,764::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4225::DEBUG::2014-09-09 11:53:48,765::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:49,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:49,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0999432 s, 10.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:50,097::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:50,097::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:50,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:50,098::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:50,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:50,100::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:53:50,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:50,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:50,106::__init__::225::IOProcess::(_processLogs) (9290) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:50,107::__init__::225::IOProcess::(_processLogs) (9290) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:50,107::__init__::225::IOProcess::(_processLogs) (9290) Building response >Thread-19::DEBUG::2014-09-09 11:53:50,108::__init__::225::IOProcess::(_processLogs) (9290) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:50,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:53:50,109::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010457 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:50,110::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:50,111::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:50,111::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:53:50,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:50,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:50,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:50,113::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:50,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:50,115::__init__::225::IOProcess::(_processLogs) (9291) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:50,115::__init__::225::IOProcess::(_processLogs) (9291) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:50,116::__init__::225::IOProcess::(_processLogs) (9291) Building response >Thread-19::DEBUG::2014-09-09 11:53:50,116::__init__::225::IOProcess::(_processLogs) (9291) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:50,117::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:50,117::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:53:51,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:51,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896825 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:51,775::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:51,776::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4226::DEBUG::2014-09-09 11:53:51,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f3ef90c-c460-4508-80a1-f79262c8a91f`::moving from state init -> state preparing >Thread-4226::INFO::2014-09-09 11:53:51,777::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4226::INFO::2014-09-09 11:53:51,777::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010457', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000938428', 'lastCheck': '5.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000991908', 'lastCheck': '7.0', 'valid': True}} >Thread-4226::DEBUG::2014-09-09 11:53:51,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f3ef90c-c460-4508-80a1-f79262c8a91f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010457', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000938428', 'lastCheck': '5.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000991908', 'lastCheck': '7.0', 'valid': True}} >Thread-4226::DEBUG::2014-09-09 11:53:51,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f3ef90c-c460-4508-80a1-f79262c8a91f`::moving from state preparing -> state finished >Thread-4226::DEBUG::2014-09-09 11:53:51,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4226::DEBUG::2014-09-09 11:53:51,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4226::DEBUG::2014-09-09 11:53:51,778::task::993::Storage.TaskManager.Task::(_decref) Task=`4f3ef90c-c460-4508-80a1-f79262c8a91f`::ref 0 aborting False >Thread-4226::DEBUG::2014-09-09 11:53:51,779::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:51,794::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:51,795::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4227::DEBUG::2014-09-09 11:53:51,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:53,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:53,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899876 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:54,764::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:54,764::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:54,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:54,764::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:54,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:54,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:54,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:54,765::__init__::225::IOProcess::(_processLogs) (9292) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:54,765::__init__::225::IOProcess::(_processLogs) (9292) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:54,765::__init__::225::IOProcess::(_processLogs) DEBUG|(9292) Building response >Thread-19::DEBUG::2014-09-09 11:53:54,766::__init__::225::IOProcess::(_processLogs) (9292) Queuing response >Thread-3443::DEBUG::2014-09-09 11:53:54,766::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:54,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:54,771::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:53:54,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00107777 s, 329 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:54,773::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:54,773::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:53:54,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) (9293) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) (9293) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) DEBUG|(9293) Building response >Thread-19::DEBUG::2014-09-09 11:53:54,774::__init__::225::IOProcess::(_processLogs) (9293) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:54,775::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:54,775::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:54,874::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:54,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4228::DEBUG::2014-09-09 11:53:54,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:55,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:55,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897114 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:56,615::__init__::225::IOProcess::(_processLogs) (9294) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:56,616::__init__::225::IOProcess::(_processLogs) (9294) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:56,616::__init__::225::IOProcess::(_processLogs) DEBUG|(9294) Building response >Thread-19::DEBUG::2014-09-09 11:53:56,616::__init__::225::IOProcess::(_processLogs) (9294) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:56,616::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:53:56,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:53:56,617::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:53:56,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000949257 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:53:56,625::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:56,625::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:53:56,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:56,625::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:56,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:56,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:56,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:56,626::__init__::225::IOProcess::(_processLogs) (9295) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:53:56,626::__init__::225::IOProcess::(_processLogs) (9295) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:53:56,626::__init__::225::IOProcess::(_processLogs) DEBUG|(9295) Building response >Thread-19::DEBUG::2014-09-09 11:53:56,626::__init__::225::IOProcess::(_processLogs) (9295) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:56,626::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:53:56,627::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:53:56,627::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:56,627::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:53:56,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:56,627::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) (9296) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) (9296) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) (9296) Building response >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) (9296) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:56,628::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) (9297) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) (9297) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:56,629::__init__::225::IOProcess::(_processLogs) (9297) Building response >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) (9297) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:53:56,630::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) (9298) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) (9298) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) (9298) Building response >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) (9298) Queuing response >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:53:56,631::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:53:57,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:57,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898495 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:57,882::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:57,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4229::DEBUG::2014-09-09 11:53:57,884::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:58,015::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:58,016::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4230::DEBUG::2014-09-09 11:53:58,016::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4230::DEBUG::2014-09-09 11:53:58,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`b59f44ad-c9b9-426e-b75b-b30d67d7e268`::moving from state init -> state preparing >Thread-4230::INFO::2014-09-09 11:53:58,016::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4230::INFO::2014-09-09 11:53:58,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4230::DEBUG::2014-09-09 11:53:58,017::task::1191::Storage.TaskManager.Task::(prepare) Task=`b59f44ad-c9b9-426e-b75b-b30d67d7e268`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4230::DEBUG::2014-09-09 11:53:58,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`b59f44ad-c9b9-426e-b75b-b30d67d7e268`::moving from state preparing -> state finished >Thread-4230::DEBUG::2014-09-09 11:53:58,017::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4230::DEBUG::2014-09-09 11:53:58,017::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4230::DEBUG::2014-09-09 11:53:58,017::task::993::Storage.TaskManager.Task::(_decref) Task=`b59f44ad-c9b9-426e-b75b-b30d67d7e268`::ref 0 aborting False >Thread-4230::DEBUG::2014-09-09 11:53:58,017::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4230::DEBUG::2014-09-09 11:53:58,017::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:53:58,056::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:53:58,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4231::DEBUG::2014-09-09 11:53:58,056::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4231::DEBUG::2014-09-09 11:53:58,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`11a69836-6950-49f5-acd5-e656f7d1234d`::moving from state init -> state preparing >Thread-4231::INFO::2014-09-09 11:53:58,058::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4231::DEBUG::2014-09-09 11:53:58,058::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca78448f-a74a-45a1-8a1e-691e140592dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4231::DEBUG::2014-09-09 11:53:58,058::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4231::DEBUG::2014-09-09 11:53:58,059::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4231::DEBUG::2014-09-09 11:53:58,059::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca78448f-a74a-45a1-8a1e-691e140592dc`::Granted request >Thread-4231::DEBUG::2014-09-09 11:53:58,059::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`11a69836-6950-49f5-acd5-e656f7d1234d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4231::DEBUG::2014-09-09 11:53:58,059::task::993::Storage.TaskManager.Task::(_decref) Task=`11a69836-6950-49f5-acd5-e656f7d1234d`::ref 1 aborting False >Thread-4231::INFO::2014-09-09 11:53:58,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4231::DEBUG::2014-09-09 11:53:58,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`11a69836-6950-49f5-acd5-e656f7d1234d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4231::DEBUG::2014-09-09 11:53:58,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`11a69836-6950-49f5-acd5-e656f7d1234d`::moving from state preparing -> state finished >Thread-4231::DEBUG::2014-09-09 11:53:58,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4231::DEBUG::2014-09-09 11:53:58,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4231::DEBUG::2014-09-09 11:53:58,061::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4231::DEBUG::2014-09-09 11:53:58,061::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4231::DEBUG::2014-09-09 11:53:58,061::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4231::DEBUG::2014-09-09 11:53:58,061::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4231::DEBUG::2014-09-09 11:53:58,061::task::993::Storage.TaskManager.Task::(_decref) Task=`11a69836-6950-49f5-acd5-e656f7d1234d`::ref 0 aborting False >Thread-4231::DEBUG::2014-09-09 11:53:58,062::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4231::DEBUG::2014-09-09 11:53:58,062::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:53:59,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:53:59,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896105 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:00,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:00,116::__init__::225::IOProcess::(_processLogs) (9299) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:00,116::__init__::225::IOProcess::(_processLogs) (9299) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:00,116::__init__::225::IOProcess::(_processLogs) DEBUG|(9299) Building response >Thread-19::DEBUG::2014-09-09 11:54:00,116::__init__::225::IOProcess::(_processLogs) (9299) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:00,116::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:00,117::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:54:00,117::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:54:00,125::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119939 s, 936 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:00,125::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:00,125::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:00,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:00,125::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) (9300) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) (9300) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) DEBUG|(9300) Building response >Thread-19::DEBUG::2014-09-09 11:54:00,126::__init__::225::IOProcess::(_processLogs) (9300) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:00,127::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:00,127::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:00,899::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:00,900::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4232::DEBUG::2014-09-09 11:54:00,901::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:01,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:02,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900849 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:03,914::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:03,915::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4233::DEBUG::2014-09-09 11:54:03,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:04,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:04,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903555 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) (9301) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:04,776::__init__::225::IOProcess::(_processLogs) (9301) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:04,777::__init__::225::IOProcess::(_processLogs) DEBUG|(9301) Building response >Thread-19::DEBUG::2014-09-09 11:54:04,777::__init__::225::IOProcess::(_processLogs) (9301) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:04,777::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:54:04,777::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:04,778::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:54:04,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00100807 s, 352 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:04,786::__init__::225::IOProcess::(_processLogs) (9302) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:04,787::__init__::225::IOProcess::(_processLogs) (9302) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:04,787::__init__::225::IOProcess::(_processLogs) DEBUG|(9302) Building response >Thread-19::DEBUG::2014-09-09 11:54:04,787::__init__::225::IOProcess::(_processLogs) (9302) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:04,787::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:04,788::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:06,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:06,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897708 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:06,631::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:06,631::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:06,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:06,631::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:06,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:06,632::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:06,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:06,632::__init__::225::IOProcess::(_processLogs) (9303) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:06,632::__init__::225::IOProcess::(_processLogs) (9303) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:06,632::__init__::225::IOProcess::(_processLogs) DEBUG|(9303) Building response >Thread-19::DEBUG::2014-09-09 11:54:06,633::__init__::225::IOProcess::(_processLogs) (9303) Queuing response >Thread-24::DEBUG::2014-09-09 11:54:06,633::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:06,633::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:06,638::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:54:06,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104449 s, 525 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:06,641::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:06,641::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:06,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:06,641::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) (9304) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) (9304) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) DEBUG|(9304) Building response >Thread-19::DEBUG::2014-09-09 11:54:06,642::__init__::225::IOProcess::(_processLogs) (9304) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:06,643::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:06,643::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:06,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:06,643::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:54:06,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) (9305) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) (9305) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) (9305) Building response >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) (9305) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:06,644::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:06,645::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:06,645::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:54:06,645::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:06,645::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:06,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:06,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) (9306) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) (9306) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) (9306) Building response >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) (9306) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:06,646::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:06,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:06,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:06,647::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:06,647::__init__::225::IOProcess::(_processLogs) (9307) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:06,647::__init__::225::IOProcess::(_processLogs) (9307) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:06,648::__init__::225::IOProcess::(_processLogs) DEBUG|(9307) Building response >Thread-19::DEBUG::2014-09-09 11:54:06,648::__init__::225::IOProcess::(_processLogs) (9307) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:06,648::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:06,648::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:06,927::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:06,928::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4234::DEBUG::2014-09-09 11:54:06,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`47305de7-c796-4d83-9d01-4fb1aa93c58f`::moving from state init -> state preparing >Thread-4234::INFO::2014-09-09 11:54:06,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4234::INFO::2014-09-09 11:54:06,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119939', 'lastCheck': '6.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104449', 'lastCheck': '0.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100807', 'lastCheck': '2.1', 'valid': True}} >Thread-4234::DEBUG::2014-09-09 11:54:06,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`47305de7-c796-4d83-9d01-4fb1aa93c58f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119939', 'lastCheck': '6.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104449', 'lastCheck': '0.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100807', 'lastCheck': '2.1', 'valid': True}} >Thread-4234::DEBUG::2014-09-09 11:54:06,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`47305de7-c796-4d83-9d01-4fb1aa93c58f`::moving from state preparing -> state finished >Thread-4234::DEBUG::2014-09-09 11:54:06,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4234::DEBUG::2014-09-09 11:54:06,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4234::DEBUG::2014-09-09 11:54:06,930::task::993::Storage.TaskManager.Task::(_decref) Task=`47305de7-c796-4d83-9d01-4fb1aa93c58f`::ref 0 aborting False >Thread-4234::DEBUG::2014-09-09 11:54:06,931::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:06,942::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:06,943::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4235::DEBUG::2014-09-09 11:54:06,944::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:08,108::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:08,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4236::DEBUG::2014-09-09 11:54:08,109::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4236::DEBUG::2014-09-09 11:54:08,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b640e20-cd36-48cb-b315-4fdde662a593`::moving from state init -> state preparing >Thread-4236::INFO::2014-09-09 11:54:08,110::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4236::INFO::2014-09-09 11:54:08,110::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4236::DEBUG::2014-09-09 11:54:08,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b640e20-cd36-48cb-b315-4fdde662a593`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4236::DEBUG::2014-09-09 11:54:08,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b640e20-cd36-48cb-b315-4fdde662a593`::moving from state preparing -> state finished >Thread-4236::DEBUG::2014-09-09 11:54:08,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4236::DEBUG::2014-09-09 11:54:08,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4236::DEBUG::2014-09-09 11:54:08,110::task::993::Storage.TaskManager.Task::(_decref) Task=`6b640e20-cd36-48cb-b315-4fdde662a593`::ref 0 aborting False >Thread-4236::DEBUG::2014-09-09 11:54:08,111::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4236::DEBUG::2014-09-09 11:54:08,111::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:08,155::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4237::DEBUG::2014-09-09 11:54:08,155::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:54:08,155::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4237::DEBUG::2014-09-09 11:54:08,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e00d945-b027-446a-8400-ed8266a17d0a`::moving from state init -> state preparing >Thread-4237::INFO::2014-09-09 11:54:08,156::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4237::DEBUG::2014-09-09 11:54:08,156::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`055cfc92-250d-4fcc-a459-5186baca8943`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4237::DEBUG::2014-09-09 11:54:08,157::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4237::DEBUG::2014-09-09 11:54:08,157::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4237::DEBUG::2014-09-09 11:54:08,157::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`055cfc92-250d-4fcc-a459-5186baca8943`::Granted request >Thread-4237::DEBUG::2014-09-09 11:54:08,158::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e00d945-b027-446a-8400-ed8266a17d0a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4237::DEBUG::2014-09-09 11:54:08,158::task::993::Storage.TaskManager.Task::(_decref) Task=`3e00d945-b027-446a-8400-ed8266a17d0a`::ref 1 aborting False >Thread-4237::INFO::2014-09-09 11:54:08,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4237::DEBUG::2014-09-09 11:54:08,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e00d945-b027-446a-8400-ed8266a17d0a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4237::DEBUG::2014-09-09 11:54:08,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e00d945-b027-446a-8400-ed8266a17d0a`::moving from state preparing -> state finished >Thread-4237::DEBUG::2014-09-09 11:54:08,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4237::DEBUG::2014-09-09 11:54:08,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4237::DEBUG::2014-09-09 11:54:08,160::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4237::DEBUG::2014-09-09 11:54:08,160::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4237::DEBUG::2014-09-09 11:54:08,160::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4237::DEBUG::2014-09-09 11:54:08,160::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4237::DEBUG::2014-09-09 11:54:08,160::task::993::Storage.TaskManager.Task::(_decref) Task=`3e00d945-b027-446a-8400-ed8266a17d0a`::ref 0 aborting False >Thread-4237::DEBUG::2014-09-09 11:54:08,161::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4237::DEBUG::2014-09-09 11:54:08,161::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:08,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:08,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900074 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:10,019::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:10,020::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4238::DEBUG::2014-09-09 11:54:10,020::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:54:10,127::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) (9308) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:10,128::__init__::225::IOProcess::(_processLogs) (9308) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:10,129::__init__::225::IOProcess::(_processLogs) DEBUG|(9308) Building response >Thread-19::DEBUG::2014-09-09 11:54:10,129::__init__::225::IOProcess::(_processLogs) (9308) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:10,130::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:10,130::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:54:10,130::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:54:10,139::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106197 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) (9309) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:10,140::__init__::225::IOProcess::(_processLogs) (9309) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:10,141::__init__::225::IOProcess::(_processLogs) DEBUG|(9309) Building response >Thread-19::DEBUG::2014-09-09 11:54:10,141::__init__::225::IOProcess::(_processLogs) (9309) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:10,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:10,142::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:10,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:10,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903924 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:54:12,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:12,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898196 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:13,029::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:13,030::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4239::DEBUG::2014-09-09 11:54:13,031::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:14,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:14,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905876 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:14,788::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:14,788::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:14,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) (9310) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) (9310) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:14,789::__init__::225::IOProcess::(_processLogs) (9310) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:14,790::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:54:14,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:54:14,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00103781 s, 342 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:14,798::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:14,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:14,798::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:14,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:14,798::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:14,798::__init__::225::IOProcess::(_processLogs) (9311) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:14,799::__init__::225::IOProcess::(_processLogs) (9311) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:14,799::__init__::225::IOProcess::(_processLogs) (9311) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:14,799::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:16,042::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:16,043::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4240::DEBUG::2014-09-09 11:54:16,044::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) (9312) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:16,649::__init__::225::IOProcess::(_processLogs) (9312) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:16,650::__init__::225::IOProcess::(_processLogs) DEBUG|(9312) Building response >Thread-19::DEBUG::2014-09-09 11:54:16,650::__init__::225::IOProcess::(_processLogs) (9312) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:16,651::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:16,651::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:54:16,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:54:16,660::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000987451 s, 555 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:16,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:16,662::__init__::225::IOProcess::(_processLogs) (9313) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:16,662::__init__::225::IOProcess::(_processLogs) (9313) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:16,662::__init__::225::IOProcess::(_processLogs) DEBUG|(9313) Building response >Thread-19::DEBUG::2014-09-09 11:54:16,662::__init__::225::IOProcess::(_processLogs) (9313) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:16,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:16,662::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:16,663::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:16,663::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:54:16,663::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) (9314) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) (9314) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) (9314) Building response >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) (9314) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:16,664::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:16,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) (9315) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) (9315) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) (9315) Building response >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) (9315) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:16,666::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) (9316) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) (9316) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) (9316) Building response >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) (9316) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:16,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:16,668::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:54:16,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:16,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899278 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:18,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:18,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4241::DEBUG::2014-09-09 11:54:18,207::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4241::DEBUG::2014-09-09 11:54:18,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a1e0cf5-1133-4cda-ada0-5c0905fc3b57`::moving from state init -> state preparing >Thread-4241::INFO::2014-09-09 11:54:18,208::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4241::INFO::2014-09-09 11:54:18,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4241::DEBUG::2014-09-09 11:54:18,209::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a1e0cf5-1133-4cda-ada0-5c0905fc3b57`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4241::DEBUG::2014-09-09 11:54:18,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a1e0cf5-1133-4cda-ada0-5c0905fc3b57`::moving from state preparing -> state finished >Thread-4241::DEBUG::2014-09-09 11:54:18,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4241::DEBUG::2014-09-09 11:54:18,209::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4241::DEBUG::2014-09-09 11:54:18,209::task::993::Storage.TaskManager.Task::(_decref) Task=`9a1e0cf5-1133-4cda-ada0-5c0905fc3b57`::ref 0 aborting False >Thread-4241::DEBUG::2014-09-09 11:54:18,209::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4241::DEBUG::2014-09-09 11:54:18,209::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:18,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:18,255::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4242::DEBUG::2014-09-09 11:54:18,255::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4242::DEBUG::2014-09-09 11:54:18,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d410407-989f-44d8-928e-50746877f595`::moving from state init -> state preparing >Thread-4242::INFO::2014-09-09 11:54:18,256::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4242::DEBUG::2014-09-09 11:54:18,256::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`52a95585-991e-4b00-b9fe-b28c3e88add3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4242::DEBUG::2014-09-09 11:54:18,256::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4242::DEBUG::2014-09-09 11:54:18,256::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4242::DEBUG::2014-09-09 11:54:18,257::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`52a95585-991e-4b00-b9fe-b28c3e88add3`::Granted request >Thread-4242::DEBUG::2014-09-09 11:54:18,257::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7d410407-989f-44d8-928e-50746877f595`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4242::DEBUG::2014-09-09 11:54:18,257::task::993::Storage.TaskManager.Task::(_decref) Task=`7d410407-989f-44d8-928e-50746877f595`::ref 1 aborting False >Thread-4242::INFO::2014-09-09 11:54:18,258::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4242::DEBUG::2014-09-09 11:54:18,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d410407-989f-44d8-928e-50746877f595`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4242::DEBUG::2014-09-09 11:54:18,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d410407-989f-44d8-928e-50746877f595`::moving from state preparing -> state finished >Thread-4242::DEBUG::2014-09-09 11:54:18,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4242::DEBUG::2014-09-09 11:54:18,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4242::DEBUG::2014-09-09 11:54:18,259::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4242::DEBUG::2014-09-09 11:54:18,259::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4242::DEBUG::2014-09-09 11:54:18,259::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4242::DEBUG::2014-09-09 11:54:18,259::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4242::DEBUG::2014-09-09 11:54:18,259::task::993::Storage.TaskManager.Task::(_decref) Task=`7d410407-989f-44d8-928e-50746877f595`::ref 0 aborting False >Thread-4242::DEBUG::2014-09-09 11:54:18,260::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4242::DEBUG::2014-09-09 11:54:18,260::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:18,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:18,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897266 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:19,055::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:19,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4243::DEBUG::2014-09-09 11:54:19,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:54:20,142::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:20,143::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:20,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:20,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:20,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:20,145::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:54:20,146::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:20,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:20,151::__init__::225::IOProcess::(_processLogs) (9317) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:20,152::__init__::225::IOProcess::(_processLogs) (9317) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:20,153::__init__::225::IOProcess::(_processLogs) (9317) Building response >Thread-19::DEBUG::2014-09-09 11:54:20,153::__init__::225::IOProcess::(_processLogs) (9317) Queuing response >Thread-23::DEBUG::2014-09-09 11:54:20,154::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109521 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:20,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:20,155::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:20,156::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:20,157::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:20,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:20,158::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:20,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:20,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:20,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:20,160::__init__::225::IOProcess::(_processLogs) DEBUG|(9318) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:20,161::__init__::225::IOProcess::(_processLogs) (9318) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:20,162::__init__::225::IOProcess::(_processLogs) (9318) Building response >Thread-19::DEBUG::2014-09-09 11:54:20,162::__init__::225::IOProcess::(_processLogs) (9318) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:20,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:20,163::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:20,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:20,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896468 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:22,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:22,066::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4244::DEBUG::2014-09-09 11:54:22,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf757d85-9e06-4492-be5e-f2e82f247979`::moving from state init -> state preparing >Thread-4244::INFO::2014-09-09 11:54:22,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4244::INFO::2014-09-09 11:54:22,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109521', 'lastCheck': '1.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987451', 'lastCheck': '5.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103781', 'lastCheck': '7.3', 'valid': True}} >Thread-4244::DEBUG::2014-09-09 11:54:22,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf757d85-9e06-4492-be5e-f2e82f247979`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109521', 'lastCheck': '1.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987451', 'lastCheck': '5.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103781', 'lastCheck': '7.3', 'valid': True}} >Thread-4244::DEBUG::2014-09-09 11:54:22,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf757d85-9e06-4492-be5e-f2e82f247979`::moving from state preparing -> state finished >Thread-4244::DEBUG::2014-09-09 11:54:22,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4244::DEBUG::2014-09-09 11:54:22,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4244::DEBUG::2014-09-09 11:54:22,068::task::993::Storage.TaskManager.Task::(_decref) Task=`cf757d85-9e06-4492-be5e-f2e82f247979`::ref 0 aborting False >Thread-4244::DEBUG::2014-09-09 11:54:22,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:22,076::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:22,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4245::DEBUG::2014-09-09 11:54:22,078::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:22,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:23,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897629 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:24,800::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) (9319) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:24,801::__init__::225::IOProcess::(_processLogs) (9319) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:24,802::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9319) Building response >Thread-19::DEBUG::2014-09-09 11:54:24,802::__init__::225::IOProcess::(_processLogs) (9319) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:24,802::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:24,803::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:54:24,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:54:24,810::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00111923 s, 317 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:24,810::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) (9320) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) (9320) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:24,811::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9320) Building response >Thread-19::DEBUG::2014-09-09 11:54:24,812::__init__::225::IOProcess::(_processLogs) (9320) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:24,812::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:24,812::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:25,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:25,170::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:25,171::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4246::DEBUG::2014-09-09 11:54:25,172::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:25,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896629 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:26,667::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:26,667::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) (9321) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) (9321) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9321) Building response >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) (9321) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:26,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:26,669::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:54:26,669::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:54:26,676::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000979058 s, 560 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:26,677::__init__::225::IOProcess::(_processLogs) (9322) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:26,678::__init__::225::IOProcess::(_processLogs) (9322) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:26,678::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9322) Building response >Thread-19::DEBUG::2014-09-09 11:54:26,678::__init__::225::IOProcess::(_processLogs) (9322) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:26,678::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:26,679::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:26,679::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:26,679::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:54:26,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:26,679::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) (9323) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) (9323) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) (9323) Building response >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) (9323) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:26,680::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) (9324) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:26,681::__init__::225::IOProcess::(_processLogs) (9324) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) (9324) Building response >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) (9324) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:26,682::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) (9325) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) (9325) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) (9325) Building response >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) (9325) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:26,683::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:54:27,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:27,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900769 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:28,182::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:28,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4247::DEBUG::2014-09-09 11:54:28,184::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:28,299::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4248::DEBUG::2014-09-09 11:54:28,299::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:54:28,299::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4248::DEBUG::2014-09-09 11:54:28,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f13df6-788d-40b8-8cfa-c88d78b41cc4`::moving from state init -> state preparing >Thread-4248::INFO::2014-09-09 11:54:28,300::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4248::INFO::2014-09-09 11:54:28,300::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4248::DEBUG::2014-09-09 11:54:28,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0f13df6-788d-40b8-8cfa-c88d78b41cc4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4248::DEBUG::2014-09-09 11:54:28,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f13df6-788d-40b8-8cfa-c88d78b41cc4`::moving from state preparing -> state finished >Thread-4248::DEBUG::2014-09-09 11:54:28,301::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4248::DEBUG::2014-09-09 11:54:28,301::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4248::DEBUG::2014-09-09 11:54:28,301::task::993::Storage.TaskManager.Task::(_decref) Task=`c0f13df6-788d-40b8-8cfa-c88d78b41cc4`::ref 0 aborting False >Thread-4248::DEBUG::2014-09-09 11:54:28,301::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4248::DEBUG::2014-09-09 11:54:28,301::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:28,331::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:28,332::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4249::DEBUG::2014-09-09 11:54:28,332::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4249::DEBUG::2014-09-09 11:54:28,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`602a5ab3-f373-4dfe-9dd8-8d6ee60ddd42`::moving from state init -> state preparing >Thread-4249::INFO::2014-09-09 11:54:28,333::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4249::DEBUG::2014-09-09 11:54:28,333::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`41404a71-c8e2-47e6-b75c-6d9788f4eef7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4249::DEBUG::2014-09-09 11:54:28,333::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4249::DEBUG::2014-09-09 11:54:28,333::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4249::DEBUG::2014-09-09 11:54:28,333::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`41404a71-c8e2-47e6-b75c-6d9788f4eef7`::Granted request >Thread-4249::DEBUG::2014-09-09 11:54:28,334::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`602a5ab3-f373-4dfe-9dd8-8d6ee60ddd42`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4249::DEBUG::2014-09-09 11:54:28,334::task::993::Storage.TaskManager.Task::(_decref) Task=`602a5ab3-f373-4dfe-9dd8-8d6ee60ddd42`::ref 1 aborting False >Thread-4249::INFO::2014-09-09 11:54:28,335::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4249::DEBUG::2014-09-09 11:54:28,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`602a5ab3-f373-4dfe-9dd8-8d6ee60ddd42`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4249::DEBUG::2014-09-09 11:54:28,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`602a5ab3-f373-4dfe-9dd8-8d6ee60ddd42`::moving from state preparing -> state finished >Thread-4249::DEBUG::2014-09-09 11:54:28,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4249::DEBUG::2014-09-09 11:54:28,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4249::DEBUG::2014-09-09 11:54:28,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4249::DEBUG::2014-09-09 11:54:28,336::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4249::DEBUG::2014-09-09 11:54:28,336::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4249::DEBUG::2014-09-09 11:54:28,336::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4249::DEBUG::2014-09-09 11:54:28,336::task::993::Storage.TaskManager.Task::(_decref) Task=`602a5ab3-f373-4dfe-9dd8-8d6ee60ddd42`::ref 0 aborting False >Thread-4249::DEBUG::2014-09-09 11:54:28,336::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283247640576', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4249::DEBUG::2014-09-09 11:54:28,337::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:29,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:29,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897333 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) (9326) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:30,162::__init__::225::IOProcess::(_processLogs) (9326) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:30,163::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9326) Building response >Thread-23::DEBUG::2014-09-09 11:54:30,163::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:30,163::__init__::225::IOProcess::(_processLogs) (9326) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:30,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:30,168::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:54:30,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110511 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:30,171::__init__::225::IOProcess::(_processLogs) (9327) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:30,172::__init__::225::IOProcess::(_processLogs) (9327) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:30,172::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9327) Building response >Thread-19::DEBUG::2014-09-09 11:54:30,172::__init__::225::IOProcess::(_processLogs) (9327) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:30,172::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:30,173::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:31,199::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:31,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4250::DEBUG::2014-09-09 11:54:31,201::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:31,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:31,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901285 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:54:33,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:33,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902176 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:34,208::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:34,209::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4251::DEBUG::2014-09-09 11:54:34,210::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:34,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:34,814::__init__::225::IOProcess::(_processLogs) (9328) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:34,814::__init__::225::IOProcess::(_processLogs) (9328) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:34,816::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9328) Building response >Thread-19::DEBUG::2014-09-09 11:54:34,816::__init__::225::IOProcess::(_processLogs) (9328) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:34,816::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:34,817::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:54:34,817::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:54:34,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910832 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:34,825::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:34,825::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:34,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:34,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:34,825::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:34,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:34,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:34,826::__init__::225::IOProcess::(_processLogs) (9329) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:34,826::__init__::225::IOProcess::(_processLogs) (9329) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:34,826::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9329) Building response >Thread-19::DEBUG::2014-09-09 11:54:34,827::__init__::225::IOProcess::(_processLogs) (9329) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:34,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:34,827::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:35,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:35,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904161 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:36,683::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:36,683::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:36,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) (9330) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) (9330) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:36,684::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9330) Building response >Thread-19::DEBUG::2014-09-09 11:54:36,685::__init__::225::IOProcess::(_processLogs) (9330) Queuing response >Thread-24::DEBUG::2014-09-09 11:54:36,685::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:36,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:36,690::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:54:36,693::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00105392 s, 520 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:36,693::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:36,693::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:36,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:36,693::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) (9331) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) (9331) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9331) Building response >Thread-19::DEBUG::2014-09-09 11:54:36,694::__init__::225::IOProcess::(_processLogs) (9331) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:36,695::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:36,695::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:36,695::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:36,695::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:54:36,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) (9332) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) (9332) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) (9332) Building response >Thread-19::DEBUG::2014-09-09 11:54:36,696::__init__::225::IOProcess::(_processLogs) (9332) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:36,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) (9333) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) (9333) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) (9333) Building response >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) (9333) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:54:36,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) (9334) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) (9334) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:36,699::__init__::225::IOProcess::(_processLogs) (9334) Building response >Thread-19::DEBUG::2014-09-09 11:54:36,700::__init__::225::IOProcess::(_processLogs) (9334) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:36,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:36,700::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:37,221::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:37,221::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4252::DEBUG::2014-09-09 11:54:37,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`c278c1bb-a614-4ccf-af97-14510da31152`::moving from state init -> state preparing >Thread-4252::INFO::2014-09-09 11:54:37,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4252::INFO::2014-09-09 11:54:37,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110511', 'lastCheck': '7.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105392', 'lastCheck': '0.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910832', 'lastCheck': '2.4', 'valid': True}} >Thread-4252::DEBUG::2014-09-09 11:54:37,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`c278c1bb-a614-4ccf-af97-14510da31152`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110511', 'lastCheck': '7.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105392', 'lastCheck': '0.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910832', 'lastCheck': '2.4', 'valid': True}} >Thread-4252::DEBUG::2014-09-09 11:54:37,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`c278c1bb-a614-4ccf-af97-14510da31152`::moving from state preparing -> state finished >Thread-4252::DEBUG::2014-09-09 11:54:37,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4252::DEBUG::2014-09-09 11:54:37,223::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4252::DEBUG::2014-09-09 11:54:37,223::task::993::Storage.TaskManager.Task::(_decref) Task=`c278c1bb-a614-4ccf-af97-14510da31152`::ref 0 aborting False >Thread-4252::DEBUG::2014-09-09 11:54:37,224::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:37,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:37,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4253::DEBUG::2014-09-09 11:54:37,243::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:37,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:37,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895885 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:38,445::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:38,446::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4254::DEBUG::2014-09-09 11:54:38,446::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4254::DEBUG::2014-09-09 11:54:38,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`e199f84a-a062-4a39-aaef-c936f01a5307`::moving from state init -> state preparing >Thread-4254::INFO::2014-09-09 11:54:38,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4254::INFO::2014-09-09 11:54:38,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4254::DEBUG::2014-09-09 11:54:38,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`e199f84a-a062-4a39-aaef-c936f01a5307`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4254::DEBUG::2014-09-09 11:54:38,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`e199f84a-a062-4a39-aaef-c936f01a5307`::moving from state preparing -> state finished >Thread-4254::DEBUG::2014-09-09 11:54:38,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4254::DEBUG::2014-09-09 11:54:38,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4254::DEBUG::2014-09-09 11:54:38,448::task::993::Storage.TaskManager.Task::(_decref) Task=`e199f84a-a062-4a39-aaef-c936f01a5307`::ref 0 aborting False >Thread-4254::DEBUG::2014-09-09 11:54:38,448::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4254::DEBUG::2014-09-09 11:54:38,448::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:38,474::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:38,474::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4255::DEBUG::2014-09-09 11:54:38,474::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4255::DEBUG::2014-09-09 11:54:38,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`29f3fc85-44f4-41ce-b98f-79e8423a3944`::moving from state init -> state preparing >Thread-4255::INFO::2014-09-09 11:54:38,475::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4255::DEBUG::2014-09-09 11:54:38,475::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`73f301a5-4573-45ef-a173-46b5de6a1dc5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4255::DEBUG::2014-09-09 11:54:38,475::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4255::DEBUG::2014-09-09 11:54:38,476::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4255::DEBUG::2014-09-09 11:54:38,476::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`73f301a5-4573-45ef-a173-46b5de6a1dc5`::Granted request >Thread-4255::DEBUG::2014-09-09 11:54:38,476::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`29f3fc85-44f4-41ce-b98f-79e8423a3944`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4255::DEBUG::2014-09-09 11:54:38,476::task::993::Storage.TaskManager.Task::(_decref) Task=`29f3fc85-44f4-41ce-b98f-79e8423a3944`::ref 1 aborting False >Thread-4255::INFO::2014-09-09 11:54:38,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4255::DEBUG::2014-09-09 11:54:38,478::task::1191::Storage.TaskManager.Task::(prepare) Task=`29f3fc85-44f4-41ce-b98f-79e8423a3944`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4255::DEBUG::2014-09-09 11:54:38,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`29f3fc85-44f4-41ce-b98f-79e8423a3944`::moving from state preparing -> state finished >Thread-4255::DEBUG::2014-09-09 11:54:38,478::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4255::DEBUG::2014-09-09 11:54:38,478::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4255::DEBUG::2014-09-09 11:54:38,478::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4255::DEBUG::2014-09-09 11:54:38,478::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4255::DEBUG::2014-09-09 11:54:38,478::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4255::DEBUG::2014-09-09 11:54:38,478::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4255::DEBUG::2014-09-09 11:54:38,478::task::993::Storage.TaskManager.Task::(_decref) Task=`29f3fc85-44f4-41ce-b98f-79e8423a3944`::ref 0 aborting False >Thread-4255::DEBUG::2014-09-09 11:54:38,479::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4255::DEBUG::2014-09-09 11:54:38,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:39,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:39,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089743 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:40,173::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:40,173::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:40,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:40,174::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:40,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:40,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:40,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:40,174::__init__::225::IOProcess::(_processLogs) (9335) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:40,174::__init__::225::IOProcess::(_processLogs) (9335) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:40,175::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9335) Building response >Thread-19::DEBUG::2014-09-09 11:54:40,175::__init__::225::IOProcess::(_processLogs) (9335) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:40,175::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:40,175::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:54:40,176::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:54:40,184::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00121439 s, 925 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:40,184::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:40,184::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:40,184::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) (9336) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) (9336) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9336) Building response >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) (9336) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:40,185::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:40,186::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:40,341::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:40,342::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4256::DEBUG::2014-09-09 11:54:40,343::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:41,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:42,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896328 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:43,423::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:43,424::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4257::DEBUG::2014-09-09 11:54:43,425::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:44,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:44,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904424 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:44,827::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:44,827::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:44,827::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:44,828::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:44,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:44,828::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:44,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:44,828::__init__::225::IOProcess::(_processLogs) (9337) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:44,828::__init__::225::IOProcess::(_processLogs) (9337) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:44,829::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9337) Building response >Thread-19::DEBUG::2014-09-09 11:54:44,829::__init__::225::IOProcess::(_processLogs) (9337) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:44,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:44,829::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:54:44,830::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:54:44,836::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000895598 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) (9338) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:44,837::__init__::225::IOProcess::(_processLogs) (9338) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:44,838::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9338) Building response >Thread-19::DEBUG::2014-09-09 11:54:44,838::__init__::225::IOProcess::(_processLogs) (9338) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:44,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:44,838::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:46,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:46,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090086 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:46,435::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:46,436::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4258::DEBUG::2014-09-09 11:54:46,437::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:54:46,700::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:46,700::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:46,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:46,700::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:46,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:46,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:46,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:46,701::__init__::225::IOProcess::(_processLogs) (9339) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:46,701::__init__::225::IOProcess::(_processLogs) (9339) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:46,701::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9339) Building response >Thread-24::DEBUG::2014-09-09 11:54:46,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:46,702::__init__::225::IOProcess::(_processLogs) (9339) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:46,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:46,707::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:54:46,710::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000933511 s, 587 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:46,710::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:46,710::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:46,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:46,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) (9340) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) (9340) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9340) Building response >Thread-19::DEBUG::2014-09-09 11:54:46,711::__init__::225::IOProcess::(_processLogs) (9340) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:46,712::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:46,712::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:46,712::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:46,712::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:54:46,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:46,712::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) (9341) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) (9341) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9341) Building response >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) (9341) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:46,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) (9342) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:46,714::__init__::225::IOProcess::(_processLogs) (9342) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9342) Building response >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) (9342) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:54:46,715::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) (9343) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) (9343) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:46,716::__init__::225::IOProcess::(_processLogs) (9343) Building response >Thread-19::DEBUG::2014-09-09 11:54:46,717::__init__::225::IOProcess::(_processLogs) (9343) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:46,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:46,717::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:54:48,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:48,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905126 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:48,521::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:48,521::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4259::DEBUG::2014-09-09 11:54:48,521::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4259::DEBUG::2014-09-09 11:54:48,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`14a26703-a187-4b4e-bccf-9592606e49f7`::moving from state init -> state preparing >Thread-4259::INFO::2014-09-09 11:54:48,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4259::INFO::2014-09-09 11:54:48,523::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4259::DEBUG::2014-09-09 11:54:48,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`14a26703-a187-4b4e-bccf-9592606e49f7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4259::DEBUG::2014-09-09 11:54:48,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`14a26703-a187-4b4e-bccf-9592606e49f7`::moving from state preparing -> state finished >Thread-4259::DEBUG::2014-09-09 11:54:48,523::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4259::DEBUG::2014-09-09 11:54:48,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4259::DEBUG::2014-09-09 11:54:48,523::task::993::Storage.TaskManager.Task::(_decref) Task=`14a26703-a187-4b4e-bccf-9592606e49f7`::ref 0 aborting False >Thread-4259::DEBUG::2014-09-09 11:54:48,523::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4259::DEBUG::2014-09-09 11:54:48,523::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:48,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:48,575::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4260::DEBUG::2014-09-09 11:54:48,575::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4260::DEBUG::2014-09-09 11:54:48,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ccb1c5f-f719-4d3a-b47b-4e8614c494e1`::moving from state init -> state preparing >Thread-4260::INFO::2014-09-09 11:54:48,576::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4260::DEBUG::2014-09-09 11:54:48,576::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eca58ba2-6188-4335-90c8-fc6be0844399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4260::DEBUG::2014-09-09 11:54:48,576::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4260::DEBUG::2014-09-09 11:54:48,576::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4260::DEBUG::2014-09-09 11:54:48,576::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eca58ba2-6188-4335-90c8-fc6be0844399`::Granted request >Thread-4260::DEBUG::2014-09-09 11:54:48,576::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8ccb1c5f-f719-4d3a-b47b-4e8614c494e1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4260::DEBUG::2014-09-09 11:54:48,577::task::993::Storage.TaskManager.Task::(_decref) Task=`8ccb1c5f-f719-4d3a-b47b-4e8614c494e1`::ref 1 aborting False >Thread-4260::INFO::2014-09-09 11:54:48,578::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4260::DEBUG::2014-09-09 11:54:48,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ccb1c5f-f719-4d3a-b47b-4e8614c494e1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4260::DEBUG::2014-09-09 11:54:48,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ccb1c5f-f719-4d3a-b47b-4e8614c494e1`::moving from state preparing -> state finished >Thread-4260::DEBUG::2014-09-09 11:54:48,578::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4260::DEBUG::2014-09-09 11:54:48,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4260::DEBUG::2014-09-09 11:54:48,579::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4260::DEBUG::2014-09-09 11:54:48,579::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4260::DEBUG::2014-09-09 11:54:48,579::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4260::DEBUG::2014-09-09 11:54:48,579::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4260::DEBUG::2014-09-09 11:54:48,579::task::993::Storage.TaskManager.Task::(_decref) Task=`8ccb1c5f-f719-4d3a-b47b-4e8614c494e1`::ref 0 aborting False >Thread-4260::DEBUG::2014-09-09 11:54:48,579::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4260::DEBUG::2014-09-09 11:54:48,579::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:49,447::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:49,449::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4261::DEBUG::2014-09-09 11:54:49,453::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:54:50,187::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:50,188::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:50,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:50,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:50,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:50,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:50,190::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-23::DEBUG::2014-09-09 11:54:50,191::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:50,192::__init__::225::IOProcess::(_processLogs) (9344) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:50,197::__init__::225::IOProcess::(_processLogs) (9344) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:50,197::__init__::225::IOProcess::(_processLogs) (9344) Building response >Thread-19::DEBUG::2014-09-09 11:54:50,198::__init__::225::IOProcess::(_processLogs) (9344) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:50,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:50,199::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:54:50,200::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00128923 s, 871 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:50,201::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:50,202::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:54:50,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:50,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:50,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:50,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:50,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:50,204::__init__::225::IOProcess::(_processLogs) (9345) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:50,205::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9345) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:50,206::__init__::225::IOProcess::(_processLogs) (9345) Building response >Thread-19::DEBUG::2014-09-09 11:54:50,207::__init__::225::IOProcess::(_processLogs) (9345) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:50,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:50,208::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:54:50,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:50,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895694 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:54:52,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:52,475::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:52,476::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4262::DEBUG::2014-09-09 11:54:52,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`d689e4e8-7d89-467c-b3be-22d2849dce8a`::moving from state init -> state preparing >Thread-4262::INFO::2014-09-09 11:54:52,477::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4262::INFO::2014-09-09 11:54:52,477::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00128923', 'lastCheck': '2.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933511', 'lastCheck': '5.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895598', 'lastCheck': '7.6', 'valid': True}} >Thread-4262::DEBUG::2014-09-09 11:54:52,478::task::1191::Storage.TaskManager.Task::(prepare) Task=`d689e4e8-7d89-467c-b3be-22d2849dce8a`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00128923', 'lastCheck': '2.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933511', 'lastCheck': '5.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895598', 'lastCheck': '7.6', 'valid': True}} >Thread-4262::DEBUG::2014-09-09 11:54:52,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`d689e4e8-7d89-467c-b3be-22d2849dce8a`::moving from state preparing -> state finished >Thread-4262::DEBUG::2014-09-09 11:54:52,478::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4262::DEBUG::2014-09-09 11:54:52,478::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4262::DEBUG::2014-09-09 11:54:52,478::task::993::Storage.TaskManager.Task::(_decref) Task=`d689e4e8-7d89-467c-b3be-22d2849dce8a`::ref 0 aborting False >Thread-4262::DEBUG::2014-09-09 11:54:52,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:52,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:52,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4263::DEBUG::2014-09-09 11:54:52,502::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:52,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897159 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:54:54,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:54,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897909 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:54,839::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:54,839::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:54,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:54,840::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:54,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:54,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:54,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:54,840::__init__::225::IOProcess::(_processLogs) (9346) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:54,840::__init__::225::IOProcess::(_processLogs) (9346) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:54,841::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9346) Building response >Thread-19::DEBUG::2014-09-09 11:54:54,841::__init__::225::IOProcess::(_processLogs) (9346) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:54,841::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:54,841::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:54:54,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:54:54,848::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000915429 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) (9347) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:54,849::__init__::225::IOProcess::(_processLogs) (9347) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:54,850::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(9347) Building response >Thread-19::DEBUG::2014-09-09 11:54:54,850::__init__::225::IOProcess::(_processLogs) (9347) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:54,850::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:54,851::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:55,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:55,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4264::DEBUG::2014-09-09 11:54:55,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:56,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) (9348) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:56,717::__init__::225::IOProcess::(_processLogs) (9348) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:56,754::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9348) Building response >Thread-19::DEBUG::2014-09-09 11:54:56,755::__init__::225::IOProcess::(_processLogs) (9348) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:56,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:56,756::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:54:56,757::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:56,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970492 s, 10.6 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:54:56,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00102615 s, 534 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:54:56,766::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:56,767::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:54:56,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:56,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:56,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:56,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:56,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:56,770::__init__::225::IOProcess::(_processLogs) (9349) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:54:56,771::__init__::225::IOProcess::(_processLogs) (9349) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:54:56,771::__init__::225::IOProcess::(_processLogs) (9349) Building response >Thread-19::DEBUG::2014-09-09 11:54:56,771::__init__::225::IOProcess::(_processLogs) (9349) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:56,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:56,772::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:54:56,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:56,773::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:54:56,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:56,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:56,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:56,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:56,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:56,776::__init__::225::IOProcess::(_processLogs) (9350) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:56,776::__init__::225::IOProcess::(_processLogs) (9350) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:56,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9350) Building response >Thread-19::DEBUG::2014-09-09 11:54:56,778::__init__::225::IOProcess::(_processLogs) (9350) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:56,778::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:56,778::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:56,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:56,780::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:54:56,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:56,780::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:56,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:56,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:56,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:56,782::__init__::225::IOProcess::(_processLogs) (9351) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:56,782::__init__::225::IOProcess::(_processLogs) (9351) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:56,783::__init__::225::IOProcess::(_processLogs) (9351) Building response >Thread-19::DEBUG::2014-09-09 11:54:56,783::__init__::225::IOProcess::(_processLogs) (9351) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:56,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:54:56,784::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:54:56,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:54:56,785::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:54:56,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:54:56,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:54:56,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:54:56,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:54:56,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:54:56,789::__init__::225::IOProcess::(_processLogs) (9352) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:54:56,789::__init__::225::IOProcess::(_processLogs) (9352) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:54:56,790::__init__::225::IOProcess::(_processLogs) (9352) Building response >Thread-19::DEBUG::2014-09-09 11:54:56,790::__init__::225::IOProcess::(_processLogs) (9352) Queuing response >Thread-19::DEBUG::2014-09-09 11:54:56,790::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:54:56,791::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:58,585::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:58,586::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4265::DEBUG::2014-09-09 11:54:58,587::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:58,622::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:58,623::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4266::DEBUG::2014-09-09 11:54:58,623::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4266::DEBUG::2014-09-09 11:54:58,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8715e8e-ddac-4f29-81df-1e10ae6691e0`::moving from state init -> state preparing >Thread-4266::INFO::2014-09-09 11:54:58,624::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4266::INFO::2014-09-09 11:54:58,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4266::DEBUG::2014-09-09 11:54:58,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8715e8e-ddac-4f29-81df-1e10ae6691e0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4266::DEBUG::2014-09-09 11:54:58,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8715e8e-ddac-4f29-81df-1e10ae6691e0`::moving from state preparing -> state finished >Thread-4266::DEBUG::2014-09-09 11:54:58,624::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4266::DEBUG::2014-09-09 11:54:58,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4266::DEBUG::2014-09-09 11:54:58,624::task::993::Storage.TaskManager.Task::(_decref) Task=`e8715e8e-ddac-4f29-81df-1e10ae6691e0`::ref 0 aborting False >Thread-4266::DEBUG::2014-09-09 11:54:58,624::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4266::DEBUG::2014-09-09 11:54:58,625::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:54:58,650::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:54:58,651::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4267::DEBUG::2014-09-09 11:54:58,651::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4267::DEBUG::2014-09-09 11:54:58,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d7f2376-2dbf-4085-a93c-99884d7eac9d`::moving from state init -> state preparing >Thread-4267::INFO::2014-09-09 11:54:58,651::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4267::DEBUG::2014-09-09 11:54:58,652::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`414f217a-8860-47a8-a9db-337a4e82dff5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4267::DEBUG::2014-09-09 11:54:58,652::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4267::DEBUG::2014-09-09 11:54:58,652::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4267::DEBUG::2014-09-09 11:54:58,652::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`414f217a-8860-47a8-a9db-337a4e82dff5`::Granted request >Thread-4267::DEBUG::2014-09-09 11:54:58,652::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9d7f2376-2dbf-4085-a93c-99884d7eac9d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4267::DEBUG::2014-09-09 11:54:58,652::task::993::Storage.TaskManager.Task::(_decref) Task=`9d7f2376-2dbf-4085-a93c-99884d7eac9d`::ref 1 aborting False >Thread-4267::INFO::2014-09-09 11:54:58,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4267::DEBUG::2014-09-09 11:54:58,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d7f2376-2dbf-4085-a93c-99884d7eac9d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4267::DEBUG::2014-09-09 11:54:58,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d7f2376-2dbf-4085-a93c-99884d7eac9d`::moving from state preparing -> state finished >Thread-4267::DEBUG::2014-09-09 11:54:58,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4267::DEBUG::2014-09-09 11:54:58,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4267::DEBUG::2014-09-09 11:54:58,654::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4267::DEBUG::2014-09-09 11:54:58,654::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4267::DEBUG::2014-09-09 11:54:58,655::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4267::DEBUG::2014-09-09 11:54:58,655::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4267::DEBUG::2014-09-09 11:54:58,655::task::993::Storage.TaskManager.Task::(_decref) Task=`9d7f2376-2dbf-4085-a93c-99884d7eac9d`::ref 0 aborting False >Thread-4267::DEBUG::2014-09-09 11:54:58,655::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4267::DEBUG::2014-09-09 11:54:58,655::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:54:58,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:54:58,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897649 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) (9353) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:00,207::__init__::225::IOProcess::(_processLogs) (9353) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:00,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9353) Building response >Thread-19::DEBUG::2014-09-09 11:55:00,208::__init__::225::IOProcess::(_processLogs) (9353) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:00,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:00,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:55:00,209::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:55:00,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111596 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) (9354) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:00,217::__init__::225::IOProcess::(_processLogs) (9354) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:00,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9354) Building response >Thread-19::DEBUG::2014-09-09 11:55:00,218::__init__::225::IOProcess::(_processLogs) (9354) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:00,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:00,219::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:00,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:00,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090188 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:01,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:01,603::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4268::DEBUG::2014-09-09 11:55:01,604::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:03,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:03,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897096 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:04,620::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:04,621::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4269::DEBUG::2014-09-09 11:55:04,622::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:04,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:04,852::__init__::225::IOProcess::(_processLogs) (9355) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:04,852::__init__::225::IOProcess::(_processLogs) (9355) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:04,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9355) Building response >Thread-3443::DEBUG::2014-09-09 11:55:04,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:04,853::__init__::225::IOProcess::(_processLogs) (9355) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:04,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:04,858::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:55:04,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00095346 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) (9356) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) (9356) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9356) Building response >Thread-19::DEBUG::2014-09-09 11:55:04,861::__init__::225::IOProcess::(_processLogs) (9356) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:04,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:04,863::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:05,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:05,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901171 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:06,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:06,788::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:06,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:06,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:06,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:06,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) (9357) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) (9357) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9357) Building response >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) (9357) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:06,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:55:06,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:55:06,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00092773 s, 591 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:06,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:06,798::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:06,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:06,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:06,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:06,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:06,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:06,799::__init__::225::IOProcess::(_processLogs) (9358) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:06,799::__init__::225::IOProcess::(_processLogs) (9358) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:06,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9358) Building response >Thread-19::DEBUG::2014-09-09 11:55:06,799::__init__::225::IOProcess::(_processLogs) (9358) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:06,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:06,800::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:06,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:06,800::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:55:06,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:06,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) (9359) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) (9359) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) (9359) Building response >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) (9359) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:06,801::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:55:06,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:06,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) (9360) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) (9360) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) (9360) Building response >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) (9360) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:06,803::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) (9361) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) (9361) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:06,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9361) Building response >Thread-19::DEBUG::2014-09-09 11:55:06,805::__init__::225::IOProcess::(_processLogs) (9361) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:06,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:06,805::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:55:07,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:07,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896974 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:07,634::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:07,635::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4270::DEBUG::2014-09-09 11:55:07,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e4cd91d-7bec-49ec-aea5-eac0d5e82af7`::moving from state init -> state preparing >Thread-4270::INFO::2014-09-09 11:55:07,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4270::INFO::2014-09-09 11:55:07,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111596', 'lastCheck': '7.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00092773', 'lastCheck': '0.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00095346', 'lastCheck': '2.8', 'valid': True}} >Thread-4270::DEBUG::2014-09-09 11:55:07,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e4cd91d-7bec-49ec-aea5-eac0d5e82af7`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111596', 'lastCheck': '7.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00092773', 'lastCheck': '0.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00095346', 'lastCheck': '2.8', 'valid': True}} >Thread-4270::DEBUG::2014-09-09 11:55:07,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e4cd91d-7bec-49ec-aea5-eac0d5e82af7`::moving from state preparing -> state finished >Thread-4270::DEBUG::2014-09-09 11:55:07,637::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4270::DEBUG::2014-09-09 11:55:07,637::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4270::DEBUG::2014-09-09 11:55:07,637::task::993::Storage.TaskManager.Task::(_decref) Task=`5e4cd91d-7bec-49ec-aea5-eac0d5e82af7`::ref 0 aborting False >Thread-4270::DEBUG::2014-09-09 11:55:07,638::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:07,649::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:07,649::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4271::DEBUG::2014-09-09 11:55:07,650::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:08,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4272::DEBUG::2014-09-09 11:55:08,697::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:55:08,697::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4272::DEBUG::2014-09-09 11:55:08,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`40b804d6-832b-450e-abfc-9127ef49a062`::moving from state init -> state preparing >Thread-4272::INFO::2014-09-09 11:55:08,698::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4272::INFO::2014-09-09 11:55:08,698::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4272::DEBUG::2014-09-09 11:55:08,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`40b804d6-832b-450e-abfc-9127ef49a062`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4272::DEBUG::2014-09-09 11:55:08,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`40b804d6-832b-450e-abfc-9127ef49a062`::moving from state preparing -> state finished >Thread-4272::DEBUG::2014-09-09 11:55:08,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4272::DEBUG::2014-09-09 11:55:08,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4272::DEBUG::2014-09-09 11:55:08,699::task::993::Storage.TaskManager.Task::(_decref) Task=`40b804d6-832b-450e-abfc-9127ef49a062`::ref 0 aborting False >Thread-4272::DEBUG::2014-09-09 11:55:08,699::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4272::DEBUG::2014-09-09 11:55:08,699::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:08,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:08,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4273::DEBUG::2014-09-09 11:55:08,794::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4273::DEBUG::2014-09-09 11:55:08,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`96d51225-a3e3-4831-b527-e3e33c7065f0`::moving from state init -> state preparing >Thread-4273::INFO::2014-09-09 11:55:08,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4273::DEBUG::2014-09-09 11:55:08,795::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`46aa43cd-8573-478e-aecc-269a5974ce80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4273::DEBUG::2014-09-09 11:55:08,795::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4273::DEBUG::2014-09-09 11:55:08,795::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4273::DEBUG::2014-09-09 11:55:08,795::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`46aa43cd-8573-478e-aecc-269a5974ce80`::Granted request >Thread-4273::DEBUG::2014-09-09 11:55:08,796::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`96d51225-a3e3-4831-b527-e3e33c7065f0`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4273::DEBUG::2014-09-09 11:55:08,796::task::993::Storage.TaskManager.Task::(_decref) Task=`96d51225-a3e3-4831-b527-e3e33c7065f0`::ref 1 aborting False >Thread-4273::INFO::2014-09-09 11:55:08,797::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4273::DEBUG::2014-09-09 11:55:08,798::task::1191::Storage.TaskManager.Task::(prepare) Task=`96d51225-a3e3-4831-b527-e3e33c7065f0`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4273::DEBUG::2014-09-09 11:55:08,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`96d51225-a3e3-4831-b527-e3e33c7065f0`::moving from state preparing -> state finished >Thread-4273::DEBUG::2014-09-09 11:55:08,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4273::DEBUG::2014-09-09 11:55:08,798::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4273::DEBUG::2014-09-09 11:55:08,798::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4273::DEBUG::2014-09-09 11:55:08,798::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4273::DEBUG::2014-09-09 11:55:08,798::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4273::DEBUG::2014-09-09 11:55:08,798::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4273::DEBUG::2014-09-09 11:55:08,798::task::993::Storage.TaskManager.Task::(_decref) Task=`96d51225-a3e3-4831-b527-e3e33c7065f0`::ref 0 aborting False >Thread-4273::DEBUG::2014-09-09 11:55:08,799::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4273::DEBUG::2014-09-09 11:55:08,799::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:09,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:09,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903747 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:10,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) (9362) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:10,220::__init__::225::IOProcess::(_processLogs) (9362) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:10,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9362) Building response >Thread-19::DEBUG::2014-09-09 11:55:10,221::__init__::225::IOProcess::(_processLogs) (9362) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:10,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:10,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:55:10,222::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:55:10,230::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010929 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:10,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:10,230::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:10,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) (9363) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) (9363) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9363) Building response >Thread-19::DEBUG::2014-09-09 11:55:10,231::__init__::225::IOProcess::(_processLogs) (9363) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:10,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:10,232::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:10,780::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:10,781::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4274::DEBUG::2014-09-09 11:55:10,782::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:11,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:11,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896784 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:55:13,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:13,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090527 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:13,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:13,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4275::DEBUG::2014-09-09 11:55:13,794::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:14,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:14,863::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:14,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:14,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:14,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:14,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:14,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:14,864::__init__::225::IOProcess::(_processLogs) (9364) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:14,864::__init__::225::IOProcess::(_processLogs) (9364) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:14,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9364) Building response >Thread-19::DEBUG::2014-09-09 11:55:14,865::__init__::225::IOProcess::(_processLogs) (9364) Queuing response >Thread-3443::DEBUG::2014-09-09 11:55:14,865::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:14,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:14,870::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:55:14,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000874881 s, 406 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:14,873::__init__::225::IOProcess::(_processLogs) (9365) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:14,874::__init__::225::IOProcess::(_processLogs) (9365) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:14,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9365) Building response >Thread-19::DEBUG::2014-09-09 11:55:14,874::__init__::225::IOProcess::(_processLogs) (9365) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:14,874::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:14,875::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:15,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:15,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896535 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:16,801::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:16,802::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4276::DEBUG::2014-09-09 11:55:16,803::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:16,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) (9366) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:16,806::__init__::225::IOProcess::(_processLogs) (9366) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:16,807::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9366) Building response >Thread-19::DEBUG::2014-09-09 11:55:16,807::__init__::225::IOProcess::(_processLogs) (9366) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:16,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:16,808::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:55:16,808::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:55:16,817::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000970875 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) (9367) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:16,818::__init__::225::IOProcess::(_processLogs) (9367) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:16,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(9367) Building response >Thread-19::DEBUG::2014-09-09 11:55:16,819::__init__::225::IOProcess::(_processLogs) (9367) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:16,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:16,819::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:16,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:16,820::__init__::225::IOProcess::(_processLogs) (9368) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) (9368) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) (9368) Building response >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) (9368) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:55:16,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) (9369) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) (9369) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) (9369) Building response >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) (9369) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:16,822::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:16,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:16,823::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:55:16,823::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:16,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:16,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:16,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) (9370) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) (9370) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) (9370) Building response >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) (9370) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:16,824::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:55:17,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:17,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902757 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:18,841::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4277::DEBUG::2014-09-09 11:55:18,842::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:55:18,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4277::DEBUG::2014-09-09 11:55:18,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`5527a47e-7cf8-44fa-823f-850cdd856205`::moving from state init -> state preparing >Thread-4277::INFO::2014-09-09 11:55:18,843::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4277::INFO::2014-09-09 11:55:18,843::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4277::DEBUG::2014-09-09 11:55:18,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`5527a47e-7cf8-44fa-823f-850cdd856205`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4277::DEBUG::2014-09-09 11:55:18,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`5527a47e-7cf8-44fa-823f-850cdd856205`::moving from state preparing -> state finished >Thread-4277::DEBUG::2014-09-09 11:55:18,844::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4277::DEBUG::2014-09-09 11:55:18,844::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4277::DEBUG::2014-09-09 11:55:18,844::task::993::Storage.TaskManager.Task::(_decref) Task=`5527a47e-7cf8-44fa-823f-850cdd856205`::ref 0 aborting False >Thread-4277::DEBUG::2014-09-09 11:55:18,844::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4277::DEBUG::2014-09-09 11:55:18,844::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:18,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:18,921::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4278::DEBUG::2014-09-09 11:55:18,921::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4278::DEBUG::2014-09-09 11:55:18,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`f711a21f-b809-4bd8-a7aa-e83d50b0b04a`::moving from state init -> state preparing >Thread-4278::INFO::2014-09-09 11:55:18,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4278::DEBUG::2014-09-09 11:55:18,922::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2d144aab-30f1-46e1-ada7-b4c7addaa85b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4278::DEBUG::2014-09-09 11:55:18,922::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4278::DEBUG::2014-09-09 11:55:18,922::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4278::DEBUG::2014-09-09 11:55:18,922::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2d144aab-30f1-46e1-ada7-b4c7addaa85b`::Granted request >Thread-4278::DEBUG::2014-09-09 11:55:18,923::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f711a21f-b809-4bd8-a7aa-e83d50b0b04a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4278::DEBUG::2014-09-09 11:55:18,923::task::993::Storage.TaskManager.Task::(_decref) Task=`f711a21f-b809-4bd8-a7aa-e83d50b0b04a`::ref 1 aborting False >Thread-4278::INFO::2014-09-09 11:55:18,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4278::DEBUG::2014-09-09 11:55:18,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`f711a21f-b809-4bd8-a7aa-e83d50b0b04a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4278::DEBUG::2014-09-09 11:55:18,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`f711a21f-b809-4bd8-a7aa-e83d50b0b04a`::moving from state preparing -> state finished >Thread-4278::DEBUG::2014-09-09 11:55:18,925::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4278::DEBUG::2014-09-09 11:55:18,925::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4278::DEBUG::2014-09-09 11:55:18,926::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4278::DEBUG::2014-09-09 11:55:18,926::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4278::DEBUG::2014-09-09 11:55:18,926::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4278::DEBUG::2014-09-09 11:55:18,926::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4278::DEBUG::2014-09-09 11:55:18,926::task::993::Storage.TaskManager.Task::(_decref) Task=`f711a21f-b809-4bd8-a7aa-e83d50b0b04a`::ref 0 aborting False >Thread-4278::DEBUG::2014-09-09 11:55:18,926::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4278::DEBUG::2014-09-09 11:55:18,926::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:19,817::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:19,820::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4279::DEBUG::2014-09-09 11:55:19,824::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:19,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:19,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0949683 s, 10.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:20,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:20,234::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:20,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:20,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:20,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:20,236::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:55:20,237::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:20,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:20,242::__init__::225::IOProcess::(_processLogs) (9371) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:20,243::__init__::225::IOProcess::(_processLogs) (9371) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:20,243::__init__::225::IOProcess::(_processLogs) (9371) Building response >Thread-19::DEBUG::2014-09-09 11:55:20,244::__init__::225::IOProcess::(_processLogs) (9371) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:20,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:55:20,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110304 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:20,246::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:20,247::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:20,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:20,248::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:20,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:20,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:20,250::__init__::225::IOProcess::(_processLogs) (9372) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:20,251::__init__::225::IOProcess::(_processLogs) (9372) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:20,251::__init__::225::IOProcess::(_processLogs) (9372) Building response >Thread-19::DEBUG::2014-09-09 11:55:20,252::__init__::225::IOProcess::(_processLogs) (9372) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:20,252::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:20,252::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:22,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:22,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897165 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:22,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:22,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4280::DEBUG::2014-09-09 11:55:22,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`21995be6-ef12-409a-b51b-3daa5d8a8680`::moving from state init -> state preparing >Thread-4280::INFO::2014-09-09 11:55:22,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4280::INFO::2014-09-09 11:55:22,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110304', 'lastCheck': '2.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000970875', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000874881', 'lastCheck': '8.0', 'valid': True}} >Thread-4280::DEBUG::2014-09-09 11:55:22,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`21995be6-ef12-409a-b51b-3daa5d8a8680`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110304', 'lastCheck': '2.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000970875', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000874881', 'lastCheck': '8.0', 'valid': True}} >Thread-4280::DEBUG::2014-09-09 11:55:22,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`21995be6-ef12-409a-b51b-3daa5d8a8680`::moving from state preparing -> state finished >Thread-4280::DEBUG::2014-09-09 11:55:22,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4280::DEBUG::2014-09-09 11:55:22,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4280::DEBUG::2014-09-09 11:55:22,837::task::993::Storage.TaskManager.Task::(_decref) Task=`21995be6-ef12-409a-b51b-3daa5d8a8680`::ref 0 aborting False >Thread-4280::DEBUG::2014-09-09 11:55:22,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:22,859::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:22,860::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4281::DEBUG::2014-09-09 11:55:22,860::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:24,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:24,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903409 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:24,875::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:24,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:24,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:24,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:24,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:24,876::__init__::225::IOProcess::(_processLogs) (9373) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:24,876::__init__::225::IOProcess::(_processLogs) (9373) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:24,877::__init__::225::IOProcess::(_processLogs) (9373) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:24,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 11:55:24,877::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:55:24,883::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00100805 s, 352 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:24,884::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:24,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:24,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:24,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:24,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:24,884::__init__::225::IOProcess::(_processLogs) (9374) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:24,885::__init__::225::IOProcess::(_processLogs) (9374) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:24,885::__init__::225::IOProcess::(_processLogs) (9374) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:24,885::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:25,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:25,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4282::DEBUG::2014-09-09 11:55:25,934::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:26,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:26,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898319 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) (9375) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:26,824::__init__::225::IOProcess::(_processLogs) (9375) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:26,825::__init__::225::IOProcess::(_processLogs) (9375) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:26,825::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:55:26,825::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:55:26,833::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104945 s, 522 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) (9376) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:26,834::__init__::225::IOProcess::(_processLogs) (9376) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:26,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9376) Building response >Thread-19::DEBUG::2014-09-09 11:55:26,835::__init__::225::IOProcess::(_processLogs) (9376) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:26,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:26,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:26,836::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:26,836::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:55:26,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:26,836::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) (9377) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) (9377) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) (9377) Building response >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) (9377) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:26,837::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) (9378) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:26,838::__init__::225::IOProcess::(_processLogs) (9378) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) (9378) Building response >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) (9378) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:26,839::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) (9379) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) (9379) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) (9379) Building response >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) (9379) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:26,840::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:55:28,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:28,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905741 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:28,942::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:28,943::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4283::DEBUG::2014-09-09 11:55:28,944::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:28,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:28,966::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4284::DEBUG::2014-09-09 11:55:28,966::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4284::DEBUG::2014-09-09 11:55:28,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d34ca8b-7e71-4aa6-9284-b692932e66ab`::moving from state init -> state preparing >Thread-4284::INFO::2014-09-09 11:55:28,967::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4284::INFO::2014-09-09 11:55:28,967::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4284::DEBUG::2014-09-09 11:55:28,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d34ca8b-7e71-4aa6-9284-b692932e66ab`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4284::DEBUG::2014-09-09 11:55:28,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d34ca8b-7e71-4aa6-9284-b692932e66ab`::moving from state preparing -> state finished >Thread-4284::DEBUG::2014-09-09 11:55:28,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4284::DEBUG::2014-09-09 11:55:28,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4284::DEBUG::2014-09-09 11:55:28,967::task::993::Storage.TaskManager.Task::(_decref) Task=`9d34ca8b-7e71-4aa6-9284-b692932e66ab`::ref 0 aborting False >Thread-4284::DEBUG::2014-09-09 11:55:28,967::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4284::DEBUG::2014-09-09 11:55:28,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:29,003::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4285::DEBUG::2014-09-09 11:55:29,004::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:55:29,004::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4285::DEBUG::2014-09-09 11:55:29,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bf5a9fc-76c5-4744-bbea-09a658fbeddc`::moving from state init -> state preparing >Thread-4285::INFO::2014-09-09 11:55:29,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4285::DEBUG::2014-09-09 11:55:29,005::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f56c0f6e-6355-4f7d-8344-6c11f2c68e65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4285::DEBUG::2014-09-09 11:55:29,005::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4285::DEBUG::2014-09-09 11:55:29,005::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4285::DEBUG::2014-09-09 11:55:29,005::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f56c0f6e-6355-4f7d-8344-6c11f2c68e65`::Granted request >Thread-4285::DEBUG::2014-09-09 11:55:29,006::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4bf5a9fc-76c5-4744-bbea-09a658fbeddc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4285::DEBUG::2014-09-09 11:55:29,006::task::993::Storage.TaskManager.Task::(_decref) Task=`4bf5a9fc-76c5-4744-bbea-09a658fbeddc`::ref 1 aborting False >Thread-4285::INFO::2014-09-09 11:55:29,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4285::DEBUG::2014-09-09 11:55:29,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bf5a9fc-76c5-4744-bbea-09a658fbeddc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4285::DEBUG::2014-09-09 11:55:29,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bf5a9fc-76c5-4744-bbea-09a658fbeddc`::moving from state preparing -> state finished >Thread-4285::DEBUG::2014-09-09 11:55:29,007::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4285::DEBUG::2014-09-09 11:55:29,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4285::DEBUG::2014-09-09 11:55:29,008::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4285::DEBUG::2014-09-09 11:55:29,008::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4285::DEBUG::2014-09-09 11:55:29,008::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4285::DEBUG::2014-09-09 11:55:29,008::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4285::DEBUG::2014-09-09 11:55:29,008::task::993::Storage.TaskManager.Task::(_decref) Task=`4bf5a9fc-76c5-4744-bbea-09a658fbeddc`::ref 0 aborting False >Thread-4285::DEBUG::2014-09-09 11:55:29,008::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4285::DEBUG::2014-09-09 11:55:29,008::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:30,251::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:30,251::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:30,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:30,251::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:30,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:30,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:30,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:30,252::__init__::225::IOProcess::(_processLogs) (9380) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:30,252::__init__::225::IOProcess::(_processLogs) (9380) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:30,252::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9380) Building response >Thread-19::DEBUG::2014-09-09 11:55:30,252::__init__::225::IOProcess::(_processLogs) (9380) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:30,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:30,253::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:55:30,253::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:55:30,260::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011305 s, 993 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:30,260::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) (9381) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) (9381) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9381) Building response >Thread-19::DEBUG::2014-09-09 11:55:30,261::__init__::225::IOProcess::(_processLogs) (9381) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:30,262::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:30,262::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:30,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:30,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901613 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:31,958::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:31,959::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4286::DEBUG::2014-09-09 11:55:31,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:32,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:32,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900777 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:55:34,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:34,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899977 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:34,886::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:34,886::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:34,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:34,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:34,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:34,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:34,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:34,887::__init__::225::IOProcess::(_processLogs) (9382) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:34,887::__init__::225::IOProcess::(_processLogs) (9382) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:34,889::__init__::225::IOProcess::(_processLogs) DEBUG|(9382) Building response >Thread-19::DEBUG::2014-09-09 11:55:34,889::__init__::225::IOProcess::(_processLogs) (9382) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:34,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:34,890::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:55:34,890::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:55:34,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00104453 s, 340 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:34,898::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:34,898::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:34,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:34,898::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:34,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:34,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:34,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:34,899::__init__::225::IOProcess::(_processLogs) (9383) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:34,899::__init__::225::IOProcess::(_processLogs) (9383) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:34,899::__init__::225::IOProcess::(_processLogs) DEBUG|(9383) Building response >Thread-19::DEBUG::2014-09-09 11:55:34,899::__init__::225::IOProcess::(_processLogs) (9383) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:34,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:34,900::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:34,978::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:34,978::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4287::DEBUG::2014-09-09 11:55:34,979::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:36,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:36,840::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:36,840::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) (9384) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:36,841::__init__::225::IOProcess::(_processLogs) (9384) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:36,847::__init__::225::IOProcess::(_processLogs) DEBUG|(9384) Building response >Thread-19::DEBUG::2014-09-09 11:55:36,847::__init__::225::IOProcess::(_processLogs) (9384) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:36,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:36,849::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:55:36,850::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:36,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0976426 s, 10.5 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:55:36,857::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000970571 s, 565 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:36,859::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:36,859::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:36,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:36,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:36,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:36,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:36,862::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:36,863::__init__::225::IOProcess::(_processLogs) (9385) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:36,863::__init__::225::IOProcess::(_processLogs) (9385) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:36,863::__init__::225::IOProcess::(_processLogs) (9385) Building response >Thread-19::DEBUG::2014-09-09 11:55:36,864::__init__::225::IOProcess::(_processLogs) (9385) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:36,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:36,865::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:36,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:36,866::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:55:36,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:36,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:36,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:36,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:36,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:36,869::__init__::225::IOProcess::(_processLogs) (9386) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:36,869::__init__::225::IOProcess::(_processLogs) (9386) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:36,870::__init__::225::IOProcess::(_processLogs) (9386) Building response >Thread-19::DEBUG::2014-09-09 11:55:36,870::__init__::225::IOProcess::(_processLogs) (9386) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:36,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:36,871::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:36,871::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:36,872::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:55:36,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:36,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:36,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:36,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:36,874::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:36,874::__init__::225::IOProcess::(_processLogs) (9387) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:36,875::__init__::225::IOProcess::(_processLogs) (9387) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:36,875::__init__::225::IOProcess::(_processLogs) (9387) Building response >Thread-19::DEBUG::2014-09-09 11:55:36,875::__init__::225::IOProcess::(_processLogs) (9387) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:36,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:36,876::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:36,876::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:36,877::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:55:36,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:36,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:36,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:36,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:36,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:36,879::__init__::225::IOProcess::(_processLogs) DEBUG|(9388) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:36,880::__init__::225::IOProcess::(_processLogs) (9388) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:36,880::__init__::225::IOProcess::(_processLogs) (9388) Building response >Thread-19::DEBUG::2014-09-09 11:55:36,881::__init__::225::IOProcess::(_processLogs) (9388) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:36,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:36,881::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:37,994::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:37,995::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4288::DEBUG::2014-09-09 11:55:37,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`a38b9641-c24e-4bf7-9cb2-f6e55d6b79d2`::moving from state init -> state preparing >Thread-4288::INFO::2014-09-09 11:55:37,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4288::INFO::2014-09-09 11:55:37,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011305', 'lastCheck': '7.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000970571', 'lastCheck': '1.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104453', 'lastCheck': '3.1', 'valid': True}} >Thread-4288::DEBUG::2014-09-09 11:55:37,996::task::1191::Storage.TaskManager.Task::(prepare) Task=`a38b9641-c24e-4bf7-9cb2-f6e55d6b79d2`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011305', 'lastCheck': '7.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000970571', 'lastCheck': '1.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104453', 'lastCheck': '3.1', 'valid': True}} >Thread-4288::DEBUG::2014-09-09 11:55:37,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`a38b9641-c24e-4bf7-9cb2-f6e55d6b79d2`::moving from state preparing -> state finished >Thread-4288::DEBUG::2014-09-09 11:55:37,996::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4288::DEBUG::2014-09-09 11:55:37,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4288::DEBUG::2014-09-09 11:55:37,996::task::993::Storage.TaskManager.Task::(_decref) Task=`a38b9641-c24e-4bf7-9cb2-f6e55d6b79d2`::ref 0 aborting False >Thread-4288::DEBUG::2014-09-09 11:55:37,997::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:38,013::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:38,013::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4289::DEBUG::2014-09-09 11:55:38,014::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:38,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:38,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900263 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:39,284::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:39,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4290::DEBUG::2014-09-09 11:55:39,285::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4290::DEBUG::2014-09-09 11:55:39,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`0892b66e-d220-4145-a2b4-63ed39f0c9ed`::moving from state init -> state preparing >Thread-4290::INFO::2014-09-09 11:55:39,286::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4290::INFO::2014-09-09 11:55:39,286::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4290::DEBUG::2014-09-09 11:55:39,286::task::1191::Storage.TaskManager.Task::(prepare) Task=`0892b66e-d220-4145-a2b4-63ed39f0c9ed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4290::DEBUG::2014-09-09 11:55:39,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`0892b66e-d220-4145-a2b4-63ed39f0c9ed`::moving from state preparing -> state finished >Thread-4290::DEBUG::2014-09-09 11:55:39,287::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4290::DEBUG::2014-09-09 11:55:39,287::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4290::DEBUG::2014-09-09 11:55:39,287::task::993::Storage.TaskManager.Task::(_decref) Task=`0892b66e-d220-4145-a2b4-63ed39f0c9ed`::ref 0 aborting False >Thread-4290::DEBUG::2014-09-09 11:55:39,287::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4290::DEBUG::2014-09-09 11:55:39,287::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:39,320::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:39,320::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4291::DEBUG::2014-09-09 11:55:39,321::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4291::DEBUG::2014-09-09 11:55:39,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`659863fe-9b87-4811-9904-5b4ff4e4b700`::moving from state init -> state preparing >Thread-4291::INFO::2014-09-09 11:55:39,321::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4291::DEBUG::2014-09-09 11:55:39,322::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6fd78102-eaa2-4e16-80cb-3cfcecb361f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4291::DEBUG::2014-09-09 11:55:39,322::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4291::DEBUG::2014-09-09 11:55:39,322::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4291::DEBUG::2014-09-09 11:55:39,322::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6fd78102-eaa2-4e16-80cb-3cfcecb361f9`::Granted request >Thread-4291::DEBUG::2014-09-09 11:55:39,322::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`659863fe-9b87-4811-9904-5b4ff4e4b700`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4291::DEBUG::2014-09-09 11:55:39,322::task::993::Storage.TaskManager.Task::(_decref) Task=`659863fe-9b87-4811-9904-5b4ff4e4b700`::ref 1 aborting False >Thread-4291::INFO::2014-09-09 11:55:39,324::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4291::DEBUG::2014-09-09 11:55:39,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`659863fe-9b87-4811-9904-5b4ff4e4b700`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4291::DEBUG::2014-09-09 11:55:39,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`659863fe-9b87-4811-9904-5b4ff4e4b700`::moving from state preparing -> state finished >Thread-4291::DEBUG::2014-09-09 11:55:39,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4291::DEBUG::2014-09-09 11:55:39,324::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4291::DEBUG::2014-09-09 11:55:39,324::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4291::DEBUG::2014-09-09 11:55:39,325::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4291::DEBUG::2014-09-09 11:55:39,325::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4291::DEBUG::2014-09-09 11:55:39,325::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4291::DEBUG::2014-09-09 11:55:39,325::task::993::Storage.TaskManager.Task::(_decref) Task=`659863fe-9b87-4811-9904-5b4ff4e4b700`::ref 0 aborting False >Thread-4291::DEBUG::2014-09-09 11:55:39,325::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4291::DEBUG::2014-09-09 11:55:39,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:40,263::__init__::225::IOProcess::(_processLogs) (9389) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:40,264::__init__::225::IOProcess::(_processLogs) (9389) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:40,265::__init__::225::IOProcess::(_processLogs) DEBUG|(9389) Building response >Thread-19::DEBUG::2014-09-09 11:55:40,265::__init__::225::IOProcess::(_processLogs) (9389) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:40,265::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:55:40,266::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:40,266::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:55:40,273::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115576 s, 972 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:40,274::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:40,274::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:40,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:40,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:40,274::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:40,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) (9390) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) (9390) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9390) Building response >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) (9390) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:40,275::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:40,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:41,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897574 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:41,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:41,119::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4292::DEBUG::2014-09-09 11:55:41,120::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:43,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:43,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901832 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:44,160::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:44,160::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4293::DEBUG::2014-09-09 11:55:44,161::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) (9391) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) (9391) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:44,901::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9391) Building response >Thread-19::DEBUG::2014-09-09 11:55:44,902::__init__::225::IOProcess::(_processLogs) (9391) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:44,902::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:55:44,902::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:44,903::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:55:44,910::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00107106 s, 331 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:44,910::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:44,910::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) (9392) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) (9392) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9392) Building response >Thread-19::DEBUG::2014-09-09 11:55:44,911::__init__::225::IOProcess::(_processLogs) (9392) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:44,912::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:44,912::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:45,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:45,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899964 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:46,880::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:46,880::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) (9393) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:46,881::__init__::225::IOProcess::(_processLogs) (9393) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:46,882::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9393) Building response >Thread-19::DEBUG::2014-09-09 11:55:46,882::__init__::225::IOProcess::(_processLogs) (9393) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:46,882::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:55:46,883::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:46,883::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:55:46,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104341 s, 525 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:46,891::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:46,891::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:46,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:46,891::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:46,891::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) (9394) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) (9394) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9394) Building response >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) (9394) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:46,892::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:46,893::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:46,893::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:46,893::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:55:46,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:46,893::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) (9395) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) (9395) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9395) Building response >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) (9395) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:46,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) (9396) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:46,895::__init__::225::IOProcess::(_processLogs) (9396) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:46,896::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(9396) Building response >Thread-19::DEBUG::2014-09-09 11:55:46,896::__init__::225::IOProcess::(_processLogs) (9396) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:46,896::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:46,896::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:46,896::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:46,896::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:55:46,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:46,897::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:46,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:46,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:46,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:46,897::__init__::225::IOProcess::(_processLogs) (9397) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:46,898::__init__::225::IOProcess::(_processLogs) (9397) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:46,898::__init__::225::IOProcess::(_processLogs) (9397) Building response >Thread-19::DEBUG::2014-09-09 11:55:46,898::__init__::225::IOProcess::(_processLogs) (9397) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:46,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:46,898::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:47,168::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:47,169::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4294::DEBUG::2014-09-09 11:55:47,170::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:47,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:47,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090052 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:49,365::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:49,368::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4295::DEBUG::2014-09-09 11:55:49,368::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4295::DEBUG::2014-09-09 11:55:49,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`01482e78-a418-49b1-b8a8-b5e9305781ce`::moving from state init -> state preparing >Thread-4295::INFO::2014-09-09 11:55:49,371::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4295::INFO::2014-09-09 11:55:49,372::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4295::DEBUG::2014-09-09 11:55:49,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`01482e78-a418-49b1-b8a8-b5e9305781ce`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4295::DEBUG::2014-09-09 11:55:49,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`01482e78-a418-49b1-b8a8-b5e9305781ce`::moving from state preparing -> state finished >Thread-4295::DEBUG::2014-09-09 11:55:49,373::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4295::DEBUG::2014-09-09 11:55:49,373::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4295::DEBUG::2014-09-09 11:55:49,374::task::993::Storage.TaskManager.Task::(_decref) Task=`01482e78-a418-49b1-b8a8-b5e9305781ce`::ref 0 aborting False >Thread-4295::DEBUG::2014-09-09 11:55:49,374::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4295::DEBUG::2014-09-09 11:55:49,375::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:49,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:49,488::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:49,490::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4296::DEBUG::2014-09-09 11:55:49,490::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4296::DEBUG::2014-09-09 11:55:49,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c59222b-ff48-45ca-a19d-62ba4052f9a7`::moving from state init -> state preparing >Thread-4296::INFO::2014-09-09 11:55:49,493::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4296::DEBUG::2014-09-09 11:55:49,494::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7b1cc4cc-688d-446f-9377-3a401e174653`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4296::DEBUG::2014-09-09 11:55:49,495::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4296::DEBUG::2014-09-09 11:55:49,495::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4296::DEBUG::2014-09-09 11:55:49,496::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7b1cc4cc-688d-446f-9377-3a401e174653`::Granted request >Thread-4296::DEBUG::2014-09-09 11:55:49,497::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c59222b-ff48-45ca-a19d-62ba4052f9a7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4296::DEBUG::2014-09-09 11:55:49,497::task::993::Storage.TaskManager.Task::(_decref) Task=`6c59222b-ff48-45ca-a19d-62ba4052f9a7`::ref 1 aborting False >Thread-4296::INFO::2014-09-09 11:55:49,505::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4296::DEBUG::2014-09-09 11:55:49,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c59222b-ff48-45ca-a19d-62ba4052f9a7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4296::DEBUG::2014-09-09 11:55:49,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c59222b-ff48-45ca-a19d-62ba4052f9a7`::moving from state preparing -> state finished >Thread-4296::DEBUG::2014-09-09 11:55:49,507::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4296::DEBUG::2014-09-09 11:55:49,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4296::DEBUG::2014-09-09 11:55:49,509::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4296::DEBUG::2014-09-09 11:55:49,511::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4296::DEBUG::2014-09-09 11:55:49,511::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4296::DEBUG::2014-09-09 11:55:49,512::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4296::DEBUG::2014-09-09 11:55:49,513::task::993::Storage.TaskManager.Task::(_decref) Task=`6c59222b-ff48-45ca-a19d-62ba4052f9a7`::ref 0 aborting False >Thread-4296::DEBUG::2014-09-09 11:55:49,515::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4296::DEBUG::2014-09-09 11:55:49,516::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:49,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101161 s, 10.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:50,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:50,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4297::DEBUG::2014-09-09 11:55:50,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:50,276::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:50,277::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:50,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:50,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:50,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:50,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 11:55:50,280::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:50,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:50,285::__init__::225::IOProcess::(_processLogs) (9398) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:50,286::__init__::225::IOProcess::(_processLogs) (9398) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:50,286::__init__::225::IOProcess::(_processLogs) (9398) Building response >Thread-19::DEBUG::2014-09-09 11:55:50,287::__init__::225::IOProcess::(_processLogs) (9398) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:50,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:55:50,288::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105811 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:50,289::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:50,290::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:50,291::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:55:50,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:50,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:50,292::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:50,293::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:50,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:50,294::__init__::225::IOProcess::(_processLogs) (9399) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:50,295::__init__::225::IOProcess::(_processLogs) (9399) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:50,295::__init__::225::IOProcess::(_processLogs) (9399) Building response >Thread-19::DEBUG::2014-09-09 11:55:50,296::__init__::225::IOProcess::(_processLogs) (9399) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:50,296::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:50,296::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:51,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:51,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897628 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:53,203::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:53,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4298::DEBUG::2014-09-09 11:55:53,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`5256d163-025a-40d9-99f9-42641b02a581`::moving from state init -> state preparing >Thread-4298::INFO::2014-09-09 11:55:53,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4298::INFO::2014-09-09 11:55:53,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105811', 'lastCheck': '2.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104341', 'lastCheck': '6.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107106', 'lastCheck': '8.3', 'valid': True}} >Thread-4298::DEBUG::2014-09-09 11:55:53,205::task::1191::Storage.TaskManager.Task::(prepare) Task=`5256d163-025a-40d9-99f9-42641b02a581`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105811', 'lastCheck': '2.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104341', 'lastCheck': '6.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107106', 'lastCheck': '8.3', 'valid': True}} >Thread-4298::DEBUG::2014-09-09 11:55:53,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`5256d163-025a-40d9-99f9-42641b02a581`::moving from state preparing -> state finished >Thread-4298::DEBUG::2014-09-09 11:55:53,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4298::DEBUG::2014-09-09 11:55:53,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4298::DEBUG::2014-09-09 11:55:53,206::task::993::Storage.TaskManager.Task::(_decref) Task=`5256d163-025a-40d9-99f9-42641b02a581`::ref 0 aborting False >Thread-4298::DEBUG::2014-09-09 11:55:53,206::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:53,223::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:53,223::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4299::DEBUG::2014-09-09 11:55:53,224::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:55:53,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:53,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899527 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:54,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:54,914::__init__::225::IOProcess::(_processLogs) (9400) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:54,914::__init__::225::IOProcess::(_processLogs) (9400) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:54,914::__init__::225::IOProcess::(_processLogs) DEBUG|(9400) Building response >Thread-3443::DEBUG::2014-09-09 11:55:54,914::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:55:54,914::__init__::225::IOProcess::(_processLogs) (9400) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:54,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:54,920::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:55:54,922::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0010177 s, 349 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:54,922::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:54,922::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:55:54,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:54,922::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) (9401) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) (9401) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) DEBUG|(9401) Building response >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) (9401) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:54,923::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:55:54,924::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:55:55,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:55,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896848 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:56,307::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:56,308::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4300::DEBUG::2014-09-09 11:55:56,309::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) (9402) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:56,898::__init__::225::IOProcess::(_processLogs) (9402) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:56,899::__init__::225::IOProcess::(_processLogs) DEBUG|(9402) Building response >Thread-19::DEBUG::2014-09-09 11:55:56,899::__init__::225::IOProcess::(_processLogs) (9402) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:56,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:56,899::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:55:56,900::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:55:56,908::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00105174 s, 521 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:55:56,908::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:56,908::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:55:56,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:56,908::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:56,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) (9403) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) (9403) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) DEBUG|(9403) Building response >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) (9403) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:56,909::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:55:56,910::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:56,910::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:55:56,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:56,910::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) (9404) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) (9404) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) (9404) Building response >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) (9404) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:56,911::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) (9405) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:56,912::__init__::225::IOProcess::(_processLogs) (9405) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) (9405) Building response >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) (9405) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:55:56,913::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) (9406) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) (9406) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) (9406) Building response >Thread-19::DEBUG::2014-09-09 11:55:56,914::__init__::225::IOProcess::(_processLogs) (9406) Queuing response >Thread-19::DEBUG::2014-09-09 11:55:56,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:55:56,915::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:55:57,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:55:57,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904908 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:59,325::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:59,325::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4301::DEBUG::2014-09-09 11:55:59,326::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:59,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:59,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4302::DEBUG::2014-09-09 11:55:59,592::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4302::DEBUG::2014-09-09 11:55:59,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c461a9e-5eb9-4369-a62d-296014398624`::moving from state init -> state preparing >Thread-4302::INFO::2014-09-09 11:55:59,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4302::INFO::2014-09-09 11:55:59,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4302::DEBUG::2014-09-09 11:55:59,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c461a9e-5eb9-4369-a62d-296014398624`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4302::DEBUG::2014-09-09 11:55:59,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c461a9e-5eb9-4369-a62d-296014398624`::moving from state preparing -> state finished >Thread-4302::DEBUG::2014-09-09 11:55:59,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4302::DEBUG::2014-09-09 11:55:59,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4302::DEBUG::2014-09-09 11:55:59,594::task::993::Storage.TaskManager.Task::(_decref) Task=`5c461a9e-5eb9-4369-a62d-296014398624`::ref 0 aborting False >Thread-4302::DEBUG::2014-09-09 11:55:59,594::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4302::DEBUG::2014-09-09 11:55:59,594::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:55:59,631::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:55:59,632::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4303::DEBUG::2014-09-09 11:55:59,632::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4303::DEBUG::2014-09-09 11:55:59,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ab0fc11-4ba1-40db-9628-e7ea08a3b59a`::moving from state init -> state preparing >Thread-4303::INFO::2014-09-09 11:55:59,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4303::DEBUG::2014-09-09 11:55:59,633::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`07e3d115-1e0e-4432-bd97-546ba5e3a937`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4303::DEBUG::2014-09-09 11:55:59,633::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4303::DEBUG::2014-09-09 11:55:59,633::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4303::DEBUG::2014-09-09 11:55:59,633::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`07e3d115-1e0e-4432-bd97-546ba5e3a937`::Granted request >Thread-4303::DEBUG::2014-09-09 11:55:59,634::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1ab0fc11-4ba1-40db-9628-e7ea08a3b59a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4303::DEBUG::2014-09-09 11:55:59,634::task::993::Storage.TaskManager.Task::(_decref) Task=`1ab0fc11-4ba1-40db-9628-e7ea08a3b59a`::ref 1 aborting False >Thread-4303::INFO::2014-09-09 11:55:59,635::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4303::DEBUG::2014-09-09 11:55:59,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ab0fc11-4ba1-40db-9628-e7ea08a3b59a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4303::DEBUG::2014-09-09 11:55:59,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ab0fc11-4ba1-40db-9628-e7ea08a3b59a`::moving from state preparing -> state finished >Thread-4303::DEBUG::2014-09-09 11:55:59,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4303::DEBUG::2014-09-09 11:55:59,636::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4303::DEBUG::2014-09-09 11:55:59,636::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4303::DEBUG::2014-09-09 11:55:59,636::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4303::DEBUG::2014-09-09 11:55:59,636::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4303::DEBUG::2014-09-09 11:55:59,636::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4303::DEBUG::2014-09-09 11:55:59,636::task::993::Storage.TaskManager.Task::(_decref) Task=`1ab0fc11-4ba1-40db-9628-e7ea08a3b59a`::ref 0 aborting False >Thread-4303::DEBUG::2014-09-09 11:55:59,636::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4303::DEBUG::2014-09-09 11:55:59,637::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:00,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:00,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896938 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:00,294::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:00,294::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:00,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:00,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:00,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) (9407) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) (9407) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) DEBUG|(9407) Building response >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) (9407) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:00,295::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:56:00,296::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:56:00,303::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114656 s, 979 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:00,304::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:00,304::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:00,304::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:00,304::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:00,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:00,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:00,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:00,305::__init__::225::IOProcess::(_processLogs) (9408) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:00,305::__init__::225::IOProcess::(_processLogs) (9408) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:00,305::__init__::225::IOProcess::(_processLogs) DEBUG|(9408) Building response >Thread-19::DEBUG::2014-09-09 11:56:00,305::__init__::225::IOProcess::(_processLogs) (9408) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:00,305::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:00,306::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:02,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:02,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901732 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:02,343::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:02,344::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4304::DEBUG::2014-09-09 11:56:02,345::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:04,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:04,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904382 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) (9409) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:04,925::__init__::225::IOProcess::(_processLogs) (9409) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:04,926::__init__::225::IOProcess::(_processLogs) DEBUG|(9409) Building response >Thread-19::DEBUG::2014-09-09 11:56:04,926::__init__::225::IOProcess::(_processLogs) (9409) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:04,926::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:04,926::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:56:04,927::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:56:04,935::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000919294 s, 386 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:04,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:04,935::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:04,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:04,935::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) (9410) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) (9410) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) DEBUG|(9410) Building response >Thread-19::DEBUG::2014-09-09 11:56:04,936::__init__::225::IOProcess::(_processLogs) (9410) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:04,937::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:04,937::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:05,359::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:05,359::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4305::DEBUG::2014-09-09 11:56:05,360::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:06,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:06,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902345 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:06,914::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:06,914::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) (9411) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:06,915::__init__::225::IOProcess::(_processLogs) (9411) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:06,916::__init__::225::IOProcess::(_processLogs) DEBUG|(9411) Building response >Thread-19::DEBUG::2014-09-09 11:56:06,916::__init__::225::IOProcess::(_processLogs) (9411) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:06,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:06,916::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:56:06,917::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:56:06,924::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000916832 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:06,924::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) (9412) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:06,925::__init__::225::IOProcess::(_processLogs) (9412) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:06,926::__init__::225::IOProcess::(_processLogs) DEBUG|(9412) Building response >Thread-19::DEBUG::2014-09-09 11:56:06,926::__init__::225::IOProcess::(_processLogs) (9412) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:06,926::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:06,926::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:06,926::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:06,927::__init__::225::IOProcess::(_processLogs) (9413) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) (9413) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) (9413) Building response >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) (9413) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:06,928::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) (9414) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) (9414) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) (9414) Building response >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) (9414) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:06,929::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) (9415) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) (9415) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:06,930::__init__::225::IOProcess::(_processLogs) DEBUG|(9415) Building response >Thread-19::DEBUG::2014-09-09 11:56:06,931::__init__::225::IOProcess::(_processLogs) (9415) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:06,931::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:06,931::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:08,368::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:08,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4306::DEBUG::2014-09-09 11:56:08,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`49b1dbff-9dc9-47a4-9a9d-7dd3d9701cf6`::moving from state init -> state preparing >Thread-4306::INFO::2014-09-09 11:56:08,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4306::INFO::2014-09-09 11:56:08,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114656', 'lastCheck': '8.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916832', 'lastCheck': '1.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000919294', 'lastCheck': '3.4', 'valid': True}} >Thread-4306::DEBUG::2014-09-09 11:56:08,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`49b1dbff-9dc9-47a4-9a9d-7dd3d9701cf6`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114656', 'lastCheck': '8.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916832', 'lastCheck': '1.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000919294', 'lastCheck': '3.4', 'valid': True}} >Thread-4306::DEBUG::2014-09-09 11:56:08,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`49b1dbff-9dc9-47a4-9a9d-7dd3d9701cf6`::moving from state preparing -> state finished >Thread-4306::DEBUG::2014-09-09 11:56:08,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4306::DEBUG::2014-09-09 11:56:08,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4306::DEBUG::2014-09-09 11:56:08,371::task::993::Storage.TaskManager.Task::(_decref) Task=`49b1dbff-9dc9-47a4-9a9d-7dd3d9701cf6`::ref 0 aborting False >Thread-4306::DEBUG::2014-09-09 11:56:08,371::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:08,382::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:08,383::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4307::DEBUG::2014-09-09 11:56:08,384::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:08,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:08,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896945 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:09,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:09,677::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4308::DEBUG::2014-09-09 11:56:09,677::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4308::DEBUG::2014-09-09 11:56:09,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dd1b213-acfb-4b5d-90cc-72f5a5c35b36`::moving from state init -> state preparing >Thread-4308::INFO::2014-09-09 11:56:09,678::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4308::INFO::2014-09-09 11:56:09,678::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4308::DEBUG::2014-09-09 11:56:09,678::task::1191::Storage.TaskManager.Task::(prepare) Task=`3dd1b213-acfb-4b5d-90cc-72f5a5c35b36`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4308::DEBUG::2014-09-09 11:56:09,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`3dd1b213-acfb-4b5d-90cc-72f5a5c35b36`::moving from state preparing -> state finished >Thread-4308::DEBUG::2014-09-09 11:56:09,678::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4308::DEBUG::2014-09-09 11:56:09,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4308::DEBUG::2014-09-09 11:56:09,679::task::993::Storage.TaskManager.Task::(_decref) Task=`3dd1b213-acfb-4b5d-90cc-72f5a5c35b36`::ref 0 aborting False >Thread-4308::DEBUG::2014-09-09 11:56:09,679::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4308::DEBUG::2014-09-09 11:56:09,679::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:09,765::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:09,766::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4309::DEBUG::2014-09-09 11:56:09,766::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4309::DEBUG::2014-09-09 11:56:09,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d84be98-d6c5-4b38-9000-4e800a4a1c97`::moving from state init -> state preparing >Thread-4309::INFO::2014-09-09 11:56:09,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4309::DEBUG::2014-09-09 11:56:09,767::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1582eec8-8651-4ce3-a3fa-1ed93e3d580d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4309::DEBUG::2014-09-09 11:56:09,767::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4309::DEBUG::2014-09-09 11:56:09,767::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4309::DEBUG::2014-09-09 11:56:09,767::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1582eec8-8651-4ce3-a3fa-1ed93e3d580d`::Granted request >Thread-4309::DEBUG::2014-09-09 11:56:09,768::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4d84be98-d6c5-4b38-9000-4e800a4a1c97`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4309::DEBUG::2014-09-09 11:56:09,768::task::993::Storage.TaskManager.Task::(_decref) Task=`4d84be98-d6c5-4b38-9000-4e800a4a1c97`::ref 1 aborting False >Thread-4309::INFO::2014-09-09 11:56:09,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4309::DEBUG::2014-09-09 11:56:09,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d84be98-d6c5-4b38-9000-4e800a4a1c97`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4309::DEBUG::2014-09-09 11:56:09,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d84be98-d6c5-4b38-9000-4e800a4a1c97`::moving from state preparing -> state finished >Thread-4309::DEBUG::2014-09-09 11:56:09,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4309::DEBUG::2014-09-09 11:56:09,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4309::DEBUG::2014-09-09 11:56:09,770::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4309::DEBUG::2014-09-09 11:56:09,770::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4309::DEBUG::2014-09-09 11:56:09,770::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4309::DEBUG::2014-09-09 11:56:09,770::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4309::DEBUG::2014-09-09 11:56:09,770::task::993::Storage.TaskManager.Task::(_decref) Task=`4d84be98-d6c5-4b38-9000-4e800a4a1c97`::ref 0 aborting False >Thread-4309::DEBUG::2014-09-09 11:56:09,770::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283246592000', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4309::DEBUG::2014-09-09 11:56:09,771::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:56:10,306::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:10,306::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) (9416) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:10,307::__init__::225::IOProcess::(_processLogs) (9416) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:10,308::__init__::225::IOProcess::(_processLogs) DEBUG|(9416) Building response >Thread-19::DEBUG::2014-09-09 11:56:10,308::__init__::225::IOProcess::(_processLogs) (9416) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:10,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:10,308::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:56:10,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:56:10,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00127671 s, 880 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:10,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:10,317::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:10,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:10,317::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) (9417) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) (9417) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) DEBUG|(9417) Building response >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) (9417) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:10,318::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:10,319::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:10,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:10,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900437 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:11,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:11,498::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4310::DEBUG::2014-09-09 11:56:11,499::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:12,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:12,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898551 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:14,515::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:14,516::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4311::DEBUG::2014-09-09 11:56:14,517::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:14,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:14,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896458 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) (9418) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:14,938::__init__::225::IOProcess::(_processLogs) (9418) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:14,939::__init__::225::IOProcess::(_processLogs) DEBUG|(9418) Building response >Thread-19::DEBUG::2014-09-09 11:56:14,939::__init__::225::IOProcess::(_processLogs) (9418) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:14,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:14,939::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:56:14,940::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:56:14,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000991828 s, 358 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) (9419) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:14,948::__init__::225::IOProcess::(_processLogs) (9419) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:14,949::__init__::225::IOProcess::(_processLogs) DEBUG|(9419) Building response >Thread-19::DEBUG::2014-09-09 11:56:14,949::__init__::225::IOProcess::(_processLogs) (9419) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:14,949::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:14,950::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:16,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:16,933::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:16,933::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:16,934::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:16,934::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:16,935::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:16,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:16,936::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-24::DEBUG::2014-09-09 11:56:16,937::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:16,937::__init__::225::IOProcess::(_processLogs) (9420) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:16,942::__init__::225::IOProcess::(_processLogs) (9420) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:16,943::__init__::225::IOProcess::(_processLogs) (9420) Building response >Thread-19::DEBUG::2014-09-09 11:56:16,944::__init__::225::IOProcess::(_processLogs) (9420) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:16,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:16,944::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:16,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101984 s, 10.0 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:56:16,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000950468 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:16,947::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:16,948::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:16,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:16,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:16,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:16,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:16,950::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:16,951::__init__::225::IOProcess::(_processLogs) (9421) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:16,952::__init__::225::IOProcess::(_processLogs) (9421) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:16,952::__init__::225::IOProcess::(_processLogs) (9421) Building response >Thread-19::DEBUG::2014-09-09 11:56:16,952::__init__::225::IOProcess::(_processLogs) (9421) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:16,953::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:16,953::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:16,954::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:16,954::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:56:16,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:16,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:16,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:16,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:16,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:16,957::__init__::225::IOProcess::(_processLogs) (9422) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:16,957::__init__::225::IOProcess::(_processLogs) (9422) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:16,958::__init__::225::IOProcess::(_processLogs) (9422) Building response >Thread-19::DEBUG::2014-09-09 11:56:16,958::__init__::225::IOProcess::(_processLogs) (9422) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:16,959::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:16,960::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:16,960::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:16,961::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:56:16,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:16,961::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:16,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:16,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:16,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:16,963::__init__::225::IOProcess::(_processLogs) (9423) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:16,963::__init__::225::IOProcess::(_processLogs) (9423) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:16,964::__init__::225::IOProcess::(_processLogs) DEBUG|(9423) Building response >Thread-19::DEBUG::2014-09-09 11:56:16,965::__init__::225::IOProcess::(_processLogs) (9423) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:16,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:16,966::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:16,966::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:16,967::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:56:16,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:16,967::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:16,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:16,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:16,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:16,969::__init__::225::IOProcess::(_processLogs) (9424) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:16,969::__init__::225::IOProcess::(_processLogs) (9424) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:16,970::__init__::225::IOProcess::(_processLogs) DEBUG|(9424) Building response >Thread-19::DEBUG::2014-09-09 11:56:16,970::__init__::225::IOProcess::(_processLogs) (9424) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:16,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:16,971::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:17,522::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:17,523::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4312::DEBUG::2014-09-09 11:56:17,524::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:18,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:19,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900798 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:19,833::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4313::DEBUG::2014-09-09 11:56:19,835::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:56:19,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4313::DEBUG::2014-09-09 11:56:19,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bb3f829-4a00-4aa3-a1f7-cb6b86f161c2`::moving from state init -> state preparing >Thread-4313::INFO::2014-09-09 11:56:19,838::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4313::INFO::2014-09-09 11:56:19,839::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4313::DEBUG::2014-09-09 11:56:19,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bb3f829-4a00-4aa3-a1f7-cb6b86f161c2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4313::DEBUG::2014-09-09 11:56:19,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bb3f829-4a00-4aa3-a1f7-cb6b86f161c2`::moving from state preparing -> state finished >Thread-4313::DEBUG::2014-09-09 11:56:19,840::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4313::DEBUG::2014-09-09 11:56:19,840::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4313::DEBUG::2014-09-09 11:56:19,841::task::993::Storage.TaskManager.Task::(_decref) Task=`8bb3f829-4a00-4aa3-a1f7-cb6b86f161c2`::ref 0 aborting False >Thread-4313::DEBUG::2014-09-09 11:56:19,842::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4313::DEBUG::2014-09-09 11:56:19,842::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:19,876::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:19,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4314::DEBUG::2014-09-09 11:56:19,877::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4314::DEBUG::2014-09-09 11:56:19,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0a11cf9-a18c-4f32-85bb-737feab89db7`::moving from state init -> state preparing >Thread-4314::INFO::2014-09-09 11:56:19,880::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4314::DEBUG::2014-09-09 11:56:19,881::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ee4e4d70-cac0-40f8-8945-2394e99cc88a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4314::DEBUG::2014-09-09 11:56:19,881::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4314::DEBUG::2014-09-09 11:56:19,882::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4314::DEBUG::2014-09-09 11:56:19,883::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ee4e4d70-cac0-40f8-8945-2394e99cc88a`::Granted request >Thread-4314::DEBUG::2014-09-09 11:56:19,884::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e0a11cf9-a18c-4f32-85bb-737feab89db7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4314::DEBUG::2014-09-09 11:56:19,884::task::993::Storage.TaskManager.Task::(_decref) Task=`e0a11cf9-a18c-4f32-85bb-737feab89db7`::ref 1 aborting False >Thread-4314::INFO::2014-09-09 11:56:19,892::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4314::DEBUG::2014-09-09 11:56:19,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0a11cf9-a18c-4f32-85bb-737feab89db7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4314::DEBUG::2014-09-09 11:56:19,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0a11cf9-a18c-4f32-85bb-737feab89db7`::moving from state preparing -> state finished >Thread-4314::DEBUG::2014-09-09 11:56:19,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4314::DEBUG::2014-09-09 11:56:19,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4314::DEBUG::2014-09-09 11:56:19,894::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4314::DEBUG::2014-09-09 11:56:19,895::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4314::DEBUG::2014-09-09 11:56:19,896::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4314::DEBUG::2014-09-09 11:56:19,896::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4314::DEBUG::2014-09-09 11:56:19,897::task::993::Storage.TaskManager.Task::(_decref) Task=`e0a11cf9-a18c-4f32-85bb-737feab89db7`::ref 0 aborting False >Thread-4314::DEBUG::2014-09-09 11:56:19,897::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4314::DEBUG::2014-09-09 11:56:19,898::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:56:20,319::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) (9425) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:20,320::__init__::225::IOProcess::(_processLogs) (9425) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:20,321::__init__::225::IOProcess::(_processLogs) DEBUG|(9425) Building response >Thread-19::DEBUG::2014-09-09 11:56:20,321::__init__::225::IOProcess::(_processLogs) (9425) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:20,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:20,321::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:56:20,322::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:56:20,329::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114346 s, 982 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:20,329::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) (9426) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) (9426) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:20,330::__init__::225::IOProcess::(_processLogs) DEBUG|(9426) Building response >Thread-19::DEBUG::2014-09-09 11:56:20,331::__init__::225::IOProcess::(_processLogs) (9426) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:20,331::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:20,331::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:20,538::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:20,539::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4315::DEBUG::2014-09-09 11:56:20,540::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:21,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:21,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896541 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:56:23,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:23,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904136 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:23,556::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:23,556::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4316::DEBUG::2014-09-09 11:56:23,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc5c1c4f-b12f-4d55-947f-9f97997a6bac`::moving from state init -> state preparing >Thread-4316::INFO::2014-09-09 11:56:23,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4316::INFO::2014-09-09 11:56:23,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114346', 'lastCheck': '3.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000950468', 'lastCheck': '6.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000991828', 'lastCheck': '8.6', 'valid': True}} >Thread-4316::DEBUG::2014-09-09 11:56:23,558::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc5c1c4f-b12f-4d55-947f-9f97997a6bac`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114346', 'lastCheck': '3.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000950468', 'lastCheck': '6.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000991828', 'lastCheck': '8.6', 'valid': True}} >Thread-4316::DEBUG::2014-09-09 11:56:23,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc5c1c4f-b12f-4d55-947f-9f97997a6bac`::moving from state preparing -> state finished >Thread-4316::DEBUG::2014-09-09 11:56:23,558::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4316::DEBUG::2014-09-09 11:56:23,558::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4316::DEBUG::2014-09-09 11:56:23,558::task::993::Storage.TaskManager.Task::(_decref) Task=`bc5c1c4f-b12f-4d55-947f-9f97997a6bac`::ref 0 aborting False >Thread-4316::DEBUG::2014-09-09 11:56:23,559::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:23,576::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:23,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4317::DEBUG::2014-09-09 11:56:23,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:56:24,950::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:24,950::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:24,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:24,950::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:24,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:24,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:24,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:24,951::__init__::225::IOProcess::(_processLogs) (9427) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:24,951::__init__::225::IOProcess::(_processLogs) (9427) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:24,951::__init__::225::IOProcess::(_processLogs) DEBUG|(9427) Building response >Thread-19::DEBUG::2014-09-09 11:56:24,952::__init__::225::IOProcess::(_processLogs) (9427) Queuing response >Thread-3443::DEBUG::2014-09-09 11:56:24,952::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:24,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:24,957::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:56:24,959::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000956107 s, 371 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:24,959::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) (9428) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) (9428) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:24,960::__init__::225::IOProcess::(_processLogs) DEBUG|(9428) Building response >Thread-19::DEBUG::2014-09-09 11:56:24,961::__init__::225::IOProcess::(_processLogs) (9428) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:24,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:24,962::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:25,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:25,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899452 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:26,713::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:26,714::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4318::DEBUG::2014-09-09 11:56:26,715::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:56:26,970::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) (9429) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) (9429) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9429) Building response >Thread-19::DEBUG::2014-09-09 11:56:26,971::__init__::225::IOProcess::(_processLogs) (9429) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:26,972::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:26,972::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:56:26,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:56:26,980::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0009687 s, 566 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:26,980::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:26,980::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:26,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:26,980::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) (9430) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) (9430) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9430) Building response >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) (9430) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:26,981::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:26,982::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:26,982::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) (9431) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) (9431) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) (9431) Building response >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) (9431) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:26,983::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:26,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) (9432) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) (9432) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) (9432) Building response >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) (9432) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:56:26,985::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) (9433) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) (9433) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) (9433) Building response >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) (9433) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:26,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:26,987::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:56:27,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:27,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905061 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:56:29,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:29,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903273 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:29,728::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:29,728::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4319::DEBUG::2014-09-09 11:56:29,729::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:29,939::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4320::DEBUG::2014-09-09 11:56:29,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:56:29,940::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4320::DEBUG::2014-09-09 11:56:29,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`09ce0efb-6ee5-42fa-92e7-dc085365a0cf`::moving from state init -> state preparing >Thread-4320::INFO::2014-09-09 11:56:29,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4320::INFO::2014-09-09 11:56:29,941::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4320::DEBUG::2014-09-09 11:56:29,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`09ce0efb-6ee5-42fa-92e7-dc085365a0cf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4320::DEBUG::2014-09-09 11:56:29,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`09ce0efb-6ee5-42fa-92e7-dc085365a0cf`::moving from state preparing -> state finished >Thread-4320::DEBUG::2014-09-09 11:56:29,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4320::DEBUG::2014-09-09 11:56:29,941::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4320::DEBUG::2014-09-09 11:56:29,941::task::993::Storage.TaskManager.Task::(_decref) Task=`09ce0efb-6ee5-42fa-92e7-dc085365a0cf`::ref 0 aborting False >Thread-4320::DEBUG::2014-09-09 11:56:29,941::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4320::DEBUG::2014-09-09 11:56:29,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:29,975::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:29,976::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4321::DEBUG::2014-09-09 11:56:29,976::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4321::DEBUG::2014-09-09 11:56:29,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`946574d0-e335-44f2-af6b-9d9943602941`::moving from state init -> state preparing >Thread-4321::INFO::2014-09-09 11:56:29,977::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4321::DEBUG::2014-09-09 11:56:29,978::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b368f07a-658e-429c-bbc5-503f99bda468`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4321::DEBUG::2014-09-09 11:56:29,978::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4321::DEBUG::2014-09-09 11:56:29,978::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4321::DEBUG::2014-09-09 11:56:29,978::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b368f07a-658e-429c-bbc5-503f99bda468`::Granted request >Thread-4321::DEBUG::2014-09-09 11:56:29,978::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`946574d0-e335-44f2-af6b-9d9943602941`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4321::DEBUG::2014-09-09 11:56:29,978::task::993::Storage.TaskManager.Task::(_decref) Task=`946574d0-e335-44f2-af6b-9d9943602941`::ref 1 aborting False >Thread-4321::INFO::2014-09-09 11:56:29,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4321::DEBUG::2014-09-09 11:56:29,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`946574d0-e335-44f2-af6b-9d9943602941`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4321::DEBUG::2014-09-09 11:56:29,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`946574d0-e335-44f2-af6b-9d9943602941`::moving from state preparing -> state finished >Thread-4321::DEBUG::2014-09-09 11:56:29,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4321::DEBUG::2014-09-09 11:56:29,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4321::DEBUG::2014-09-09 11:56:29,981::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4321::DEBUG::2014-09-09 11:56:29,981::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4321::DEBUG::2014-09-09 11:56:29,981::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4321::DEBUG::2014-09-09 11:56:29,981::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4321::DEBUG::2014-09-09 11:56:29,981::task::993::Storage.TaskManager.Task::(_decref) Task=`946574d0-e335-44f2-af6b-9d9943602941`::ref 0 aborting False >Thread-4321::DEBUG::2014-09-09 11:56:29,981::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4321::DEBUG::2014-09-09 11:56:29,981::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:30,332::__init__::225::IOProcess::(_processLogs) (9434) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:30,333::__init__::225::IOProcess::(_processLogs) (9434) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:30,333::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9434) Building response >Thread-19::DEBUG::2014-09-09 11:56:30,333::__init__::225::IOProcess::(_processLogs) (9434) Queuing response >Thread-23::DEBUG::2014-09-09 11:56:30,333::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:30,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:30,338::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:56:30,340::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108869 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) (9435) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:30,341::__init__::225::IOProcess::(_processLogs) (9435) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:30,342::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9435) Building response >Thread-19::DEBUG::2014-09-09 11:56:30,342::__init__::225::IOProcess::(_processLogs) (9435) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:30,342::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:30,343::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:31,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:31,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904499 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:32,742::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:32,743::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4322::DEBUG::2014-09-09 11:56:32,744::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:33,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:33,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897181 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:34,962::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:34,962::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:34,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:34,962::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:34,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:34,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:34,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:34,963::__init__::225::IOProcess::(_processLogs) (9436) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:34,963::__init__::225::IOProcess::(_processLogs) (9436) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:34,965::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9436) Building response >Thread-19::DEBUG::2014-09-09 11:56:34,965::__init__::225::IOProcess::(_processLogs) (9436) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:34,965::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:34,965::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:56:34,966::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:56:34,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000944383 s, 376 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:34,974::__init__::225::IOProcess::(_processLogs) (9437) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:34,975::__init__::225::IOProcess::(_processLogs) (9437) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:34,975::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9437) Building response >Thread-19::DEBUG::2014-09-09 11:56:34,975::__init__::225::IOProcess::(_processLogs) (9437) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:34,975::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:34,976::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:35,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:35,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4323::DEBUG::2014-09-09 11:56:35,755::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:35,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:35,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899121 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:36,986::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:36,986::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) (9438) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) (9438) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:36,987::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9438) Building response >Thread-24::DEBUG::2014-09-09 11:56:36,988::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:36,988::__init__::225::IOProcess::(_processLogs) (9438) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:36,993::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:36,993::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:56:36,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00103591 s, 529 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:36,996::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:36,996::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) (9439) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) (9439) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9439) Building response >Thread-19::DEBUG::2014-09-09 11:56:36,997::__init__::225::IOProcess::(_processLogs) (9439) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:36,998::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:36,998::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:36,998::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:36,998::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:56:36,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) (9440) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) (9440) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) (9440) Building response >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) (9440) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:36,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:37,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) (9441) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) (9441) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) (9441) Building response >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) (9441) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:56:37,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) (9442) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) (9442) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) (9442) Building response >Thread-19::DEBUG::2014-09-09 11:56:37,002::__init__::225::IOProcess::(_processLogs) (9442) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:37,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:37,003::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:56:37,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:38,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901425 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:38,763::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:38,764::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4324::DEBUG::2014-09-09 11:56:38,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`5832d133-5faf-42f1-8400-3cd5c5325e51`::moving from state init -> state preparing >Thread-4324::INFO::2014-09-09 11:56:38,766::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4324::INFO::2014-09-09 11:56:38,766::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108869', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103591', 'lastCheck': '1.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000944383', 'lastCheck': '3.8', 'valid': True}} >Thread-4324::DEBUG::2014-09-09 11:56:38,766::task::1191::Storage.TaskManager.Task::(prepare) Task=`5832d133-5faf-42f1-8400-3cd5c5325e51`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108869', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103591', 'lastCheck': '1.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000944383', 'lastCheck': '3.8', 'valid': True}} >Thread-4324::DEBUG::2014-09-09 11:56:38,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`5832d133-5faf-42f1-8400-3cd5c5325e51`::moving from state preparing -> state finished >Thread-4324::DEBUG::2014-09-09 11:56:38,766::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4324::DEBUG::2014-09-09 11:56:38,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4324::DEBUG::2014-09-09 11:56:38,766::task::993::Storage.TaskManager.Task::(_decref) Task=`5832d133-5faf-42f1-8400-3cd5c5325e51`::ref 0 aborting False >Thread-4324::DEBUG::2014-09-09 11:56:38,767::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:38,777::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:38,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4325::DEBUG::2014-09-09 11:56:38,778::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:40,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:40,029::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4326::DEBUG::2014-09-09 11:56:40,031::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:56:40,031::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4326::DEBUG::2014-09-09 11:56:40,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c729a1d-0d7e-4311-b910-0e3a5f01e92b`::moving from state init -> state preparing >Thread-4326::INFO::2014-09-09 11:56:40,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4326::INFO::2014-09-09 11:56:40,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4326::DEBUG::2014-09-09 11:56:40,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c729a1d-0d7e-4311-b910-0e3a5f01e92b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4326::DEBUG::2014-09-09 11:56:40,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c729a1d-0d7e-4311-b910-0e3a5f01e92b`::moving from state preparing -> state finished >Thread-4326::DEBUG::2014-09-09 11:56:40,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4326::DEBUG::2014-09-09 11:56:40,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4326::DEBUG::2014-09-09 11:56:40,037::task::993::Storage.TaskManager.Task::(_decref) Task=`1c729a1d-0d7e-4311-b910-0e3a5f01e92b`::ref 0 aborting False >Thread-4326::DEBUG::2014-09-09 11:56:40,037::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4326::DEBUG::2014-09-09 11:56:40,038::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:40,091::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4327::DEBUG::2014-09-09 11:56:40,092::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:56:40,092::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4327::DEBUG::2014-09-09 11:56:40,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`50c9086a-49a0-4126-b469-d39dd4ff2916`::moving from state init -> state preparing >Thread-4327::INFO::2014-09-09 11:56:40,093::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4327::DEBUG::2014-09-09 11:56:40,093::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`acdf894c-3877-4304-9098-1ae17b2512eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4327::DEBUG::2014-09-09 11:56:40,093::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4327::DEBUG::2014-09-09 11:56:40,093::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4327::DEBUG::2014-09-09 11:56:40,093::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`acdf894c-3877-4304-9098-1ae17b2512eb`::Granted request >Thread-4327::DEBUG::2014-09-09 11:56:40,094::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`50c9086a-49a0-4126-b469-d39dd4ff2916`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4327::DEBUG::2014-09-09 11:56:40,094::task::993::Storage.TaskManager.Task::(_decref) Task=`50c9086a-49a0-4126-b469-d39dd4ff2916`::ref 1 aborting False >Thread-4327::INFO::2014-09-09 11:56:40,096::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4327::DEBUG::2014-09-09 11:56:40,096::task::1191::Storage.TaskManager.Task::(prepare) Task=`50c9086a-49a0-4126-b469-d39dd4ff2916`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4327::DEBUG::2014-09-09 11:56:40,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`50c9086a-49a0-4126-b469-d39dd4ff2916`::moving from state preparing -> state finished >Thread-4327::DEBUG::2014-09-09 11:56:40,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4327::DEBUG::2014-09-09 11:56:40,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4327::DEBUG::2014-09-09 11:56:40,097::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4327::DEBUG::2014-09-09 11:56:40,097::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4327::DEBUG::2014-09-09 11:56:40,097::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4327::DEBUG::2014-09-09 11:56:40,097::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4327::DEBUG::2014-09-09 11:56:40,097::task::993::Storage.TaskManager.Task::(_decref) Task=`50c9086a-49a0-4126-b469-d39dd4ff2916`::ref 0 aborting False >Thread-4327::DEBUG::2014-09-09 11:56:40,097::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4327::DEBUG::2014-09-09 11:56:40,097::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:40,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899343 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:40,343::__init__::225::IOProcess::(_processLogs) (9443) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:40,344::__init__::225::IOProcess::(_processLogs) (9443) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:40,344::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9443) Building response >Thread-19::DEBUG::2014-09-09 11:56:40,345::__init__::225::IOProcess::(_processLogs) (9443) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:40,345::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:40,345::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:56:40,345::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:56:40,353::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108774 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) (9444) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:40,354::__init__::225::IOProcess::(_processLogs) (9444) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:40,355::__init__::225::IOProcess::(_processLogs) (9444) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:40,355::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:41,971::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:41,972::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4328::DEBUG::2014-09-09 11:56:41,973::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:42,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:42,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897141 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:56:44,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:44,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902439 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:44,976::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:44,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:44,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:44,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:44,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:44,977::__init__::225::IOProcess::(_processLogs) (9445) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:44,977::__init__::225::IOProcess::(_processLogs) (9445) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:44,977::__init__::225::IOProcess::(_processLogs) (9445) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:44,978::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:56:44,978::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:56:44,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000966574 s, 367 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:44,985::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) (9446) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) (9446) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:44,986::__init__::225::IOProcess::(_processLogs) (9446) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:44,987::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:45,013::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:45,014::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4329::DEBUG::2014-09-09 11:56:45,015::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:46,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:46,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897091 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:47,002::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:47,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:47,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:47,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:47,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:47,003::__init__::225::IOProcess::(_processLogs) (9447) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:47,003::__init__::225::IOProcess::(_processLogs) (9447) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:47,004::__init__::225::IOProcess::(_processLogs) (9447) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:47,004::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:56:47,005::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:56:47,012::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000985126 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) (9448) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) (9448) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:47,013::__init__::225::IOProcess::(_processLogs) (9448) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:47,014::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:47,014::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:56:47,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) (9449) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) (9449) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) (9449) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:47,015::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) (9450) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:47,016::__init__::225::IOProcess::(_processLogs) (9450) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:47,017::__init__::225::IOProcess::(_processLogs) (9450) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:47,017::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:47,017::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:56:47,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:47,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:47,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:47,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:47,018::__init__::225::IOProcess::(_processLogs) (9451) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:47,018::__init__::225::IOProcess::(_processLogs) (9451) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:47,018::__init__::225::IOProcess::(_processLogs) (9451) Building response >Thread-19::DEBUG::2014-09-09 11:56:47,019::__init__::225::IOProcess::(_processLogs) (9451) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:47,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:47,019::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:48,026::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:48,027::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4330::DEBUG::2014-09-09 11:56:48,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:48,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:48,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905101 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:50,148::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:50,149::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4331::DEBUG::2014-09-09 11:56:50,149::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4331::DEBUG::2014-09-09 11:56:50,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e1a69b2-cd8d-4a6b-96a7-07f224de4fb4`::moving from state init -> state preparing >Thread-4331::INFO::2014-09-09 11:56:50,152::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4331::INFO::2014-09-09 11:56:50,153::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4331::DEBUG::2014-09-09 11:56:50,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e1a69b2-cd8d-4a6b-96a7-07f224de4fb4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4331::DEBUG::2014-09-09 11:56:50,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e1a69b2-cd8d-4a6b-96a7-07f224de4fb4`::moving from state preparing -> state finished >Thread-4331::DEBUG::2014-09-09 11:56:50,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4331::DEBUG::2014-09-09 11:56:50,155::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4331::DEBUG::2014-09-09 11:56:50,155::task::993::Storage.TaskManager.Task::(_decref) Task=`1e1a69b2-cd8d-4a6b-96a7-07f224de4fb4`::ref 0 aborting False >Thread-4331::DEBUG::2014-09-09 11:56:50,156::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4331::DEBUG::2014-09-09 11:56:50,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:50,194::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:50,195::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4332::DEBUG::2014-09-09 11:56:50,196::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4332::DEBUG::2014-09-09 11:56:50,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fec119f-bcf6-4708-b4a1-83ac8fe9f3c7`::moving from state init -> state preparing >Thread-4332::INFO::2014-09-09 11:56:50,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4332::DEBUG::2014-09-09 11:56:50,201::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b5e73ae4-304e-4cf5-a3f4-70d3abcf4d06`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4332::DEBUG::2014-09-09 11:56:50,202::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4332::DEBUG::2014-09-09 11:56:50,203::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4332::DEBUG::2014-09-09 11:56:50,204::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b5e73ae4-304e-4cf5-a3f4-70d3abcf4d06`::Granted request >Thread-4332::DEBUG::2014-09-09 11:56:50,206::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5fec119f-bcf6-4708-b4a1-83ac8fe9f3c7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4332::DEBUG::2014-09-09 11:56:50,206::task::993::Storage.TaskManager.Task::(_decref) Task=`5fec119f-bcf6-4708-b4a1-83ac8fe9f3c7`::ref 1 aborting False >Thread-4332::INFO::2014-09-09 11:56:50,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4332::DEBUG::2014-09-09 11:56:50,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fec119f-bcf6-4708-b4a1-83ac8fe9f3c7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4332::DEBUG::2014-09-09 11:56:50,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fec119f-bcf6-4708-b4a1-83ac8fe9f3c7`::moving from state preparing -> state finished >Thread-4332::DEBUG::2014-09-09 11:56:50,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4332::DEBUG::2014-09-09 11:56:50,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4332::DEBUG::2014-09-09 11:56:50,222::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4332::DEBUG::2014-09-09 11:56:50,223::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4332::DEBUG::2014-09-09 11:56:50,224::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4332::DEBUG::2014-09-09 11:56:50,225::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4332::DEBUG::2014-09-09 11:56:50,226::task::993::Storage.TaskManager.Task::(_decref) Task=`5fec119f-bcf6-4708-b4a1-83ac8fe9f3c7`::ref 0 aborting False >Thread-4332::DEBUG::2014-09-09 11:56:50,227::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4332::DEBUG::2014-09-09 11:56:50,228::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:56:50,356::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:50,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:50,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:50,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:50,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-23::DEBUG::2014-09-09 11:56:50,360::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:50,360::__init__::225::IOProcess::(_processLogs) (9452) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:50,366::__init__::225::IOProcess::(_processLogs) (9452) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:50,367::__init__::225::IOProcess::(_processLogs) (9452) Building response >Thread-19::DEBUG::2014-09-09 11:56:50,367::__init__::225::IOProcess::(_processLogs) (9452) Queuing response >Thread-23::DEBUG::2014-09-09 11:56:50,368::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00118034 s, 951 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:50,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:50,370::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:50,370::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:56:50,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:50,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:50,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:50,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:50,374::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:50,375::__init__::225::IOProcess::(_processLogs) (9453) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:50,375::__init__::225::IOProcess::(_processLogs) (9453) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:50,376::__init__::225::IOProcess::(_processLogs) (9453) Building response >Thread-19::DEBUG::2014-09-09 11:56:50,376::__init__::225::IOProcess::(_processLogs) (9453) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:50,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:50,377::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:50,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:50,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896732 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:51,044::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:51,045::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4333::DEBUG::2014-09-09 11:56:51,046::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:52,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:52,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905536 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:54,061::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:54,061::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4334::DEBUG::2014-09-09 11:56:54,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`54c79740-8bbb-4208-9038-793d3665e883`::moving from state init -> state preparing >Thread-4334::INFO::2014-09-09 11:56:54,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4334::INFO::2014-09-09 11:56:54,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00118034', 'lastCheck': '3.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000985126', 'lastCheck': '7.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966574', 'lastCheck': '9.1', 'valid': True}} >Thread-4334::DEBUG::2014-09-09 11:56:54,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`54c79740-8bbb-4208-9038-793d3665e883`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00118034', 'lastCheck': '3.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000985126', 'lastCheck': '7.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966574', 'lastCheck': '9.1', 'valid': True}} >Thread-4334::DEBUG::2014-09-09 11:56:54,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`54c79740-8bbb-4208-9038-793d3665e883`::moving from state preparing -> state finished >Thread-4334::DEBUG::2014-09-09 11:56:54,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4334::DEBUG::2014-09-09 11:56:54,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4334::DEBUG::2014-09-09 11:56:54,065::task::993::Storage.TaskManager.Task::(_decref) Task=`54c79740-8bbb-4208-9038-793d3665e883`::ref 0 aborting False >Thread-4334::DEBUG::2014-09-09 11:56:54,068::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:54,078::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:54,078::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4335::DEBUG::2014-09-09 11:56:54,079::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:54,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:54,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900096 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) (9454) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:54,988::__init__::225::IOProcess::(_processLogs) (9454) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:54,989::__init__::225::IOProcess::(_processLogs) DEBUG|(9454) Building response >Thread-19::DEBUG::2014-09-09 11:56:54,989::__init__::225::IOProcess::(_processLogs) (9454) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:54,989::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:54,990::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:56:54,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:56:54,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000901023 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:54,997::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) (9455) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) (9455) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) DEBUG|(9455) Building response >Thread-19::DEBUG::2014-09-09 11:56:54,998::__init__::225::IOProcess::(_processLogs) (9455) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:54,999::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:54,999::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:56:56,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:56,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903406 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:57,018::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) (9456) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:57,019::__init__::225::IOProcess::(_processLogs) (9456) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:57,020::__init__::225::IOProcess::(_processLogs) DEBUG|(9456) Building response >Thread-19::DEBUG::2014-09-09 11:56:57,020::__init__::225::IOProcess::(_processLogs) (9456) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:57,020::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:56:57,021::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:56:57,021::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:56:57,028::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000921346 s, 595 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:57,029::__init__::225::IOProcess::(_processLogs) (9457) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:56:57,030::__init__::225::IOProcess::(_processLogs) (9457) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:56:57,030::__init__::225::IOProcess::(_processLogs) DEBUG|(9457) Building response >Thread-19::DEBUG::2014-09-09 11:56:57,030::__init__::225::IOProcess::(_processLogs) (9457) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:57,030::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:57,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) (9458) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) (9458) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) (9458) Building response >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) (9458) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:56:57,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) (9459) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) (9459) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) (9459) Building response >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) (9459) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:57,033::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:56:57,034::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:56:57,034::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:56:57,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:56:57,034::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:56:57,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) (9460) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) (9460) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) (9460) Building response >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) (9460) Queuing response >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:56:57,035::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:56:57,150::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:56:57,150::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4336::DEBUG::2014-09-09 11:56:57,151::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:56:58,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:56:59,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898327 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:00,164::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:00,165::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4337::DEBUG::2014-09-09 11:57:00,166::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:00,273::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4338::DEBUG::2014-09-09 11:57:00,274::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:57:00,274::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4338::DEBUG::2014-09-09 11:57:00,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`cec69365-53d3-4e36-91cf-9c60224b8e63`::moving from state init -> state preparing >Thread-4338::INFO::2014-09-09 11:57:00,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4338::INFO::2014-09-09 11:57:00,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4338::DEBUG::2014-09-09 11:57:00,275::task::1191::Storage.TaskManager.Task::(prepare) Task=`cec69365-53d3-4e36-91cf-9c60224b8e63`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4338::DEBUG::2014-09-09 11:57:00,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`cec69365-53d3-4e36-91cf-9c60224b8e63`::moving from state preparing -> state finished >Thread-4338::DEBUG::2014-09-09 11:57:00,275::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4338::DEBUG::2014-09-09 11:57:00,275::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4338::DEBUG::2014-09-09 11:57:00,275::task::993::Storage.TaskManager.Task::(_decref) Task=`cec69365-53d3-4e36-91cf-9c60224b8e63`::ref 0 aborting False >Thread-4338::DEBUG::2014-09-09 11:57:00,275::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4338::DEBUG::2014-09-09 11:57:00,276::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:00,313::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:00,313::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4339::DEBUG::2014-09-09 11:57:00,313::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4339::DEBUG::2014-09-09 11:57:00,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2233fb6-9249-46a4-a575-4c89538e2df1`::moving from state init -> state preparing >Thread-4339::INFO::2014-09-09 11:57:00,314::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4339::DEBUG::2014-09-09 11:57:00,314::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2a309a25-a98d-462e-ae08-cc03d25a4f4f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4339::DEBUG::2014-09-09 11:57:00,314::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4339::DEBUG::2014-09-09 11:57:00,315::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4339::DEBUG::2014-09-09 11:57:00,315::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2a309a25-a98d-462e-ae08-cc03d25a4f4f`::Granted request >Thread-4339::DEBUG::2014-09-09 11:57:00,315::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a2233fb6-9249-46a4-a575-4c89538e2df1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4339::DEBUG::2014-09-09 11:57:00,315::task::993::Storage.TaskManager.Task::(_decref) Task=`a2233fb6-9249-46a4-a575-4c89538e2df1`::ref 1 aborting False >Thread-4339::INFO::2014-09-09 11:57:00,317::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4339::DEBUG::2014-09-09 11:57:00,317::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2233fb6-9249-46a4-a575-4c89538e2df1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4339::DEBUG::2014-09-09 11:57:00,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2233fb6-9249-46a4-a575-4c89538e2df1`::moving from state preparing -> state finished >Thread-4339::DEBUG::2014-09-09 11:57:00,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4339::DEBUG::2014-09-09 11:57:00,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4339::DEBUG::2014-09-09 11:57:00,317::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4339::DEBUG::2014-09-09 11:57:00,317::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4339::DEBUG::2014-09-09 11:57:00,317::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4339::DEBUG::2014-09-09 11:57:00,317::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4339::DEBUG::2014-09-09 11:57:00,317::task::993::Storage.TaskManager.Task::(_decref) Task=`a2233fb6-9249-46a4-a575-4c89538e2df1`::ref 0 aborting False >Thread-4339::DEBUG::2014-09-09 11:57:00,318::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4339::DEBUG::2014-09-09 11:57:00,318::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:57:00,374::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) (9461) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) (9461) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:00,375::__init__::225::IOProcess::(_processLogs) DEBUG|(9461) Building response >Thread-19::DEBUG::2014-09-09 11:57:00,376::__init__::225::IOProcess::(_processLogs) (9461) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:00,376::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:00,376::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:57:00,376::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:57:00,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103853 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:00,384::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:00,384::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) (9462) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) (9462) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) DEBUG|(9462) Building response >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) (9462) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:00,385::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:00,386::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:57:01,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:01,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090051 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:57:03,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:03,181::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:03,182::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4340::DEBUG::2014-09-09 11:57:03,183::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:03,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899858 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:05,000::__init__::225::IOProcess::(_processLogs) (9463) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:05,001::__init__::225::IOProcess::(_processLogs) (9463) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:05,001::__init__::225::IOProcess::(_processLogs) DEBUG|(9463) Building response >Thread-19::DEBUG::2014-09-09 11:57:05,001::__init__::225::IOProcess::(_processLogs) (9463) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:05,001::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:05,002::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:57:05,002::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:57:05,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910231 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:05,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:05,011::__init__::225::IOProcess::(_processLogs) (9464) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:05,011::__init__::225::IOProcess::(_processLogs) (9464) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:05,011::__init__::225::IOProcess::(_processLogs) DEBUG|(9464) Building response >Thread-19::DEBUG::2014-09-09 11:57:05,011::__init__::225::IOProcess::(_processLogs) (9464) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:05,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:05,011::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:57:05,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:05,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897811 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:06,196::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:06,197::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4341::DEBUG::2014-09-09 11:57:06,198::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) (9465) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:07,035::__init__::225::IOProcess::(_processLogs) (9465) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:07,036::__init__::225::IOProcess::(_processLogs) DEBUG|(9465) Building response >Thread-19::DEBUG::2014-09-09 11:57:07,036::__init__::225::IOProcess::(_processLogs) (9465) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:07,036::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:57:07,037::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:57:07,037::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:57:07,044::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000962088 s, 570 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) (9466) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:07,045::__init__::225::IOProcess::(_processLogs) (9466) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:07,046::__init__::225::IOProcess::(_processLogs) DEBUG|(9466) Building response >Thread-19::DEBUG::2014-09-09 11:57:07,046::__init__::225::IOProcess::(_processLogs) (9466) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:07,046::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:07,047::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:57:07,047::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:07,047::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:57:07,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:07,047::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:07,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) (9467) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) (9467) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) (9467) Building response >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) (9467) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:07,048::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) (9468) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) (9468) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) (9468) Building response >Thread-19::DEBUG::2014-09-09 11:57:07,049::__init__::225::IOProcess::(_processLogs) (9468) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) (9469) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:07,050::__init__::225::IOProcess::(_processLogs) (9469) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:07,051::__init__::225::IOProcess::(_processLogs) DEBUG|(9469) Building response >Thread-19::DEBUG::2014-09-09 11:57:07,051::__init__::225::IOProcess::(_processLogs) (9469) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:07,051::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:07,051::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:57:07,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:07,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901214 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:09,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:09,206::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4342::DEBUG::2014-09-09 11:57:09,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbec71e1-a623-4077-a496-83a13e8d3ef8`::moving from state init -> state preparing >Thread-4342::INFO::2014-09-09 11:57:09,208::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4342::INFO::2014-09-09 11:57:09,208::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103853', 'lastCheck': '8.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000962088', 'lastCheck': '2.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910231', 'lastCheck': '4.2', 'valid': True}} >Thread-4342::DEBUG::2014-09-09 11:57:09,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbec71e1-a623-4077-a496-83a13e8d3ef8`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103853', 'lastCheck': '8.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000962088', 'lastCheck': '2.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910231', 'lastCheck': '4.2', 'valid': True}} >Thread-4342::DEBUG::2014-09-09 11:57:09,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbec71e1-a623-4077-a496-83a13e8d3ef8`::moving from state preparing -> state finished >Thread-4342::DEBUG::2014-09-09 11:57:09,208::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4342::DEBUG::2014-09-09 11:57:09,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4342::DEBUG::2014-09-09 11:57:09,208::task::993::Storage.TaskManager.Task::(_decref) Task=`cbec71e1-a623-4077-a496-83a13e8d3ef8`::ref 0 aborting False >Thread-4342::DEBUG::2014-09-09 11:57:09,209::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:09,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:09,223::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4343::DEBUG::2014-09-09 11:57:09,224::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:09,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:09,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902842 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:10,362::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:10,363::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4344::DEBUG::2014-09-09 11:57:10,363::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4344::DEBUG::2014-09-09 11:57:10,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`123529b3-c880-4e9b-8bc7-176b2375a18d`::moving from state init -> state preparing >Thread-4344::INFO::2014-09-09 11:57:10,364::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4344::INFO::2014-09-09 11:57:10,364::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4344::DEBUG::2014-09-09 11:57:10,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`123529b3-c880-4e9b-8bc7-176b2375a18d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4344::DEBUG::2014-09-09 11:57:10,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`123529b3-c880-4e9b-8bc7-176b2375a18d`::moving from state preparing -> state finished >Thread-4344::DEBUG::2014-09-09 11:57:10,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4344::DEBUG::2014-09-09 11:57:10,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4344::DEBUG::2014-09-09 11:57:10,365::task::993::Storage.TaskManager.Task::(_decref) Task=`123529b3-c880-4e9b-8bc7-176b2375a18d`::ref 0 aborting False >Thread-4344::DEBUG::2014-09-09 11:57:10,365::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4344::DEBUG::2014-09-09 11:57:10,365::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) (9470) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:10,387::__init__::225::IOProcess::(_processLogs) (9470) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:10,389::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9470) Building response >Thread-19::DEBUG::2014-09-09 11:57:10,389::__init__::225::IOProcess::(_processLogs) (9470) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:10,389::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:57:10,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:57:10,390::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:57:10,397::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104511 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) (9471) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) (9471) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:10,398::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9471) Building response >Thread-19::DEBUG::2014-09-09 11:57:10,399::__init__::225::IOProcess::(_processLogs) (9471) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:10,399::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:10,399::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:10,424::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4345::DEBUG::2014-09-09 11:57:10,426::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:57:10,426::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4345::DEBUG::2014-09-09 11:57:10,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`946f9c54-d766-403d-af79-22243998e53e`::moving from state init -> state preparing >Thread-4345::INFO::2014-09-09 11:57:10,429::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4345::DEBUG::2014-09-09 11:57:10,430::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eca2bcca-439d-4ff7-ba62-e00ebd9bc0ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4345::DEBUG::2014-09-09 11:57:10,431::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4345::DEBUG::2014-09-09 11:57:10,432::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4345::DEBUG::2014-09-09 11:57:10,432::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eca2bcca-439d-4ff7-ba62-e00ebd9bc0ca`::Granted request >Thread-4345::DEBUG::2014-09-09 11:57:10,433::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`946f9c54-d766-403d-af79-22243998e53e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4345::DEBUG::2014-09-09 11:57:10,434::task::993::Storage.TaskManager.Task::(_decref) Task=`946f9c54-d766-403d-af79-22243998e53e`::ref 1 aborting False >Thread-4345::INFO::2014-09-09 11:57:10,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4345::DEBUG::2014-09-09 11:57:10,443::task::1191::Storage.TaskManager.Task::(prepare) Task=`946f9c54-d766-403d-af79-22243998e53e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4345::DEBUG::2014-09-09 11:57:10,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`946f9c54-d766-403d-af79-22243998e53e`::moving from state preparing -> state finished >Thread-4345::DEBUG::2014-09-09 11:57:10,443::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4345::DEBUG::2014-09-09 11:57:10,444::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4345::DEBUG::2014-09-09 11:57:10,445::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4345::DEBUG::2014-09-09 11:57:10,445::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4345::DEBUG::2014-09-09 11:57:10,446::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4345::DEBUG::2014-09-09 11:57:10,446::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4345::DEBUG::2014-09-09 11:57:10,447::task::993::Storage.TaskManager.Task::(_decref) Task=`946f9c54-d766-403d-af79-22243998e53e`::ref 0 aborting False >Thread-4345::DEBUG::2014-09-09 11:57:10,448::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4345::DEBUG::2014-09-09 11:57:10,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:11,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:11,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896228 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:12,291::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:12,292::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4346::DEBUG::2014-09-09 11:57:12,293::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:13,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:13,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905745 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:15,012::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) (9472) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:15,013::__init__::225::IOProcess::(_processLogs) (9472) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:15,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9472) Building response >Thread-19::DEBUG::2014-09-09 11:57:15,014::__init__::225::IOProcess::(_processLogs) (9472) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:15,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:15,015::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:57:15,015::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:57:15,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000870404 s, 408 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:15,022::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) (9473) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) (9473) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9473) Building response >Thread-19::DEBUG::2014-09-09 11:57:15,023::__init__::225::IOProcess::(_processLogs) (9473) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:15,024::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:15,024::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:15,308::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:15,309::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4347::DEBUG::2014-09-09 11:57:15,310::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:15,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:15,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896601 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:17,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:17,052::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:17,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:17,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:17,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:17,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:17,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:17,053::__init__::225::IOProcess::(_processLogs) (9474) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:17,053::__init__::225::IOProcess::(_processLogs) (9474) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:17,053::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9474) Building response >Thread-19::DEBUG::2014-09-09 11:57:17,054::__init__::225::IOProcess::(_processLogs) (9474) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:17,054::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:57:17,054::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:57:17,054::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:57:17,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000920176 s, 596 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:17,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:17,064::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:17,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) (9475) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) (9475) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9475) Building response >Thread-19::DEBUG::2014-09-09 11:57:17,065::__init__::225::IOProcess::(_processLogs) (9475) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:17,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:17,066::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:57:17,066::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:17,067::__init__::225::IOProcess::(_processLogs) (9476) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) (9476) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) (9476) Building response >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) (9476) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:17,068::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) (9477) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) (9477) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) (9477) Building response >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) (9477) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:17,069::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:17,070::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:57:17,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:17,070::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:17,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:17,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:17,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:17,071::__init__::225::IOProcess::(_processLogs) (9478) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:17,071::__init__::225::IOProcess::(_processLogs) (9478) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:17,071::__init__::225::IOProcess::(_processLogs) (9478) Building response >Thread-19::DEBUG::2014-09-09 11:57:17,071::__init__::225::IOProcess::(_processLogs) (9478) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:17,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:17,071::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:57:17,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:18,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900223 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:18,326::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:18,327::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4348::DEBUG::2014-09-09 11:57:18,328::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:20,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:20,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0989789 s, 10.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:20,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:20,401::__init__::225::IOProcess::(_processLogs) (9479) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:20,401::__init__::225::IOProcess::(_processLogs) (9479) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:20,401::__init__::225::IOProcess::(_processLogs) DEBUG|(9479) Building response >Thread-19::DEBUG::2014-09-09 11:57:20,401::__init__::225::IOProcess::(_processLogs) (9479) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:20,401::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:20,402::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:57:20,402::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:57:20,409::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109996 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:20,409::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:20,409::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:20,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) (9480) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) (9480) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) DEBUG|(9480) Building response >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) (9480) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:20,410::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:20,411::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:20,500::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:20,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4349::DEBUG::2014-09-09 11:57:20,501::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4349::DEBUG::2014-09-09 11:57:20,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0f15185-cb39-4acc-b2f2-14cc2c6d1c0a`::moving from state init -> state preparing >Thread-4349::INFO::2014-09-09 11:57:20,502::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4349::INFO::2014-09-09 11:57:20,502::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4349::DEBUG::2014-09-09 11:57:20,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0f15185-cb39-4acc-b2f2-14cc2c6d1c0a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4349::DEBUG::2014-09-09 11:57:20,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0f15185-cb39-4acc-b2f2-14cc2c6d1c0a`::moving from state preparing -> state finished >Thread-4349::DEBUG::2014-09-09 11:57:20,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4349::DEBUG::2014-09-09 11:57:20,503::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4349::DEBUG::2014-09-09 11:57:20,503::task::993::Storage.TaskManager.Task::(_decref) Task=`b0f15185-cb39-4acc-b2f2-14cc2c6d1c0a`::ref 0 aborting False >Thread-4349::DEBUG::2014-09-09 11:57:20,503::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4349::DEBUG::2014-09-09 11:57:20,503::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:20,530::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:20,531::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4350::DEBUG::2014-09-09 11:57:20,531::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4350::DEBUG::2014-09-09 11:57:20,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7769b5c-41a4-4fc2-be1b-804bda51f91b`::moving from state init -> state preparing >Thread-4350::INFO::2014-09-09 11:57:20,532::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4350::DEBUG::2014-09-09 11:57:20,532::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3c1f4201-ca4c-4f37-93e6-db8e726918bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4350::DEBUG::2014-09-09 11:57:20,532::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4350::DEBUG::2014-09-09 11:57:20,532::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4350::DEBUG::2014-09-09 11:57:20,532::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3c1f4201-ca4c-4f37-93e6-db8e726918bd`::Granted request >Thread-4350::DEBUG::2014-09-09 11:57:20,533::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a7769b5c-41a4-4fc2-be1b-804bda51f91b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4350::DEBUG::2014-09-09 11:57:20,533::task::993::Storage.TaskManager.Task::(_decref) Task=`a7769b5c-41a4-4fc2-be1b-804bda51f91b`::ref 1 aborting False >Thread-4350::INFO::2014-09-09 11:57:20,534::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4350::DEBUG::2014-09-09 11:57:20,534::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7769b5c-41a4-4fc2-be1b-804bda51f91b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4350::DEBUG::2014-09-09 11:57:20,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7769b5c-41a4-4fc2-be1b-804bda51f91b`::moving from state preparing -> state finished >Thread-4350::DEBUG::2014-09-09 11:57:20,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4350::DEBUG::2014-09-09 11:57:20,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4350::DEBUG::2014-09-09 11:57:20,535::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4350::DEBUG::2014-09-09 11:57:20,535::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4350::DEBUG::2014-09-09 11:57:20,535::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4350::DEBUG::2014-09-09 11:57:20,535::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4350::DEBUG::2014-09-09 11:57:20,535::task::993::Storage.TaskManager.Task::(_decref) Task=`a7769b5c-41a4-4fc2-be1b-804bda51f91b`::ref 0 aborting False >Thread-4350::DEBUG::2014-09-09 11:57:20,535::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4350::DEBUG::2014-09-09 11:57:20,535::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:21,345::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:21,346::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4351::DEBUG::2014-09-09 11:57:21,346::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:22,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:22,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902361 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:57:24,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:24,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:24,370::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4352::DEBUG::2014-09-09 11:57:24,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`d69833ed-4717-49e5-85e2-869d9cb0f53f`::moving from state init -> state preparing >Thread-4352::INFO::2014-09-09 11:57:24,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4352::INFO::2014-09-09 11:57:24,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109996', 'lastCheck': '4.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920176', 'lastCheck': '7.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000870404', 'lastCheck': '9.3', 'valid': True}} >Thread-4352::DEBUG::2014-09-09 11:57:24,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`d69833ed-4717-49e5-85e2-869d9cb0f53f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109996', 'lastCheck': '4.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920176', 'lastCheck': '7.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000870404', 'lastCheck': '9.3', 'valid': True}} >Thread-4352::DEBUG::2014-09-09 11:57:24,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`d69833ed-4717-49e5-85e2-869d9cb0f53f`::moving from state preparing -> state finished >Thread-4352::DEBUG::2014-09-09 11:57:24,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4352::DEBUG::2014-09-09 11:57:24,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4352::DEBUG::2014-09-09 11:57:24,372::task::993::Storage.TaskManager.Task::(_decref) Task=`d69833ed-4717-49e5-85e2-869d9cb0f53f`::ref 0 aborting False >Thread-4352::DEBUG::2014-09-09 11:57:24,373::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:24,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:24,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4353::DEBUG::2014-09-09 11:57:24,396::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:24,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0968337 s, 10.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:25,025::__init__::225::IOProcess::(_processLogs) (9481) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:25,026::__init__::225::IOProcess::(_processLogs) (9481) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:25,026::__init__::225::IOProcess::(_processLogs) DEBUG|(9481) Building response >Thread-19::DEBUG::2014-09-09 11:57:25,026::__init__::225::IOProcess::(_processLogs) (9481) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:25,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:25,027::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:57:25,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:57:25,033::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000866923 s, 409 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) (9482) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:25,034::__init__::225::IOProcess::(_processLogs) (9482) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:25,035::__init__::225::IOProcess::(_processLogs) (9482) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:25,035::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:57:26,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:26,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898754 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) (9483) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:27,071::__init__::225::IOProcess::(_processLogs) (9483) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:27,072::__init__::225::IOProcess::(_processLogs) (9483) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:27,072::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:57:27,073::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:57:27,081::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00097097 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:27,081::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:27,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:27,081::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:27,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:27,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:27,082::__init__::225::IOProcess::(_processLogs) (9484) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:27,082::__init__::225::IOProcess::(_processLogs) (9484) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:27,082::__init__::225::IOProcess::(_processLogs) (9484) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:27,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) (9485) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) (9485) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) (9485) Building response >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) (9485) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:27,083::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:27,084::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:57:27,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:27,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) (9486) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) (9486) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) (9486) Building response >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) (9486) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:57:27,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) (9487) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) (9487) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) (9487) Building response >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) (9487) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:27,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:27,087::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:27,467::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:27,468::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4354::DEBUG::2014-09-09 11:57:27,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:28,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:28,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897416 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) (9488) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:30,412::__init__::225::IOProcess::(_processLogs) (9488) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:30,413::__init__::225::IOProcess::(_processLogs) (9488) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:30,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:57:30,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:57:30,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108548 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:30,420::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:30,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:30,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:30,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:30,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:30,421::__init__::225::IOProcess::(_processLogs) (9489) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:30,421::__init__::225::IOProcess::(_processLogs) (9489) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:30,421::__init__::225::IOProcess::(_processLogs) (9489) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:30,422::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:30,484::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:30,485::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4355::DEBUG::2014-09-09 11:57:30,485::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:30,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:30,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4356::DEBUG::2014-09-09 11:57:30,577::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4356::DEBUG::2014-09-09 11:57:30,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d6b74f5-7409-406e-8f21-1f3530c8d9ec`::moving from state init -> state preparing >Thread-4356::INFO::2014-09-09 11:57:30,578::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4356::INFO::2014-09-09 11:57:30,578::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4356::DEBUG::2014-09-09 11:57:30,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d6b74f5-7409-406e-8f21-1f3530c8d9ec`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4356::DEBUG::2014-09-09 11:57:30,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d6b74f5-7409-406e-8f21-1f3530c8d9ec`::moving from state preparing -> state finished >Thread-4356::DEBUG::2014-09-09 11:57:30,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4356::DEBUG::2014-09-09 11:57:30,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4356::DEBUG::2014-09-09 11:57:30,579::task::993::Storage.TaskManager.Task::(_decref) Task=`1d6b74f5-7409-406e-8f21-1f3530c8d9ec`::ref 0 aborting False >Thread-4356::DEBUG::2014-09-09 11:57:30,579::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4356::DEBUG::2014-09-09 11:57:30,579::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:30,605::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4357::DEBUG::2014-09-09 11:57:30,605::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:57:30,605::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4357::DEBUG::2014-09-09 11:57:30,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`453b7bbe-99d0-480f-9c7d-cabdcf6dd155`::moving from state init -> state preparing >Thread-4357::INFO::2014-09-09 11:57:30,606::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4357::DEBUG::2014-09-09 11:57:30,606::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a7cfe1b3-b134-4ffa-8599-b0248847f50b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4357::DEBUG::2014-09-09 11:57:30,607::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4357::DEBUG::2014-09-09 11:57:30,607::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4357::DEBUG::2014-09-09 11:57:30,607::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a7cfe1b3-b134-4ffa-8599-b0248847f50b`::Granted request >Thread-4357::DEBUG::2014-09-09 11:57:30,607::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`453b7bbe-99d0-480f-9c7d-cabdcf6dd155`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4357::DEBUG::2014-09-09 11:57:30,607::task::993::Storage.TaskManager.Task::(_decref) Task=`453b7bbe-99d0-480f-9c7d-cabdcf6dd155`::ref 1 aborting False >Thread-4357::INFO::2014-09-09 11:57:30,609::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4357::DEBUG::2014-09-09 11:57:30,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`453b7bbe-99d0-480f-9c7d-cabdcf6dd155`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4357::DEBUG::2014-09-09 11:57:30,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`453b7bbe-99d0-480f-9c7d-cabdcf6dd155`::moving from state preparing -> state finished >Thread-4357::DEBUG::2014-09-09 11:57:30,609::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4357::DEBUG::2014-09-09 11:57:30,609::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4357::DEBUG::2014-09-09 11:57:30,610::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4357::DEBUG::2014-09-09 11:57:30,610::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4357::DEBUG::2014-09-09 11:57:30,610::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4357::DEBUG::2014-09-09 11:57:30,610::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4357::DEBUG::2014-09-09 11:57:30,610::task::993::Storage.TaskManager.Task::(_decref) Task=`453b7bbe-99d0-480f-9c7d-cabdcf6dd155`::ref 0 aborting False >Thread-4357::DEBUG::2014-09-09 11:57:30,610::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4357::DEBUG::2014-09-09 11:57:30,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:30,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:30,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900661 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:57:32,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:32,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897185 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:33,500::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:33,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4358::DEBUG::2014-09-09 11:57:33,502::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:34,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:34,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900439 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:35,036::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:35,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:35,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:35,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:35,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:35,037::__init__::225::IOProcess::(_processLogs) (9490) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:35,037::__init__::225::IOProcess::(_processLogs) (9490) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:35,039::__init__::225::IOProcess::(_processLogs) (9490) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:35,039::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:57:35,040::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:57:35,047::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000861569 s, 412 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:35,047::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) (9491) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) (9491) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:35,048::__init__::225::IOProcess::(_processLogs) (9491) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:35,049::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:36,510::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:36,511::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4359::DEBUG::2014-09-09 11:57:36,512::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:36,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:37,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900377 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:37,086::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:37,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:37,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:37,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:37,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:37,087::__init__::225::IOProcess::(_processLogs) (9492) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:37,087::__init__::225::IOProcess::(_processLogs) (9492) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:37,088::__init__::225::IOProcess::(_processLogs) (9492) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:37,088::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:57:37,089::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:57:37,096::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000908159 s, 603 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:37,096::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:37,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:37,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:37,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:37,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:37,097::__init__::225::IOProcess::(_processLogs) (9493) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:37,097::__init__::225::IOProcess::(_processLogs) (9493) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:37,097::__init__::225::IOProcess::(_processLogs) (9493) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:37,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:37,098::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:57:37,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:37,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) (9494) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) (9494) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) (9494) Building response >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) (9494) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:57:37,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) (9495) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) (9495) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) (9495) Building response >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) (9495) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:37,100::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:37,101::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:57:37,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:37,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:37,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:37,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:37,102::__init__::225::IOProcess::(_processLogs) (9496) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:37,102::__init__::225::IOProcess::(_processLogs) (9496) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:37,102::__init__::225::IOProcess::(_processLogs) (9496) Building response >Thread-19::DEBUG::2014-09-09 11:57:37,102::__init__::225::IOProcess::(_processLogs) (9496) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:37,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:37,102::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:57:39,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:39,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898587 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:39,523::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:39,523::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4360::DEBUG::2014-09-09 11:57:39,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ae48190-7bfb-4f39-8373-5896cc424b87`::moving from state init -> state preparing >Thread-4360::INFO::2014-09-09 11:57:39,525::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4360::INFO::2014-09-09 11:57:39,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108548', 'lastCheck': '9.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000908159', 'lastCheck': '2.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000861569', 'lastCheck': '4.5', 'valid': True}} >Thread-4360::DEBUG::2014-09-09 11:57:39,525::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ae48190-7bfb-4f39-8373-5896cc424b87`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108548', 'lastCheck': '9.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000908159', 'lastCheck': '2.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000861569', 'lastCheck': '4.5', 'valid': True}} >Thread-4360::DEBUG::2014-09-09 11:57:39,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ae48190-7bfb-4f39-8373-5896cc424b87`::moving from state preparing -> state finished >Thread-4360::DEBUG::2014-09-09 11:57:39,525::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4360::DEBUG::2014-09-09 11:57:39,525::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4360::DEBUG::2014-09-09 11:57:39,526::task::993::Storage.TaskManager.Task::(_decref) Task=`1ae48190-7bfb-4f39-8373-5896cc424b87`::ref 0 aborting False >Thread-4360::DEBUG::2014-09-09 11:57:39,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:39,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:39,542::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4361::DEBUG::2014-09-09 11:57:39,543::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:57:40,422::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:40,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:40,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:40,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:40,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:40,423::__init__::225::IOProcess::(_processLogs) (9497) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:40,423::__init__::225::IOProcess::(_processLogs) (9497) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:40,425::__init__::225::IOProcess::(_processLogs) (9497) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:40,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:57:40,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:57:40,432::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00120611 s, 931 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:40,433::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:40,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:40,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:40,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:40,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:40,434::__init__::225::IOProcess::(_processLogs) (9498) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:40,434::__init__::225::IOProcess::(_processLogs) (9498) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:40,434::__init__::225::IOProcess::(_processLogs) (9498) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:40,434::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:40,649::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:40,649::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4362::DEBUG::2014-09-09 11:57:40,649::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4362::DEBUG::2014-09-09 11:57:40,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e0f1e9a-052a-4f48-ba8c-51069ff9d6c4`::moving from state init -> state preparing >Thread-4362::INFO::2014-09-09 11:57:40,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4362::INFO::2014-09-09 11:57:40,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4362::DEBUG::2014-09-09 11:57:40,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e0f1e9a-052a-4f48-ba8c-51069ff9d6c4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4362::DEBUG::2014-09-09 11:57:40,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e0f1e9a-052a-4f48-ba8c-51069ff9d6c4`::moving from state preparing -> state finished >Thread-4362::DEBUG::2014-09-09 11:57:40,651::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4362::DEBUG::2014-09-09 11:57:40,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4362::DEBUG::2014-09-09 11:57:40,651::task::993::Storage.TaskManager.Task::(_decref) Task=`3e0f1e9a-052a-4f48-ba8c-51069ff9d6c4`::ref 0 aborting False >Thread-4362::DEBUG::2014-09-09 11:57:40,651::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4362::DEBUG::2014-09-09 11:57:40,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:40,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:40,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4363::DEBUG::2014-09-09 11:57:40,713::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4363::DEBUG::2014-09-09 11:57:40,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`d171b92e-7214-46f2-9ae4-cc8c7e233f31`::moving from state init -> state preparing >Thread-4363::INFO::2014-09-09 11:57:40,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4363::DEBUG::2014-09-09 11:57:40,714::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fbe425c5-8f9d-435e-b72d-7cd2750ee9b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4363::DEBUG::2014-09-09 11:57:40,714::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4363::DEBUG::2014-09-09 11:57:40,714::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4363::DEBUG::2014-09-09 11:57:40,714::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fbe425c5-8f9d-435e-b72d-7cd2750ee9b8`::Granted request >Thread-4363::DEBUG::2014-09-09 11:57:40,714::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d171b92e-7214-46f2-9ae4-cc8c7e233f31`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4363::DEBUG::2014-09-09 11:57:40,714::task::993::Storage.TaskManager.Task::(_decref) Task=`d171b92e-7214-46f2-9ae4-cc8c7e233f31`::ref 1 aborting False >Thread-4363::INFO::2014-09-09 11:57:40,716::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4363::DEBUG::2014-09-09 11:57:40,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`d171b92e-7214-46f2-9ae4-cc8c7e233f31`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4363::DEBUG::2014-09-09 11:57:40,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`d171b92e-7214-46f2-9ae4-cc8c7e233f31`::moving from state preparing -> state finished >Thread-4363::DEBUG::2014-09-09 11:57:40,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4363::DEBUG::2014-09-09 11:57:40,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4363::DEBUG::2014-09-09 11:57:40,716::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4363::DEBUG::2014-09-09 11:57:40,716::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4363::DEBUG::2014-09-09 11:57:40,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4363::DEBUG::2014-09-09 11:57:40,717::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4363::DEBUG::2014-09-09 11:57:40,717::task::993::Storage.TaskManager.Task::(_decref) Task=`d171b92e-7214-46f2-9ae4-cc8c7e233f31`::ref 0 aborting False >Thread-4363::DEBUG::2014-09-09 11:57:40,717::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4363::DEBUG::2014-09-09 11:57:40,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:41,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:41,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898801 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:42,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:42,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4364::DEBUG::2014-09-09 11:57:42,626::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:43,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:43,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901927 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) (9499) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:45,050::__init__::225::IOProcess::(_processLogs) (9499) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:45,051::__init__::225::IOProcess::(_processLogs) (9499) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:45,051::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:57:45,052::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:57:45,058::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000944612 s, 376 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) (9500) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:45,059::__init__::225::IOProcess::(_processLogs) (9500) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:45,060::__init__::225::IOProcess::(_processLogs) (9500) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:45,060::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 11:57:45,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:45,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904688 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:45,641::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:45,641::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4365::DEBUG::2014-09-09 11:57:45,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) (9501) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:47,102::__init__::225::IOProcess::(_processLogs) (9501) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:47,103::__init__::225::IOProcess::(_processLogs) (9501) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:47,103::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:57:47,104::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:57:47,112::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00103472 s, 530 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:47,112::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:47,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:47,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:47,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:47,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:47,113::__init__::225::IOProcess::(_processLogs) (9502) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:47,113::__init__::225::IOProcess::(_processLogs) (9502) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:47,114::__init__::225::IOProcess::(_processLogs) (9502) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:47,114::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) (9503) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:47,115::__init__::225::IOProcess::(_processLogs) (9503) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:47,116::__init__::225::IOProcess::(_processLogs) (9503) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:47,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:47,116::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:47,117::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:47,117::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:57:47,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:47,117::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) (9504) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) (9504) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9504) Building response >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) (9504) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:47,118::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:47,119::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:47,119::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:47,119::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:57:47,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:47,119::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) (9505) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) (9505) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) (9505) Building response >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) (9505) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:47,120::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:57:47,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:47,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090022 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:48,649::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:48,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4366::DEBUG::2014-09-09 11:57:48,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:49,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:49,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0948877 s, 10.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:50,436::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:50,436::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:50,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:50,436::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:50,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:50,436::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:50,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:50,437::__init__::225::IOProcess::(_processLogs) (9506) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:50,437::__init__::225::IOProcess::(_processLogs) (9506) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:50,437::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9506) Building response >Thread-19::DEBUG::2014-09-09 11:57:50,437::__init__::225::IOProcess::(_processLogs) (9506) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:50,437::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:57:50,438::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:57:50,438::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:57:50,445::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108652 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:50,445::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:50,445::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:57:50,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) (9507) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) (9507) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9507) Building response >Thread-19::DEBUG::2014-09-09 11:57:50,446::__init__::225::IOProcess::(_processLogs) (9507) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:50,447::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:50,447::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:50,776::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4367::DEBUG::2014-09-09 11:57:50,777::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:57:50,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4367::DEBUG::2014-09-09 11:57:50,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`f980f3f8-6665-4260-aaf3-f6b4a4947d39`::moving from state init -> state preparing >Thread-4367::INFO::2014-09-09 11:57:50,778::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4367::INFO::2014-09-09 11:57:50,778::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4367::DEBUG::2014-09-09 11:57:50,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`f980f3f8-6665-4260-aaf3-f6b4a4947d39`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4367::DEBUG::2014-09-09 11:57:50,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`f980f3f8-6665-4260-aaf3-f6b4a4947d39`::moving from state preparing -> state finished >Thread-4367::DEBUG::2014-09-09 11:57:50,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4367::DEBUG::2014-09-09 11:57:50,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4367::DEBUG::2014-09-09 11:57:50,779::task::993::Storage.TaskManager.Task::(_decref) Task=`f980f3f8-6665-4260-aaf3-f6b4a4947d39`::ref 0 aborting False >Thread-4367::DEBUG::2014-09-09 11:57:50,779::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4367::DEBUG::2014-09-09 11:57:50,779::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:50,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:50,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4368::DEBUG::2014-09-09 11:57:50,817::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4368::DEBUG::2014-09-09 11:57:50,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd9b1117-d875-4977-82ce-a6cd892e757b`::moving from state init -> state preparing >Thread-4368::INFO::2014-09-09 11:57:50,817::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4368::DEBUG::2014-09-09 11:57:50,818::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a6b76ec5-35bf-43a8-ac7f-50bd3b3c05ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4368::DEBUG::2014-09-09 11:57:50,818::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4368::DEBUG::2014-09-09 11:57:50,818::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4368::DEBUG::2014-09-09 11:57:50,818::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a6b76ec5-35bf-43a8-ac7f-50bd3b3c05ce`::Granted request >Thread-4368::DEBUG::2014-09-09 11:57:50,818::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bd9b1117-d875-4977-82ce-a6cd892e757b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4368::DEBUG::2014-09-09 11:57:50,818::task::993::Storage.TaskManager.Task::(_decref) Task=`bd9b1117-d875-4977-82ce-a6cd892e757b`::ref 1 aborting False >Thread-4368::INFO::2014-09-09 11:57:50,820::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4368::DEBUG::2014-09-09 11:57:50,820::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd9b1117-d875-4977-82ce-a6cd892e757b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4368::DEBUG::2014-09-09 11:57:50,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd9b1117-d875-4977-82ce-a6cd892e757b`::moving from state preparing -> state finished >Thread-4368::DEBUG::2014-09-09 11:57:50,820::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4368::DEBUG::2014-09-09 11:57:50,820::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4368::DEBUG::2014-09-09 11:57:50,820::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4368::DEBUG::2014-09-09 11:57:50,821::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4368::DEBUG::2014-09-09 11:57:50,821::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4368::DEBUG::2014-09-09 11:57:50,821::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4368::DEBUG::2014-09-09 11:57:50,821::task::993::Storage.TaskManager.Task::(_decref) Task=`bd9b1117-d875-4977-82ce-a6cd892e757b`::ref 0 aborting False >Thread-4368::DEBUG::2014-09-09 11:57:50,821::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283245543424', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4368::DEBUG::2014-09-09 11:57:50,821::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:51,665::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:51,665::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4369::DEBUG::2014-09-09 11:57:51,666::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:51,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:51,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903673 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:57:53,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:53,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900941 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:54,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:54,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4370::DEBUG::2014-09-09 11:57:54,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`f97f6a20-5276-4359-9873-1185b87ea996`::moving from state init -> state preparing >Thread-4370::INFO::2014-09-09 11:57:54,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4370::INFO::2014-09-09 11:57:54,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108652', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103472', 'lastCheck': '7.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000944612', 'lastCheck': '9.6', 'valid': True}} >Thread-4370::DEBUG::2014-09-09 11:57:54,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`f97f6a20-5276-4359-9873-1185b87ea996`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108652', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103472', 'lastCheck': '7.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000944612', 'lastCheck': '9.6', 'valid': True}} >Thread-4370::DEBUG::2014-09-09 11:57:54,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`f97f6a20-5276-4359-9873-1185b87ea996`::moving from state preparing -> state finished >Thread-4370::DEBUG::2014-09-09 11:57:54,683::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4370::DEBUG::2014-09-09 11:57:54,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4370::DEBUG::2014-09-09 11:57:54,683::task::993::Storage.TaskManager.Task::(_decref) Task=`f97f6a20-5276-4359-9873-1185b87ea996`::ref 0 aborting False >Thread-4370::DEBUG::2014-09-09 11:57:54,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:54,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:54,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4371::DEBUG::2014-09-09 11:57:54,700::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:57:55,060::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) (9508) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:55,061::__init__::225::IOProcess::(_processLogs) (9508) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:55,062::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9508) Building response >Thread-19::DEBUG::2014-09-09 11:57:55,062::__init__::225::IOProcess::(_processLogs) (9508) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:55,062::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:57:55,063::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:57:55,063::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:57:55,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000880123 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:55,070::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:55,070::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:57:55,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:55,070::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:55,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) (9509) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) (9509) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9509) Building response >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) (9509) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:55,071::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:55,072::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:57:55,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:56,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900315 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:57,120::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:57,120::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:57,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:57,120::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) (9510) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) (9510) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9510) Building response >Thread-19::DEBUG::2014-09-09 11:57:57,121::__init__::225::IOProcess::(_processLogs) (9510) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:57,122::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:57,122::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:57:57,122::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:57:57,130::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101267 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) (9511) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:57:57,131::__init__::225::IOProcess::(_processLogs) (9511) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:57:57,132::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9511) Building response >Thread-19::DEBUG::2014-09-09 11:57:57,132::__init__::225::IOProcess::(_processLogs) (9511) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:57,132::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:57:57,132::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:57:57,132::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) (9512) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:57,133::__init__::225::IOProcess::(_processLogs) (9512) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) (9512) Building response >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) (9512) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:57,134::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) (9513) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) (9513) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) (9513) Building response >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) (9513) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:57:57,135::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) (9514) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:57:57,136::__init__::225::IOProcess::(_processLogs) (9514) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:57:57,137::__init__::225::IOProcess::(_processLogs) (9514) Building response >Thread-19::DEBUG::2014-09-09 11:57:57,137::__init__::225::IOProcess::(_processLogs) (9514) Queuing response >Thread-19::DEBUG::2014-09-09 11:57:57,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:57:57,137::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:57:57,771::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:57:57,772::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4372::DEBUG::2014-09-09 11:57:57,773::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:57:58,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:57:58,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900145 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:58:00,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:00,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898444 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) (9515) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:00,448::__init__::225::IOProcess::(_processLogs) (9515) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:00,449::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9515) Building response >Thread-19::DEBUG::2014-09-09 11:58:00,449::__init__::225::IOProcess::(_processLogs) (9515) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:00,449::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:58:00,450::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:00,450::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:58:00,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109587 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:00,458::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:00,458::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:00,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:00,458::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:00,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:00,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:00,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:00,459::__init__::225::IOProcess::(_processLogs) (9516) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:00,459::__init__::225::IOProcess::(_processLogs) (9516) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:00,459::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9516) Building response >Thread-19::DEBUG::2014-09-09 11:58:00,459::__init__::225::IOProcess::(_processLogs) (9516) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:00,459::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:00,460::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:00,786::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:00,787::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4373::DEBUG::2014-09-09 11:58:00,788::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:00,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:00,870::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4374::DEBUG::2014-09-09 11:58:00,871::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4374::DEBUG::2014-09-09 11:58:00,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcf8e749-0746-4f07-9317-ec3a1a1294f0`::moving from state init -> state preparing >Thread-4374::INFO::2014-09-09 11:58:00,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4374::INFO::2014-09-09 11:58:00,872::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4374::DEBUG::2014-09-09 11:58:00,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcf8e749-0746-4f07-9317-ec3a1a1294f0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4374::DEBUG::2014-09-09 11:58:00,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcf8e749-0746-4f07-9317-ec3a1a1294f0`::moving from state preparing -> state finished >Thread-4374::DEBUG::2014-09-09 11:58:00,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4374::DEBUG::2014-09-09 11:58:00,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4374::DEBUG::2014-09-09 11:58:00,872::task::993::Storage.TaskManager.Task::(_decref) Task=`fcf8e749-0746-4f07-9317-ec3a1a1294f0`::ref 0 aborting False >Thread-4374::DEBUG::2014-09-09 11:58:00,872::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4374::DEBUG::2014-09-09 11:58:00,872::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:00,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:00,907::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4375::DEBUG::2014-09-09 11:58:00,907::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4375::DEBUG::2014-09-09 11:58:00,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`23ac9cd3-b7cd-4321-903f-86e58d733826`::moving from state init -> state preparing >Thread-4375::INFO::2014-09-09 11:58:00,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4375::DEBUG::2014-09-09 11:58:00,908::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c67e4434-c5ca-497f-ae30-1fdcf90e2d84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4375::DEBUG::2014-09-09 11:58:00,908::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4375::DEBUG::2014-09-09 11:58:00,909::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4375::DEBUG::2014-09-09 11:58:00,909::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c67e4434-c5ca-497f-ae30-1fdcf90e2d84`::Granted request >Thread-4375::DEBUG::2014-09-09 11:58:00,909::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`23ac9cd3-b7cd-4321-903f-86e58d733826`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4375::DEBUG::2014-09-09 11:58:00,909::task::993::Storage.TaskManager.Task::(_decref) Task=`23ac9cd3-b7cd-4321-903f-86e58d733826`::ref 1 aborting False >Thread-4375::INFO::2014-09-09 11:58:00,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4375::DEBUG::2014-09-09 11:58:00,911::task::1191::Storage.TaskManager.Task::(prepare) Task=`23ac9cd3-b7cd-4321-903f-86e58d733826`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4375::DEBUG::2014-09-09 11:58:00,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`23ac9cd3-b7cd-4321-903f-86e58d733826`::moving from state preparing -> state finished >Thread-4375::DEBUG::2014-09-09 11:58:00,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4375::DEBUG::2014-09-09 11:58:00,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4375::DEBUG::2014-09-09 11:58:00,911::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4375::DEBUG::2014-09-09 11:58:00,911::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4375::DEBUG::2014-09-09 11:58:00,911::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4375::DEBUG::2014-09-09 11:58:00,911::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4375::DEBUG::2014-09-09 11:58:00,911::task::993::Storage.TaskManager.Task::(_decref) Task=`23ac9cd3-b7cd-4321-903f-86e58d733826`::ref 0 aborting False >Thread-4375::DEBUG::2014-09-09 11:58:00,911::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4375::DEBUG::2014-09-09 11:58:00,912::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:02,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:02,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905369 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:03,801::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:03,802::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4376::DEBUG::2014-09-09 11:58:03,803::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:04,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:04,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089784 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:05,072::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) (9517) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:05,073::__init__::225::IOProcess::(_processLogs) (9517) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:05,074::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9517) Building response >Thread-19::DEBUG::2014-09-09 11:58:05,074::__init__::225::IOProcess::(_processLogs) (9517) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:05,074::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:05,075::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:58:05,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:58:05,082::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910005 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:05,083::__init__::225::IOProcess::(_processLogs) (9518) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:05,084::__init__::225::IOProcess::(_processLogs) (9518) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:05,084::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|(9518) Building response >Thread-19::DEBUG::2014-09-09 11:58:05,084::__init__::225::IOProcess::(_processLogs) (9518) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:05,084::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:05,085::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:58:06,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:06,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906398 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:06,810::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:06,810::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4377::DEBUG::2014-09-09 11:58:06,811::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) (9503) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) (9519) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:07,137::__init__::225::IOProcess::(_processLogs) (9519) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:07,138::__init__::225::IOProcess::(_processLogs) (9519) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:07,138::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:58:07,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:58:07,145::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000990933 s, 553 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:07,146::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:07,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:07,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:07,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:07,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:07,146::__init__::225::IOProcess::(_processLogs) (9520) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:07,147::__init__::225::IOProcess::(_processLogs) (9520) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:07,147::__init__::225::IOProcess::(_processLogs) (9520) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:07,147::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:58:07,148::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:58:07,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:07,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:07,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) (9521) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) (9521) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) (9521) Building response >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) (9521) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:07,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) (9522) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) (9522) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) (9522) Building response >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) (9522) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:07,150::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:58:07,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:07,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:07,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:07,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:07,151::__init__::225::IOProcess::(_processLogs) (9523) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:07,151::__init__::225::IOProcess::(_processLogs) (9523) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:07,152::__init__::225::IOProcess::(_processLogs) (9523) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:07,152::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:58:08,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:08,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898425 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:09,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:09,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4378::DEBUG::2014-09-09 11:58:09,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0872bc3-8e14-4496-b5d7-3bcd1713f5fa`::moving from state init -> state preparing >Thread-4378::INFO::2014-09-09 11:58:09,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4378::INFO::2014-09-09 11:58:09,828::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109587', 'lastCheck': '9.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000990933', 'lastCheck': '2.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910005', 'lastCheck': '4.7', 'valid': True}} >Thread-4378::DEBUG::2014-09-09 11:58:09,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0872bc3-8e14-4496-b5d7-3bcd1713f5fa`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109587', 'lastCheck': '9.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000990933', 'lastCheck': '2.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910005', 'lastCheck': '4.7', 'valid': True}} >Thread-4378::DEBUG::2014-09-09 11:58:09,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0872bc3-8e14-4496-b5d7-3bcd1713f5fa`::moving from state preparing -> state finished >Thread-4378::DEBUG::2014-09-09 11:58:09,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4378::DEBUG::2014-09-09 11:58:09,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4378::DEBUG::2014-09-09 11:58:09,828::task::993::Storage.TaskManager.Task::(_decref) Task=`c0872bc3-8e14-4496-b5d7-3bcd1713f5fa`::ref 0 aborting False >Thread-4378::DEBUG::2014-09-09 11:58:09,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:09,844::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:09,845::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4379::DEBUG::2014-09-09 11:58:09,845::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-23::DEBUG::2014-09-09 11:58:10,460::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:58:10,462::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:58:10,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,462::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) (9524) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) (9524) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) (9524) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) (9525) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) (9525) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,464::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) (9526) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) (9526) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:10,465::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9525) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,466::__init__::225::IOProcess::(_processLogs) (9525) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:10,466::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:58:10,466::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9526) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,467::__init__::225::IOProcess::(_processLogs) (9526) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:10,468::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 11:58:10,470::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 11:58:10,470::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,470::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 11:58:10,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,470::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,471::__init__::225::IOProcess::(_processLogs) (9527) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:58:10,471::__init__::225::IOProcess::(_processLogs) (9527) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:58:10,504::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9527) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,504::__init__::225::IOProcess::(_processLogs) (9527) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,504::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:58:10,504::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:58:10,505::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:10,505::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,505::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) (9528) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:58:10,506::__init__::225::IOProcess::(_processLogs) (9528) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:58:10,509::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9528) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,509::__init__::225::IOProcess::(_processLogs) (9528) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,509::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:58:10,509::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 11:58:10,510::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 11:58:10,510::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,510::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) (9529) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) (9529) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) (9529) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,511::__init__::225::IOProcess::(_processLogs) (9529) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) (9530) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:10,512::__init__::225::IOProcess::(_processLogs) (9530) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:10,513::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9530) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,513::__init__::225::IOProcess::(_processLogs) (9530) Queuing response >Thread-23::DEBUG::2014-09-09 11:58:10,514::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:58:10,514::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-23::INFO::2014-09-09 11:58:10,514::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:58:10,514::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-23::INFO::2014-09-09 11:58:10,515::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:58:10,515::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,515::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:10,515::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,515::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,516::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,516::__init__::225::IOProcess::(_processLogs) (9531) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:10,516::__init__::225::IOProcess::(_processLogs) (9531) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:10,516::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9531) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,516::__init__::225::IOProcess::(_processLogs) (9531) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,516::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:58:10,517::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:10,517::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:58:10,524::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114799 s, 978 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) (9532) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:10,525::__init__::225::IOProcess::(_processLogs) (9532) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:10,526::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9532) Building response >Thread-19::DEBUG::2014-09-09 11:58:10,526::__init__::225::IOProcess::(_processLogs) (9532) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:10,526::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:10,527::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:58:10,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:10,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899787 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:10,952::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4383::DEBUG::2014-09-09 11:58:10,952::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:58:10,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4383::DEBUG::2014-09-09 11:58:10,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`74aa9bb6-c4be-42f2-aed9-86420db545e8`::moving from state init -> state preparing >Thread-4383::INFO::2014-09-09 11:58:10,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4383::INFO::2014-09-09 11:58:10,954::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4383::DEBUG::2014-09-09 11:58:10,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`74aa9bb6-c4be-42f2-aed9-86420db545e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4383::DEBUG::2014-09-09 11:58:10,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`74aa9bb6-c4be-42f2-aed9-86420db545e8`::moving from state preparing -> state finished >Thread-4383::DEBUG::2014-09-09 11:58:10,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4383::DEBUG::2014-09-09 11:58:10,954::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4383::DEBUG::2014-09-09 11:58:10,954::task::993::Storage.TaskManager.Task::(_decref) Task=`74aa9bb6-c4be-42f2-aed9-86420db545e8`::ref 0 aborting False >Thread-4383::DEBUG::2014-09-09 11:58:10,954::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4383::DEBUG::2014-09-09 11:58:10,954::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:10,993::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:10,994::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4384::DEBUG::2014-09-09 11:58:10,994::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4384::DEBUG::2014-09-09 11:58:10,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`987fcb01-fbe1-47ec-a4cd-7172b84a7184`::moving from state init -> state preparing >Thread-4384::INFO::2014-09-09 11:58:10,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4384::DEBUG::2014-09-09 11:58:10,995::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b9fa14a9-f597-4b72-86b6-c593ece5a61c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4384::DEBUG::2014-09-09 11:58:10,995::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4384::DEBUG::2014-09-09 11:58:10,995::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4384::DEBUG::2014-09-09 11:58:10,996::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b9fa14a9-f597-4b72-86b6-c593ece5a61c`::Granted request >Thread-4384::DEBUG::2014-09-09 11:58:10,996::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`987fcb01-fbe1-47ec-a4cd-7172b84a7184`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4384::DEBUG::2014-09-09 11:58:10,996::task::993::Storage.TaskManager.Task::(_decref) Task=`987fcb01-fbe1-47ec-a4cd-7172b84a7184`::ref 1 aborting False >Thread-4384::INFO::2014-09-09 11:58:10,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4384::DEBUG::2014-09-09 11:58:10,998::task::1191::Storage.TaskManager.Task::(prepare) Task=`987fcb01-fbe1-47ec-a4cd-7172b84a7184`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4384::DEBUG::2014-09-09 11:58:10,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`987fcb01-fbe1-47ec-a4cd-7172b84a7184`::moving from state preparing -> state finished >Thread-4384::DEBUG::2014-09-09 11:58:10,998::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4384::DEBUG::2014-09-09 11:58:10,998::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4384::DEBUG::2014-09-09 11:58:10,998::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4384::DEBUG::2014-09-09 11:58:10,998::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4384::DEBUG::2014-09-09 11:58:10,998::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4384::DEBUG::2014-09-09 11:58:10,998::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4384::DEBUG::2014-09-09 11:58:10,998::task::993::Storage.TaskManager.Task::(_decref) Task=`987fcb01-fbe1-47ec-a4cd-7172b84a7184`::ref 0 aborting False >Thread-4384::DEBUG::2014-09-09 11:58:10,998::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4384::DEBUG::2014-09-09 11:58:10,999::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:12,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:12,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900518 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:12,929::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:12,929::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4385::DEBUG::2014-09-09 11:58:12,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:14,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:14,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904693 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:15,085::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:15,085::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:15,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:15,086::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:15,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:15,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:15,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:15,086::__init__::225::IOProcess::(_processLogs) (9533) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:15,086::__init__::225::IOProcess::(_processLogs) (9533) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:15,087::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9533) Building response >Thread-19::DEBUG::2014-09-09 11:58:15,087::__init__::225::IOProcess::(_processLogs) (9533) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:15,087::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:58:15,088::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:15,088::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:58:15,095::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00096511 s, 368 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) (9534) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:15,096::__init__::225::IOProcess::(_processLogs) (9534) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:15,097::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9534) Building response >Thread-19::DEBUG::2014-09-09 11:58:15,097::__init__::225::IOProcess::(_processLogs) (9534) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:15,097::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:15,098::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:15,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:15,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4386::DEBUG::2014-09-09 11:58:15,947::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:16,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:17,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897077 s, 11.4 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 11:58:17,152::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:58:17,154::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) (9535) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:17,155::__init__::225::IOProcess::(_processLogs) (9535) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:17,156::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9535) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,156::__init__::225::IOProcess::(_processLogs) (9535) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,156::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:58:17,156::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,156::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) (9536) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) (9536) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) (9537) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) (9537) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9537) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) (9537) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,159::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:58:17,159::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9536) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,160::__init__::225::IOProcess::(_processLogs) (9536) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,161::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-24::DEBUG::2014-09-09 11:58:17,162::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) (9538) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:58:17,163::__init__::225::IOProcess::(_processLogs) (9538) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:58:17,214::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9538) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,215::__init__::225::IOProcess::(_processLogs) (9538) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,215::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:58:17,215::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:58:17,215::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) (9539) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:58:17,216::__init__::225::IOProcess::(_processLogs) (9539) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:58:17,220::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9539) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,220::__init__::225::IOProcess::(_processLogs) (9539) Queuing response >Thread-24::DEBUG::2014-09-09 11:58:17,220::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 11:58:17,220::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,221::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) (9540) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) (9540) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:17,222::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9540) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) (9540) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,224::__init__::225::IOProcess::(_processLogs) (9541) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:17,224::__init__::225::IOProcess::(_processLogs) (9541) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:17,225::__init__::225::IOProcess::(_processLogs) Receiving request...DEBUG|(9541) Building response >Thread-24::DEBUG::2014-09-09 11:58:17,225::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:58:17,225::__init__::225::IOProcess::(_processLogs) (9541) Queuing response >Thread-24::INFO::2014-09-09 11:58:17,225::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 11:58:17,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::INFO::2014-09-09 11:58:17,226::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:58:17,226::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) (9542) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:17,227::__init__::225::IOProcess::(_processLogs) (9542) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:17,228::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|(9542) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,228::__init__::225::IOProcess::(_processLogs) (9542) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,228::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:58:17,229::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:17,229::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:58:17,236::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000983134 s, 557 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,238::__init__::225::IOProcess::(_processLogs) (9543) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:17,238::__init__::225::IOProcess::(_processLogs) (9543) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:17,238::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|(9543) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,238::__init__::225::IOProcess::(_processLogs) (9543) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,238::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) (9541) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) (9544) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) (9544) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) (9544) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) (9544) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) (9545) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) (9545) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) (9545) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) (9545) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,241::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:17,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:17,243::__init__::225::IOProcess::(_processLogs) (9546) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:17,243::__init__::225::IOProcess::(_processLogs) (9546) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:17,243::__init__::225::IOProcess::(_processLogs) (9546) Building response >Thread-19::DEBUG::2014-09-09 11:58:17,243::__init__::225::IOProcess::(_processLogs) (9546) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:17,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:17,243::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:18,963::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:18,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4390::DEBUG::2014-09-09 11:58:18,965::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:19,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:19,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901043 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:20,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:20,527::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) (9547) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) (9547) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:20,528::__init__::225::IOProcess::(_processLogs) DEBUG|(9547) Building response >Thread-19::DEBUG::2014-09-09 11:58:20,529::__init__::225::IOProcess::(_processLogs) (9547) Queuing response >Thread-23::DEBUG::2014-09-09 11:58:20,529::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:20,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:20,534::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:58:20,537::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00119931 s, 936 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:20,537::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:20,537::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:20,537::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:20,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:20,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:20,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:20,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:20,538::__init__::225::IOProcess::(_processLogs) (9548) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:20,538::__init__::225::IOProcess::(_processLogs) (9548) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:20,538::__init__::225::IOProcess::(_processLogs) DEBUG|(9548) Building response >Thread-19::DEBUG::2014-09-09 11:58:20,538::__init__::225::IOProcess::(_processLogs) (9548) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:20,538::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:20,539::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:21,040::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4391::DEBUG::2014-09-09 11:58:21,041::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:58:21,041::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4391::DEBUG::2014-09-09 11:58:21,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`a33ff9d8-5a17-45e0-92a6-d456474759ed`::moving from state init -> state preparing >Thread-4391::INFO::2014-09-09 11:58:21,042::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4391::INFO::2014-09-09 11:58:21,042::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4391::DEBUG::2014-09-09 11:58:21,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`a33ff9d8-5a17-45e0-92a6-d456474759ed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4391::DEBUG::2014-09-09 11:58:21,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`a33ff9d8-5a17-45e0-92a6-d456474759ed`::moving from state preparing -> state finished >Thread-4391::DEBUG::2014-09-09 11:58:21,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4391::DEBUG::2014-09-09 11:58:21,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4391::DEBUG::2014-09-09 11:58:21,043::task::993::Storage.TaskManager.Task::(_decref) Task=`a33ff9d8-5a17-45e0-92a6-d456474759ed`::ref 0 aborting False >Thread-4391::DEBUG::2014-09-09 11:58:21,043::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4391::DEBUG::2014-09-09 11:58:21,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:21,076::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:21,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4392::DEBUG::2014-09-09 11:58:21,077::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4392::DEBUG::2014-09-09 11:58:21,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`5489e6e9-8e2b-49cf-a389-5c58ecef94e3`::moving from state init -> state preparing >Thread-4392::INFO::2014-09-09 11:58:21,078::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4392::DEBUG::2014-09-09 11:58:21,078::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6be4a002-cf01-4981-9c9f-c3c551abd674`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4392::DEBUG::2014-09-09 11:58:21,078::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4392::DEBUG::2014-09-09 11:58:21,078::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4392::DEBUG::2014-09-09 11:58:21,078::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6be4a002-cf01-4981-9c9f-c3c551abd674`::Granted request >Thread-4392::DEBUG::2014-09-09 11:58:21,079::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5489e6e9-8e2b-49cf-a389-5c58ecef94e3`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4392::DEBUG::2014-09-09 11:58:21,079::task::993::Storage.TaskManager.Task::(_decref) Task=`5489e6e9-8e2b-49cf-a389-5c58ecef94e3`::ref 1 aborting False >Thread-4392::INFO::2014-09-09 11:58:21,080::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4392::DEBUG::2014-09-09 11:58:21,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`5489e6e9-8e2b-49cf-a389-5c58ecef94e3`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4392::DEBUG::2014-09-09 11:58:21,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`5489e6e9-8e2b-49cf-a389-5c58ecef94e3`::moving from state preparing -> state finished >Thread-4392::DEBUG::2014-09-09 11:58:21,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4392::DEBUG::2014-09-09 11:58:21,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4392::DEBUG::2014-09-09 11:58:21,081::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4392::DEBUG::2014-09-09 11:58:21,081::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4392::DEBUG::2014-09-09 11:58:21,081::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4392::DEBUG::2014-09-09 11:58:21,081::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4392::DEBUG::2014-09-09 11:58:21,081::task::993::Storage.TaskManager.Task::(_decref) Task=`5489e6e9-8e2b-49cf-a389-5c58ecef94e3`::ref 0 aborting False >Thread-4392::DEBUG::2014-09-09 11:58:21,081::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4392::DEBUG::2014-09-09 11:58:21,081::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:21,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:21,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896552 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:21,979::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:21,979::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4393::DEBUG::2014-09-09 11:58:21,980::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:23,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:23,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902467 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:24,988::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:24,989::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4394::DEBUG::2014-09-09 11:58:24,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`61ea3974-de4a-4557-98fa-7342899e0191`::moving from state init -> state preparing >Thread-4394::INFO::2014-09-09 11:58:24,990::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4394::INFO::2014-09-09 11:58:24,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119931', 'lastCheck': '4.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000983134', 'lastCheck': '7.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096511', 'lastCheck': '9.9', 'valid': True}} >Thread-4394::DEBUG::2014-09-09 11:58:24,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`61ea3974-de4a-4557-98fa-7342899e0191`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00119931', 'lastCheck': '4.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000983134', 'lastCheck': '7.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096511', 'lastCheck': '9.9', 'valid': True}} >Thread-4394::DEBUG::2014-09-09 11:58:24,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`61ea3974-de4a-4557-98fa-7342899e0191`::moving from state preparing -> state finished >Thread-4394::DEBUG::2014-09-09 11:58:24,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4394::DEBUG::2014-09-09 11:58:24,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4394::DEBUG::2014-09-09 11:58:24,990::task::993::Storage.TaskManager.Task::(_decref) Task=`61ea3974-de4a-4557-98fa-7342899e0191`::ref 0 aborting False >Thread-4394::DEBUG::2014-09-09 11:58:24,991::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:25,004::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:25,005::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4395::DEBUG::2014-09-09 11:58:25,005::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-3443::DEBUG::2014-09-09 11:58:25,098::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:58:25,100::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,100::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 11:58:25,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,101::__init__::225::IOProcess::(_processLogs) (9549) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:25,101::__init__::225::IOProcess::(_processLogs) (9549) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:25,101::__init__::225::IOProcess::(_processLogs) DEBUG|(9549) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,101::__init__::225::IOProcess::(_processLogs) (9549) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:25,103::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 11:58:25,104::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,105::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 11:58:25,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-3443::DEBUG::2014-09-09 11:58:25,107::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 11:58:25,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,108::__init__::225::IOProcess::(_processLogs) (9550) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:25,108::__init__::225::IOProcess::(_processLogs) (9550) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:25,108::__init__::225::IOProcess::(_processLogs) DEBUG|(9550) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) (9550) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,110::__init__::225::IOProcess::(_processLogs) (9551) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:25,110::__init__::225::IOProcess::(_processLogs) (9551) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:25,110::__init__::225::IOProcess::(_processLogs) DEBUG|(9551) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,110::__init__::225::IOProcess::(_processLogs) (9551) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:25,110::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) (9552) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 11:58:25,111::__init__::225::IOProcess::(_processLogs) (9552) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 11:58:25,143::__init__::225::IOProcess::(_processLogs) DEBUG|(9552) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,143::__init__::225::IOProcess::(_processLogs) (9552) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:25,143::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-3443::DEBUG::2014-09-09 11:58:25,143::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,145::__init__::225::IOProcess::(_processLogs) (9553) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 11:58:25,145::__init__::225::IOProcess::(_processLogs) (9553) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 11:58:25,147::__init__::225::IOProcess::(_processLogs) DEBUG|(9553) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,147::__init__::225::IOProcess::(_processLogs) (9553) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,147::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:58:25,147::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 11:58:25,148::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) (9554) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) (9554) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) (9554) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) (9554) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,151::__init__::225::IOProcess::(_processLogs) (9555) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 11:58:25,151::__init__::225::IOProcess::(_processLogs) (9555) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 11:58:25,152::__init__::225::IOProcess::(_processLogs) DEBUG|(9555) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,152::__init__::225::IOProcess::(_processLogs) (9555) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,152::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:58:25,152::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 11:58:25,153::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::INFO::2014-09-09 11:58:25,153::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 11:58:25,153::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 11:58:25,153::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,153::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) (9556) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) (9556) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) DEBUG|(9556) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,154::__init__::225::IOProcess::(_processLogs) (9556) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,155::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 11:58:25,155::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:25,155::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:58:25,162::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00094412 s, 376 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) (9557) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:25,163::__init__::225::IOProcess::(_processLogs) (9557) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:25,164::__init__::225::IOProcess::(_processLogs) DEBUG|(9557) Building response >Thread-19::DEBUG::2014-09-09 11:58:25,164::__init__::225::IOProcess::(_processLogs) (9557) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:25,164::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:25,165::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:58:25,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:25,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899673 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) (9558) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:27,243::__init__::225::IOProcess::(_processLogs) (9558) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:27,244::__init__::225::IOProcess::(_processLogs) DEBUG|(9558) Building response >Thread-24::DEBUG::2014-09-09 11:58:27,244::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:27,244::__init__::225::IOProcess::(_processLogs) (9558) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:27,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:27,249::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:58:27,252::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000930517 s, 589 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:27,252::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:27,252::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:27,252::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:27,252::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:27,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:27,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:27,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:27,253::__init__::225::IOProcess::(_processLogs) (9559) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:27,253::__init__::225::IOProcess::(_processLogs) (9559) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:27,253::__init__::225::IOProcess::(_processLogs) DEBUG|(9559) Building response >Thread-19::DEBUG::2014-09-09 11:58:27,253::__init__::225::IOProcess::(_processLogs) (9559) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:27,253::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:27,254::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:58:27,254::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:27,254::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:58:27,254::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) (9560) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) (9560) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) (9560) Building response >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) (9560) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:27,255::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:27,256::__init__::225::IOProcess::(_processLogs) (9561) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) (9561) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) (9561) Building response >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) (9561) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:27,257::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) (9562) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) (9562) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) (9562) Building response >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) (9562) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:27,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:27,259::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:58:27,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:27,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897204 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:28,122::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:28,123::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4399::DEBUG::2014-09-09 11:58:28,124::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:29,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:29,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090034 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:30,539::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) (9563) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) (9563) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:30,540::__init__::225::IOProcess::(_processLogs) (9563) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:30,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 11:58:30,541::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:30,541::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:58:30,548::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106651 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) (9564) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:30,549::__init__::225::IOProcess::(_processLogs) (9564) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:30,550::__init__::225::IOProcess::(_processLogs) (9564) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:30,550::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:31,131::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4400::DEBUG::2014-09-09 11:58:31,132::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:58:31,132::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4400::DEBUG::2014-09-09 11:58:31,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`3267895c-4b06-4dd3-8a23-d7127e342472`::moving from state init -> state preparing >Thread-4400::INFO::2014-09-09 11:58:31,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4400::INFO::2014-09-09 11:58:31,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4400::DEBUG::2014-09-09 11:58:31,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`3267895c-4b06-4dd3-8a23-d7127e342472`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4400::DEBUG::2014-09-09 11:58:31,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`3267895c-4b06-4dd3-8a23-d7127e342472`::moving from state preparing -> state finished >Thread-4400::DEBUG::2014-09-09 11:58:31,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4400::DEBUG::2014-09-09 11:58:31,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4400::DEBUG::2014-09-09 11:58:31,134::task::993::Storage.TaskManager.Task::(_decref) Task=`3267895c-4b06-4dd3-8a23-d7127e342472`::ref 0 aborting False >Thread-4400::DEBUG::2014-09-09 11:58:31,134::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4400::DEBUG::2014-09-09 11:58:31,134::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:31,137::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:31,137::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4401::DEBUG::2014-09-09 11:58:31,138::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:31,168::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:31,169::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4402::DEBUG::2014-09-09 11:58:31,169::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4402::DEBUG::2014-09-09 11:58:31,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`29c237ef-6b64-42b5-a672-db37f120fd31`::moving from state init -> state preparing >Thread-4402::INFO::2014-09-09 11:58:31,170::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4402::DEBUG::2014-09-09 11:58:31,170::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`364413c8-5b0b-4a2b-8720-c6664164f182`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4402::DEBUG::2014-09-09 11:58:31,170::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4402::DEBUG::2014-09-09 11:58:31,170::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4402::DEBUG::2014-09-09 11:58:31,170::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`364413c8-5b0b-4a2b-8720-c6664164f182`::Granted request >Thread-4402::DEBUG::2014-09-09 11:58:31,170::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`29c237ef-6b64-42b5-a672-db37f120fd31`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4402::DEBUG::2014-09-09 11:58:31,170::task::993::Storage.TaskManager.Task::(_decref) Task=`29c237ef-6b64-42b5-a672-db37f120fd31`::ref 1 aborting False >Thread-4402::INFO::2014-09-09 11:58:31,172::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4402::DEBUG::2014-09-09 11:58:31,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`29c237ef-6b64-42b5-a672-db37f120fd31`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4402::DEBUG::2014-09-09 11:58:31,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`29c237ef-6b64-42b5-a672-db37f120fd31`::moving from state preparing -> state finished >Thread-4402::DEBUG::2014-09-09 11:58:31,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4402::DEBUG::2014-09-09 11:58:31,172::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4402::DEBUG::2014-09-09 11:58:31,173::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4402::DEBUG::2014-09-09 11:58:31,173::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4402::DEBUG::2014-09-09 11:58:31,173::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4402::DEBUG::2014-09-09 11:58:31,173::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4402::DEBUG::2014-09-09 11:58:31,173::task::993::Storage.TaskManager.Task::(_decref) Task=`29c237ef-6b64-42b5-a672-db37f120fd31`::ref 0 aborting False >Thread-4402::DEBUG::2014-09-09 11:58:31,173::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4402::DEBUG::2014-09-09 11:58:31,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:31,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:31,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904165 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:58:33,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:33,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904312 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:34,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:34,147::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4403::DEBUG::2014-09-09 11:58:34,148::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:58:35,165::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:35,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:35,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:35,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:35,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:35,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:35,166::__init__::225::IOProcess::(_processLogs) (9565) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:35,166::__init__::225::IOProcess::(_processLogs) (9565) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:35,167::__init__::225::IOProcess::(_processLogs) DEBUG|(9565) Building response >Thread-19::DEBUG::2014-09-09 11:58:35,167::__init__::225::IOProcess::(_processLogs) (9565) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:35,168::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:35,168::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:58:35,168::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:58:35,176::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00086463 s, 411 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) (9566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:35,177::__init__::225::IOProcess::(_processLogs) (9566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:35,178::__init__::225::IOProcess::(_processLogs) DEBUG|(9566) Building response >Thread-19::DEBUG::2014-09-09 11:58:35,178::__init__::225::IOProcess::(_processLogs) (9566) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:35,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:35,178::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:58:35,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:36,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905243 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:37,160::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:37,161::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4404::DEBUG::2014-09-09 11:58:37,162::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:58:37,258::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:37,258::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:37,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:37,258::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) (9567) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) (9567) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) DEBUG|(9567) Building response >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) (9567) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:37,259::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:58:37,260::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:37,260::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:58:37,268::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00099897 s, 549 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:37,268::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:37,268::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) (9568) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) (9568) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) DEBUG|(9568) Building response >Thread-19::DEBUG::2014-09-09 11:58:37,269::__init__::225::IOProcess::(_processLogs) (9568) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:37,270::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:37,270::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:58:37,270::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:37,270::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:58:37,270::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) (9569) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) (9569) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) (9569) Building response >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) (9569) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:37,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:37,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) (9570) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) (9570) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) (9570) Building response >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) (9570) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:37,273::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) (9571) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) (9571) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) (9571) Building response >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) (9571) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:37,274::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:58:38,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:38,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896068 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:58:40,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:40,182::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:40,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4405::DEBUG::2014-09-09 11:58:40,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`845802b0-7c22-418e-8a51-9c9dbafb613f`::moving from state init -> state preparing >Thread-4405::INFO::2014-09-09 11:58:40,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4405::INFO::2014-09-09 11:58:40,185::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106651', 'lastCheck': '9.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00099897', 'lastCheck': '2.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00086463', 'lastCheck': '5.0', 'valid': True}} >Thread-4405::DEBUG::2014-09-09 11:58:40,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`845802b0-7c22-418e-8a51-9c9dbafb613f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106651', 'lastCheck': '9.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00099897', 'lastCheck': '2.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00086463', 'lastCheck': '5.0', 'valid': True}} >Thread-4405::DEBUG::2014-09-09 11:58:40,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`845802b0-7c22-418e-8a51-9c9dbafb613f`::moving from state preparing -> state finished >Thread-4405::DEBUG::2014-09-09 11:58:40,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4405::DEBUG::2014-09-09 11:58:40,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4405::DEBUG::2014-09-09 11:58:40,185::task::993::Storage.TaskManager.Task::(_decref) Task=`845802b0-7c22-418e-8a51-9c9dbafb613f`::ref 0 aborting False >Thread-4405::DEBUG::2014-09-09 11:58:40,186::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:40,203::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:40,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4406::DEBUG::2014-09-09 11:58:40,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:40,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901211 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:40,551::__init__::225::IOProcess::(_processLogs) (9572) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:40,552::__init__::225::IOProcess::(_processLogs) (9572) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:40,553::__init__::225::IOProcess::(_processLogs) DEBUG|(9572) Building response >Thread-19::DEBUG::2014-09-09 11:58:40,553::__init__::225::IOProcess::(_processLogs) (9572) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:40,553::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:40,554::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:58:40,554::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:58:40,561::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00131543 s, 854 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:40,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:40,563::__init__::225::IOProcess::(_processLogs) (9573) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:40,563::__init__::225::IOProcess::(_processLogs) (9573) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:40,563::__init__::225::IOProcess::(_processLogs) DEBUG|(9573) Building response >Thread-19::DEBUG::2014-09-09 11:58:40,563::__init__::225::IOProcess::(_processLogs) (9573) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:40,563::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:40,564::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:41,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:41,214::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4407::DEBUG::2014-09-09 11:58:41,214::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4407::DEBUG::2014-09-09 11:58:41,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`14705114-3e0a-4da3-9258-06e236d59a39`::moving from state init -> state preparing >Thread-4407::INFO::2014-09-09 11:58:41,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4407::INFO::2014-09-09 11:58:41,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4407::DEBUG::2014-09-09 11:58:41,215::task::1191::Storage.TaskManager.Task::(prepare) Task=`14705114-3e0a-4da3-9258-06e236d59a39`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4407::DEBUG::2014-09-09 11:58:41,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`14705114-3e0a-4da3-9258-06e236d59a39`::moving from state preparing -> state finished >Thread-4407::DEBUG::2014-09-09 11:58:41,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4407::DEBUG::2014-09-09 11:58:41,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4407::DEBUG::2014-09-09 11:58:41,215::task::993::Storage.TaskManager.Task::(_decref) Task=`14705114-3e0a-4da3-9258-06e236d59a39`::ref 0 aborting False >Thread-4407::DEBUG::2014-09-09 11:58:41,216::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4407::DEBUG::2014-09-09 11:58:41,216::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:41,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4408::DEBUG::2014-09-09 11:58:41,244::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:58:41,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4408::DEBUG::2014-09-09 11:58:41,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`56297ca9-78ef-425f-80a3-c571ee429ed6`::moving from state init -> state preparing >Thread-4408::INFO::2014-09-09 11:58:41,245::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4408::DEBUG::2014-09-09 11:58:41,245::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`486af937-4dc9-4454-825f-2fa1a018b26d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4408::DEBUG::2014-09-09 11:58:41,245::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4408::DEBUG::2014-09-09 11:58:41,245::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4408::DEBUG::2014-09-09 11:58:41,245::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`486af937-4dc9-4454-825f-2fa1a018b26d`::Granted request >Thread-4408::DEBUG::2014-09-09 11:58:41,246::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`56297ca9-78ef-425f-80a3-c571ee429ed6`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4408::DEBUG::2014-09-09 11:58:41,246::task::993::Storage.TaskManager.Task::(_decref) Task=`56297ca9-78ef-425f-80a3-c571ee429ed6`::ref 1 aborting False >Thread-4408::INFO::2014-09-09 11:58:41,247::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4408::DEBUG::2014-09-09 11:58:41,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`56297ca9-78ef-425f-80a3-c571ee429ed6`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4408::DEBUG::2014-09-09 11:58:41,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`56297ca9-78ef-425f-80a3-c571ee429ed6`::moving from state preparing -> state finished >Thread-4408::DEBUG::2014-09-09 11:58:41,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4408::DEBUG::2014-09-09 11:58:41,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4408::DEBUG::2014-09-09 11:58:41,248::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4408::DEBUG::2014-09-09 11:58:41,248::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4408::DEBUG::2014-09-09 11:58:41,248::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4408::DEBUG::2014-09-09 11:58:41,248::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4408::DEBUG::2014-09-09 11:58:41,248::task::993::Storage.TaskManager.Task::(_decref) Task=`56297ca9-78ef-425f-80a3-c571ee429ed6`::ref 0 aborting False >Thread-4408::DEBUG::2014-09-09 11:58:41,248::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4408::DEBUG::2014-09-09 11:58:41,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:42,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:42,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896615 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:43,268::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:43,269::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4409::DEBUG::2014-09-09 11:58:43,270::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:44,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:44,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090109 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:45,179::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:45,179::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:45,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:45,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:45,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:45,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:45,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:45,180::__init__::225::IOProcess::(_processLogs) (9574) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:45,180::__init__::225::IOProcess::(_processLogs) (9574) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:45,180::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9574) Building response >Thread-19::DEBUG::2014-09-09 11:58:45,181::__init__::225::IOProcess::(_processLogs) (9574) Queuing response >Thread-3443::DEBUG::2014-09-09 11:58:45,181::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:45,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:45,186::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:58:45,188::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00100191 s, 354 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:45,188::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:45,188::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:45,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) (9575) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) (9575) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9575) Building response >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) (9575) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:45,189::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:45,190::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:46,281::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:46,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4410::DEBUG::2014-09-09 11:58:46,283::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:46,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:46,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896878 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:47,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:47,274::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) (9576) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:47,275::__init__::225::IOProcess::(_processLogs) (9576) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:47,276::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9576) Building response >Thread-19::DEBUG::2014-09-09 11:58:47,276::__init__::225::IOProcess::(_processLogs) (9576) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:47,276::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:47,277::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:58:47,277::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:58:47,285::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00102711 s, 534 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:47,285::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) (9577) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) (9577) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9577) Building response >Thread-19::DEBUG::2014-09-09 11:58:47,286::__init__::225::IOProcess::(_processLogs) (9577) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:47,287::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:47,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:58:47,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) (9578) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) (9578) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:47,288::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9578) Building response >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9578) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:47,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:47,290::__init__::225::IOProcess::(_processLogs) (9579) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:47,290::__init__::225::IOProcess::(_processLogs) (9579) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:47,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9579) Building response >Thread-19::DEBUG::2014-09-09 11:58:47,290::__init__::225::IOProcess::(_processLogs) (9579) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:47,290::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:47,290::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:47,291::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:47,291::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:58:47,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:47,291::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:47,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) (9580) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) (9580) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) (9580) Building response >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) (9580) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:47,292::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:58:48,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:48,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903094 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:49,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:49,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4411::DEBUG::2014-09-09 11:58:49,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:58:50,564::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:50,564::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) (9581) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:50,565::__init__::225::IOProcess::(_processLogs) (9581) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:50,566::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9581) Building response >Thread-19::DEBUG::2014-09-09 11:58:50,566::__init__::225::IOProcess::(_processLogs) (9581) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:50,566::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:58:50,567::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:50,567::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:58:50,574::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115957 s, 968 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) (9582) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) (9582) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:50,575::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9582) Building response >Thread-19::DEBUG::2014-09-09 11:58:50,576::__init__::225::IOProcess::(_processLogs) (9582) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:50,576::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:50,576::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:58:50,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:50,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896534 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:51,289::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:51,290::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4412::DEBUG::2014-09-09 11:58:51,290::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4412::DEBUG::2014-09-09 11:58:51,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fc5cd69-b9ca-4843-b814-ae1f37dd588a`::moving from state init -> state preparing >Thread-4412::INFO::2014-09-09 11:58:51,292::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4412::INFO::2014-09-09 11:58:51,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4412::DEBUG::2014-09-09 11:58:51,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fc5cd69-b9ca-4843-b814-ae1f37dd588a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4412::DEBUG::2014-09-09 11:58:51,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fc5cd69-b9ca-4843-b814-ae1f37dd588a`::moving from state preparing -> state finished >Thread-4412::DEBUG::2014-09-09 11:58:51,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4412::DEBUG::2014-09-09 11:58:51,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4412::DEBUG::2014-09-09 11:58:51,293::task::993::Storage.TaskManager.Task::(_decref) Task=`7fc5cd69-b9ca-4843-b814-ae1f37dd588a`::ref 0 aborting False >Thread-4412::DEBUG::2014-09-09 11:58:51,293::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4412::DEBUG::2014-09-09 11:58:51,293::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:51,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4413::DEBUG::2014-09-09 11:58:51,312::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:58:51,312::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4413::DEBUG::2014-09-09 11:58:51,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c11f93f-51ab-4c2a-8984-2c9d72ecb01f`::moving from state init -> state preparing >Thread-4413::INFO::2014-09-09 11:58:51,313::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4413::DEBUG::2014-09-09 11:58:51,313::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f4493353-f4ed-4a60-bfb6-a6494c2cc64d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4413::DEBUG::2014-09-09 11:58:51,313::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4413::DEBUG::2014-09-09 11:58:51,313::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4413::DEBUG::2014-09-09 11:58:51,314::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f4493353-f4ed-4a60-bfb6-a6494c2cc64d`::Granted request >Thread-4413::DEBUG::2014-09-09 11:58:51,314::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4c11f93f-51ab-4c2a-8984-2c9d72ecb01f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4413::DEBUG::2014-09-09 11:58:51,314::task::993::Storage.TaskManager.Task::(_decref) Task=`4c11f93f-51ab-4c2a-8984-2c9d72ecb01f`::ref 1 aborting False >Thread-4413::INFO::2014-09-09 11:58:51,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4413::DEBUG::2014-09-09 11:58:51,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c11f93f-51ab-4c2a-8984-2c9d72ecb01f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4413::DEBUG::2014-09-09 11:58:51,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c11f93f-51ab-4c2a-8984-2c9d72ecb01f`::moving from state preparing -> state finished >Thread-4413::DEBUG::2014-09-09 11:58:51,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4413::DEBUG::2014-09-09 11:58:51,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4413::DEBUG::2014-09-09 11:58:51,316::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4413::DEBUG::2014-09-09 11:58:51,316::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4413::DEBUG::2014-09-09 11:58:51,316::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4413::DEBUG::2014-09-09 11:58:51,316::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4413::DEBUG::2014-09-09 11:58:51,316::task::993::Storage.TaskManager.Task::(_decref) Task=`4c11f93f-51ab-4c2a-8984-2c9d72ecb01f`::ref 0 aborting False >Thread-4413::DEBUG::2014-09-09 11:58:51,316::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4413::DEBUG::2014-09-09 11:58:51,317::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:52,303::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:52,304::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4414::DEBUG::2014-09-09 11:58:52,305::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:52,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:52,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897283 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:58:54,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:54,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089767 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) (9583) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:55,191::__init__::225::IOProcess::(_processLogs) (9583) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:55,192::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9583) Building response >Thread-19::DEBUG::2014-09-09 11:58:55,192::__init__::225::IOProcess::(_processLogs) (9583) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:55,192::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:55,192::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:58:55,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:58:55,199::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910659 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) (9584) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) (9584) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:55,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9584) Building response >Thread-19::DEBUG::2014-09-09 11:58:55,201::__init__::225::IOProcess::(_processLogs) (9584) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:55,201::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:55,201::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:55,317::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:55,318::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4415::DEBUG::2014-09-09 11:58:55,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`e11629bf-90b4-4314-ad56-11b3e52ce30e`::moving from state init -> state preparing >Thread-4415::INFO::2014-09-09 11:58:55,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4415::INFO::2014-09-09 11:58:55,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115957', 'lastCheck': '4.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102711', 'lastCheck': '8.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910659', 'lastCheck': '0.1', 'valid': True}} >Thread-4415::DEBUG::2014-09-09 11:58:55,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`e11629bf-90b4-4314-ad56-11b3e52ce30e`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115957', 'lastCheck': '4.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102711', 'lastCheck': '8.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910659', 'lastCheck': '0.1', 'valid': True}} >Thread-4415::DEBUG::2014-09-09 11:58:55,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`e11629bf-90b4-4314-ad56-11b3e52ce30e`::moving from state preparing -> state finished >Thread-4415::DEBUG::2014-09-09 11:58:55,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4415::DEBUG::2014-09-09 11:58:55,319::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4415::DEBUG::2014-09-09 11:58:55,320::task::993::Storage.TaskManager.Task::(_decref) Task=`e11629bf-90b4-4314-ad56-11b3e52ce30e`::ref 0 aborting False >Thread-4415::DEBUG::2014-09-09 11:58:55,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:55,333::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:55,334::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4416::DEBUG::2014-09-09 11:58:55,335::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:56,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:57,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899746 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:57,292::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:57,292::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:57,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:57,292::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:57,292::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:57,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:57,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:57,293::__init__::225::IOProcess::(_processLogs) (9585) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:57,293::__init__::225::IOProcess::(_processLogs) (9585) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:57,293::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9585) Building response >Thread-19::DEBUG::2014-09-09 11:58:57,293::__init__::225::IOProcess::(_processLogs) (9585) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:57,294::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 11:58:57,294::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:58:57,294::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:58:57,301::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000967443 s, 566 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) (9585) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:57,302::__init__::225::IOProcess::(_processLogs) (9586) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:58:57,303::__init__::225::IOProcess::(_processLogs) (9586) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:58:57,303::__init__::225::IOProcess::(_processLogs) DEBUG|(9586) Building response >Thread-19::DEBUG::2014-09-09 11:58:57,303::__init__::225::IOProcess::(_processLogs) (9586) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:57,303::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:57,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) (9587) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) (9587) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) (9587) Building response >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) (9587) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:57,305::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) (9588) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) (9588) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) (9588) Building response >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) (9588) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:57,306::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:58:57,307::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:58:57,307::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:58:57,307::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:58:57,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:58:57,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:58:57,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) (9589) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) (9589) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) (9589) Building response >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) (9589) Queuing response >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:58:57,308::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:58:58,407::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:58:58,408::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4417::DEBUG::2014-09-09 11:58:58,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:58:59,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:58:59,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900977 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:00,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:00,578::__init__::225::IOProcess::(_processLogs) (9590) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:00,578::__init__::225::IOProcess::(_processLogs) (9590) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:00,578::__init__::225::IOProcess::(_processLogs) DEBUG|(9590) Building response >Thread-19::DEBUG::2014-09-09 11:59:00,578::__init__::225::IOProcess::(_processLogs) (9590) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:00,578::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:00,579::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:59:00,579::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:59:00,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107202 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) (9591) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:00,588::__init__::225::IOProcess::(_processLogs) (9591) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:00,589::__init__::225::IOProcess::(_processLogs) DEBUG|(9591) Building response >Thread-19::DEBUG::2014-09-09 11:59:00,589::__init__::225::IOProcess::(_processLogs) (9591) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:00,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:00,589::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:01,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:01,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089906 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:01,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:01,355::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4418::DEBUG::2014-09-09 11:59:01,355::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4418::DEBUG::2014-09-09 11:59:01,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`b706d7ad-cc80-47a7-8547-f1835de4b111`::moving from state init -> state preparing >Thread-4418::INFO::2014-09-09 11:59:01,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4418::INFO::2014-09-09 11:59:01,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4418::DEBUG::2014-09-09 11:59:01,356::task::1191::Storage.TaskManager.Task::(prepare) Task=`b706d7ad-cc80-47a7-8547-f1835de4b111`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4418::DEBUG::2014-09-09 11:59:01,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`b706d7ad-cc80-47a7-8547-f1835de4b111`::moving from state preparing -> state finished >Thread-4418::DEBUG::2014-09-09 11:59:01,357::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4418::DEBUG::2014-09-09 11:59:01,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4418::DEBUG::2014-09-09 11:59:01,357::task::993::Storage.TaskManager.Task::(_decref) Task=`b706d7ad-cc80-47a7-8547-f1835de4b111`::ref 0 aborting False >Thread-4418::DEBUG::2014-09-09 11:59:01,357::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4418::DEBUG::2014-09-09 11:59:01,357::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:01,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:01,387::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4419::DEBUG::2014-09-09 11:59:01,387::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4419::DEBUG::2014-09-09 11:59:01,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`326d2b52-c2e5-4c51-8bff-114c3ee6c78e`::moving from state init -> state preparing >Thread-4419::INFO::2014-09-09 11:59:01,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4419::DEBUG::2014-09-09 11:59:01,388::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4ca8c9b8-493f-4278-9195-ee2e43003098`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4419::DEBUG::2014-09-09 11:59:01,388::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4419::DEBUG::2014-09-09 11:59:01,388::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4419::DEBUG::2014-09-09 11:59:01,388::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4ca8c9b8-493f-4278-9195-ee2e43003098`::Granted request >Thread-4419::DEBUG::2014-09-09 11:59:01,389::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`326d2b52-c2e5-4c51-8bff-114c3ee6c78e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4419::DEBUG::2014-09-09 11:59:01,389::task::993::Storage.TaskManager.Task::(_decref) Task=`326d2b52-c2e5-4c51-8bff-114c3ee6c78e`::ref 1 aborting False >Thread-4419::INFO::2014-09-09 11:59:01,390::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4419::DEBUG::2014-09-09 11:59:01,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`326d2b52-c2e5-4c51-8bff-114c3ee6c78e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4419::DEBUG::2014-09-09 11:59:01,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`326d2b52-c2e5-4c51-8bff-114c3ee6c78e`::moving from state preparing -> state finished >Thread-4419::DEBUG::2014-09-09 11:59:01,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4419::DEBUG::2014-09-09 11:59:01,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4419::DEBUG::2014-09-09 11:59:01,391::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4419::DEBUG::2014-09-09 11:59:01,391::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4419::DEBUG::2014-09-09 11:59:01,391::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4419::DEBUG::2014-09-09 11:59:01,391::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4419::DEBUG::2014-09-09 11:59:01,391::task::993::Storage.TaskManager.Task::(_decref) Task=`326d2b52-c2e5-4c51-8bff-114c3ee6c78e`::ref 0 aborting False >Thread-4419::DEBUG::2014-09-09 11:59:01,391::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4419::DEBUG::2014-09-09 11:59:01,392::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:01,421::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:01,422::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4420::DEBUG::2014-09-09 11:59:01,423::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:03,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:03,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896696 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:04,429::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:04,430::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4421::DEBUG::2014-09-09 11:59:04,431::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:59:05,202::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:05,202::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:05,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:05,202::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:05,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:05,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:05,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:05,203::__init__::225::IOProcess::(_processLogs) (9592) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:05,203::__init__::225::IOProcess::(_processLogs) (9592) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:05,203::__init__::225::IOProcess::(_processLogs) DEBUG|(9592) Building response >Thread-19::DEBUG::2014-09-09 11:59:05,203::__init__::225::IOProcess::(_processLogs) (9592) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:05,203::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:05,204::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:59:05,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:59:05,211::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000881543 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:05,211::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) (9593) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) (9593) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:05,212::__init__::225::IOProcess::(_processLogs) DEBUG|(9593) Building response >Thread-19::DEBUG::2014-09-09 11:59:05,213::__init__::225::IOProcess::(_processLogs) (9593) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:05,213::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:05,213::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:05,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:05,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898705 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:07,308::__init__::225::IOProcess::(_processLogs) (9594) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:07,309::__init__::225::IOProcess::(_processLogs) (9594) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:07,309::__init__::225::IOProcess::(_processLogs) DEBUG|(9594) Building response >Thread-19::DEBUG::2014-09-09 11:59:07,309::__init__::225::IOProcess::(_processLogs) (9594) Queuing response >Thread-24::DEBUG::2014-09-09 11:59:07,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:07,310::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:07,315::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:59:07,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00105634 s, 519 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:07,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:07,319::__init__::225::IOProcess::(_processLogs) (9595) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:07,319::__init__::225::IOProcess::(_processLogs) (9595) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:07,319::__init__::225::IOProcess::(_processLogs) DEBUG|(9595) Building response >Thread-19::DEBUG::2014-09-09 11:59:07,319::__init__::225::IOProcess::(_processLogs) (9595) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:07,319::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:07,320::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:59:07,320::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:07,320::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:59:07,320::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) (9596) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) (9596) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) (9596) Building response >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) (9596) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:07,321::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) (9597) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:07,322::__init__::225::IOProcess::(_processLogs) (9597) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) (9597) Building response >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) (9597) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:07,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:07,324::__init__::225::IOProcess::(_processLogs) (9598) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:07,324::__init__::225::IOProcess::(_processLogs) (9598) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:07,324::__init__::225::IOProcess::(_processLogs) DEBUG|(9598) Building response >Thread-19::DEBUG::2014-09-09 11:59:07,324::__init__::225::IOProcess::(_processLogs) (9598) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:07,324::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:07,325::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:07,444::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:07,445::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4422::DEBUG::2014-09-09 11:59:07,446::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:07,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:07,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089712 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:59:09,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:09,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090025 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:10,455::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:10,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4423::DEBUG::2014-09-09 11:59:10,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`e269c968-955f-4901-ba0d-448fa26bb947`::moving from state init -> state preparing >Thread-4423::INFO::2014-09-09 11:59:10,457::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4423::INFO::2014-09-09 11:59:10,457::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107202', 'lastCheck': '9.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105634', 'lastCheck': '3.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000881543', 'lastCheck': '5.2', 'valid': True}} >Thread-4423::DEBUG::2014-09-09 11:59:10,457::task::1191::Storage.TaskManager.Task::(prepare) Task=`e269c968-955f-4901-ba0d-448fa26bb947`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107202', 'lastCheck': '9.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105634', 'lastCheck': '3.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000881543', 'lastCheck': '5.2', 'valid': True}} >Thread-4423::DEBUG::2014-09-09 11:59:10,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`e269c968-955f-4901-ba0d-448fa26bb947`::moving from state preparing -> state finished >Thread-4423::DEBUG::2014-09-09 11:59:10,457::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4423::DEBUG::2014-09-09 11:59:10,457::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4423::DEBUG::2014-09-09 11:59:10,457::task::993::Storage.TaskManager.Task::(_decref) Task=`e269c968-955f-4901-ba0d-448fa26bb947`::ref 0 aborting False >Thread-4423::DEBUG::2014-09-09 11:59:10,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:10,466::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:10,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4424::DEBUG::2014-09-09 11:59:10,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) (9599) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:10,590::__init__::225::IOProcess::(_processLogs) (9599) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:10,592::__init__::225::IOProcess::(_processLogs) DEBUG|(9599) Building response >Thread-19::DEBUG::2014-09-09 11:59:10,592::__init__::225::IOProcess::(_processLogs) (9599) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:10,592::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 11:59:10,593::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:10,593::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:59:10,600::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105692 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:10,601::__init__::225::IOProcess::(_processLogs) (9600) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:10,602::__init__::225::IOProcess::(_processLogs) (9600) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:10,602::__init__::225::IOProcess::(_processLogs) DEBUG|(9600) Building response >Thread-19::DEBUG::2014-09-09 11:59:10,602::__init__::225::IOProcess::(_processLogs) (9600) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:10,602::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:10,603::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:11,432::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4425::DEBUG::2014-09-09 11:59:11,433::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:59:11,433::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4425::DEBUG::2014-09-09 11:59:11,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e5b96d5-e0e3-4d31-a0f5-510cfd3ee6e5`::moving from state init -> state preparing >Thread-4425::INFO::2014-09-09 11:59:11,434::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4425::INFO::2014-09-09 11:59:11,435::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4425::DEBUG::2014-09-09 11:59:11,435::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e5b96d5-e0e3-4d31-a0f5-510cfd3ee6e5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4425::DEBUG::2014-09-09 11:59:11,435::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e5b96d5-e0e3-4d31-a0f5-510cfd3ee6e5`::moving from state preparing -> state finished >Thread-4425::DEBUG::2014-09-09 11:59:11,435::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4425::DEBUG::2014-09-09 11:59:11,435::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4425::DEBUG::2014-09-09 11:59:11,435::task::993::Storage.TaskManager.Task::(_decref) Task=`5e5b96d5-e0e3-4d31-a0f5-510cfd3ee6e5`::ref 0 aborting False >Thread-4425::DEBUG::2014-09-09 11:59:11,435::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4425::DEBUG::2014-09-09 11:59:11,435::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:11,504::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:11,505::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4426::DEBUG::2014-09-09 11:59:11,505::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4426::DEBUG::2014-09-09 11:59:11,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`045a33e4-a8cc-43b7-9d7f-4acd6143962c`::moving from state init -> state preparing >Thread-4426::INFO::2014-09-09 11:59:11,506::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4426::DEBUG::2014-09-09 11:59:11,506::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`61f2e984-88cb-41d2-970b-d0d1c880bcb3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4426::DEBUG::2014-09-09 11:59:11,506::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4426::DEBUG::2014-09-09 11:59:11,506::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4426::DEBUG::2014-09-09 11:59:11,506::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`61f2e984-88cb-41d2-970b-d0d1c880bcb3`::Granted request >Thread-4426::DEBUG::2014-09-09 11:59:11,506::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`045a33e4-a8cc-43b7-9d7f-4acd6143962c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4426::DEBUG::2014-09-09 11:59:11,507::task::993::Storage.TaskManager.Task::(_decref) Task=`045a33e4-a8cc-43b7-9d7f-4acd6143962c`::ref 1 aborting False >Thread-4426::INFO::2014-09-09 11:59:11,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4426::DEBUG::2014-09-09 11:59:11,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`045a33e4-a8cc-43b7-9d7f-4acd6143962c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4426::DEBUG::2014-09-09 11:59:11,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`045a33e4-a8cc-43b7-9d7f-4acd6143962c`::moving from state preparing -> state finished >Thread-4426::DEBUG::2014-09-09 11:59:11,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4426::DEBUG::2014-09-09 11:59:11,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4426::DEBUG::2014-09-09 11:59:11,509::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4426::DEBUG::2014-09-09 11:59:11,509::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4426::DEBUG::2014-09-09 11:59:11,509::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4426::DEBUG::2014-09-09 11:59:11,509::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4426::DEBUG::2014-09-09 11:59:11,509::task::993::Storage.TaskManager.Task::(_decref) Task=`045a33e4-a8cc-43b7-9d7f-4acd6143962c`::ref 0 aborting False >Thread-4426::DEBUG::2014-09-09 11:59:11,509::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4426::DEBUG::2014-09-09 11:59:11,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:11,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:11,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900302 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:13,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:13,551::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4427::DEBUG::2014-09-09 11:59:13,552::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:13,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:13,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903813 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:15,214::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:15,214::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:15,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:15,214::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:15,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:15,214::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:15,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:15,215::__init__::225::IOProcess::(_processLogs) (9601) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:15,215::__init__::225::IOProcess::(_processLogs) (9601) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:15,215::__init__::225::IOProcess::(_processLogs) DEBUG|(9601) Building response >Thread-19::DEBUG::2014-09-09 11:59:15,215::__init__::225::IOProcess::(_processLogs) (9601) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:15,215::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:15,216::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:59:15,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:59:15,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000894214 s, 397 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) (9602) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) (9602) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) DEBUG|(9602) Building response >Thread-19::DEBUG::2014-09-09 11:59:15,224::__init__::225::IOProcess::(_processLogs) (9602) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:15,225::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:15,225::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:15,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:16,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896256 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:16,561::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:16,562::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4428::DEBUG::2014-09-09 11:59:16,562::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:59:17,325::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:17,325::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:17,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:17,326::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:17,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:17,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:17,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:17,326::__init__::225::IOProcess::(_processLogs) (9603) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:17,326::__init__::225::IOProcess::(_processLogs) (9603) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:17,327::__init__::225::IOProcess::(_processLogs) DEBUG|(9603) Building response >Thread-19::DEBUG::2014-09-09 11:59:17,327::__init__::225::IOProcess::(_processLogs) (9603) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:17,327::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:17,328::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:59:17,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:59:17,337::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000905445 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:17,337::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) (9604) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:17,338::__init__::225::IOProcess::(_processLogs) (9604) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:17,339::__init__::225::IOProcess::(_processLogs) DEBUG|(9604) Building response >Thread-19::DEBUG::2014-09-09 11:59:17,339::__init__::225::IOProcess::(_processLogs) (9604) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:17,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:17,339::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:59:17,340::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:17,340::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:59:17,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:17,340::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) (9605) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) (9605) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) (9605) Building response >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) (9605) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:17,341::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:17,342::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:59:17,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:17,342::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:17,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:17,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) (9606) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) (9606) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) (9606) Building response >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) (9606) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:17,343::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) (9607) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:17,344::__init__::225::IOProcess::(_processLogs) (9607) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:17,345::__init__::225::IOProcess::(_processLogs) (9607) Building response >Thread-19::DEBUG::2014-09-09 11:59:17,345::__init__::225::IOProcess::(_processLogs) (9607) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:17,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:17,345::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:59:18,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:18,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897269 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:19,570::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:19,572::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4429::DEBUG::2014-09-09 11:59:19,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:20,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:20,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0948445 s, 10.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:20,603::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:20,603::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:20,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:20,603::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:20,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:20,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:20,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:20,604::__init__::225::IOProcess::(_processLogs) (9608) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:20,604::__init__::225::IOProcess::(_processLogs) (9608) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:20,604::__init__::225::IOProcess::(_processLogs) DEBUG|(9608) Building response >Thread-19::DEBUG::2014-09-09 11:59:20,605::__init__::225::IOProcess::(_processLogs) (9608) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:20,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:20,605::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:59:20,605::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:59:20,612::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00102117 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:20,612::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) (9609) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) (9609) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) DEBUG|(9609) Building response >Thread-19::DEBUG::2014-09-09 11:59:20,613::__init__::225::IOProcess::(_processLogs) (9609) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:20,614::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:20,614::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:21,640::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4430::DEBUG::2014-09-09 11:59:21,640::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:59:21,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4430::DEBUG::2014-09-09 11:59:21,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4b88060-11ee-4339-bf52-589bbaad61ff`::moving from state init -> state preparing >Thread-4430::INFO::2014-09-09 11:59:21,641::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4430::INFO::2014-09-09 11:59:21,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4430::DEBUG::2014-09-09 11:59:21,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4b88060-11ee-4339-bf52-589bbaad61ff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4430::DEBUG::2014-09-09 11:59:21,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4b88060-11ee-4339-bf52-589bbaad61ff`::moving from state preparing -> state finished >Thread-4430::DEBUG::2014-09-09 11:59:21,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4430::DEBUG::2014-09-09 11:59:21,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4430::DEBUG::2014-09-09 11:59:21,642::task::993::Storage.TaskManager.Task::(_decref) Task=`a4b88060-11ee-4339-bf52-589bbaad61ff`::ref 0 aborting False >Thread-4430::DEBUG::2014-09-09 11:59:21,642::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4430::DEBUG::2014-09-09 11:59:21,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:21,671::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:21,672::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4431::DEBUG::2014-09-09 11:59:21,672::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4431::DEBUG::2014-09-09 11:59:21,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b973182-e496-4cf1-8684-01ace1db2767`::moving from state init -> state preparing >Thread-4431::INFO::2014-09-09 11:59:21,673::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4431::DEBUG::2014-09-09 11:59:21,673::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9754f0ce-22d2-4c1a-b431-01f337bdf177`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4431::DEBUG::2014-09-09 11:59:21,673::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4431::DEBUG::2014-09-09 11:59:21,673::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4431::DEBUG::2014-09-09 11:59:21,673::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9754f0ce-22d2-4c1a-b431-01f337bdf177`::Granted request >Thread-4431::DEBUG::2014-09-09 11:59:21,674::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7b973182-e496-4cf1-8684-01ace1db2767`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4431::DEBUG::2014-09-09 11:59:21,674::task::993::Storage.TaskManager.Task::(_decref) Task=`7b973182-e496-4cf1-8684-01ace1db2767`::ref 1 aborting False >Thread-4431::INFO::2014-09-09 11:59:21,675::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4431::DEBUG::2014-09-09 11:59:21,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b973182-e496-4cf1-8684-01ace1db2767`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4431::DEBUG::2014-09-09 11:59:21,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b973182-e496-4cf1-8684-01ace1db2767`::moving from state preparing -> state finished >Thread-4431::DEBUG::2014-09-09 11:59:21,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4431::DEBUG::2014-09-09 11:59:21,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4431::DEBUG::2014-09-09 11:59:21,676::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4431::DEBUG::2014-09-09 11:59:21,676::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4431::DEBUG::2014-09-09 11:59:21,676::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4431::DEBUG::2014-09-09 11:59:21,676::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4431::DEBUG::2014-09-09 11:59:21,676::task::993::Storage.TaskManager.Task::(_decref) Task=`7b973182-e496-4cf1-8684-01ace1db2767`::ref 0 aborting False >Thread-4431::DEBUG::2014-09-09 11:59:21,676::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4431::DEBUG::2014-09-09 11:59:21,677::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:22,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:22,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903607 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:22,585::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:22,586::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4432::DEBUG::2014-09-09 11:59:22,587::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:24,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:24,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897543 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:25,226::__init__::225::IOProcess::(_processLogs) (9610) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:25,227::__init__::225::IOProcess::(_processLogs) (9610) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:25,227::__init__::225::IOProcess::(_processLogs) DEBUG|(9610) Building response >Thread-19::DEBUG::2014-09-09 11:59:25,227::__init__::225::IOProcess::(_processLogs) (9610) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:25,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:25,227::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:59:25,228::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:59:25,235::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000998046 s, 356 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) (9611) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:25,236::__init__::225::IOProcess::(_processLogs) (9611) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:25,237::__init__::225::IOProcess::(_processLogs) DEBUG|(9611) Building response >Thread-19::DEBUG::2014-09-09 11:59:25,237::__init__::225::IOProcess::(_processLogs) (9611) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:25,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:25,237::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:25,592::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:25,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4433::DEBUG::2014-09-09 11:59:25,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`61f7595e-89a1-40b7-b5e7-50d93e872edd`::moving from state init -> state preparing >Thread-4433::INFO::2014-09-09 11:59:25,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4433::INFO::2014-09-09 11:59:25,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102117', 'lastCheck': '5.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000905445', 'lastCheck': '8.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000998046', 'lastCheck': '0.4', 'valid': True}} >Thread-4433::DEBUG::2014-09-09 11:59:25,594::task::1191::Storage.TaskManager.Task::(prepare) Task=`61f7595e-89a1-40b7-b5e7-50d93e872edd`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102117', 'lastCheck': '5.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000905445', 'lastCheck': '8.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000998046', 'lastCheck': '0.4', 'valid': True}} >Thread-4433::DEBUG::2014-09-09 11:59:25,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`61f7595e-89a1-40b7-b5e7-50d93e872edd`::moving from state preparing -> state finished >Thread-4433::DEBUG::2014-09-09 11:59:25,594::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4433::DEBUG::2014-09-09 11:59:25,594::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4433::DEBUG::2014-09-09 11:59:25,594::task::993::Storage.TaskManager.Task::(_decref) Task=`61f7595e-89a1-40b7-b5e7-50d93e872edd`::ref 0 aborting False >Thread-4433::DEBUG::2014-09-09 11:59:25,595::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:25,603::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:25,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4434::DEBUG::2014-09-09 11:59:25,604::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:26,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:26,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901697 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:27,344::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:27,344::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) (9612) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) (9612) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) DEBUG|(9612) Building response >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) (9612) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:27,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:27,346::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:59:27,346::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:59:27,354::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000984963 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:27,354::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:27,354::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:27,354::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:27,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) (9613) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) (9613) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) DEBUG|(9613) Building response >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) (9613) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:27,355::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:27,356::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:59:27,356::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:27,356::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:59:27,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:27,356::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) (9614) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) (9614) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) (9614) Building response >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) (9614) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:27,357::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:27,358::__init__::225::IOProcess::(_processLogs) (9615) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) (9615) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) (9615) Building response >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) (9615) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:27,359::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) (9616) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) (9616) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) (9616) Building response >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) (9616) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:27,360::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:59:28,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:28,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:28,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4435::DEBUG::2014-09-09 11:59:28,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:28,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897057 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:30,615::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:30,615::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) (9617) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) (9617) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:30,616::__init__::225::IOProcess::(_processLogs) DEBUG|(9617) Building response >Thread-19::DEBUG::2014-09-09 11:59:30,617::__init__::225::IOProcess::(_processLogs) (9617) Queuing response >Thread-23::DEBUG::2014-09-09 11:59:30,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:30,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:30,622::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:59:30,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104819 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:30,624::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:30,624::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) (9618) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) (9618) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) DEBUG|(9618) Building response >Thread-19::DEBUG::2014-09-09 11:59:30,625::__init__::225::IOProcess::(_processLogs) (9618) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:30,626::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:30,626::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:30,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:30,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903373 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:31,693::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:31,694::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4436::DEBUG::2014-09-09 11:59:31,695::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:31,716::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:31,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4437::DEBUG::2014-09-09 11:59:31,716::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4437::DEBUG::2014-09-09 11:59:31,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`46190c55-ed30-47fb-b7f2-b58f3b1c48fb`::moving from state init -> state preparing >Thread-4437::INFO::2014-09-09 11:59:31,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4437::INFO::2014-09-09 11:59:31,717::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4437::DEBUG::2014-09-09 11:59:31,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`46190c55-ed30-47fb-b7f2-b58f3b1c48fb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4437::DEBUG::2014-09-09 11:59:31,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`46190c55-ed30-47fb-b7f2-b58f3b1c48fb`::moving from state preparing -> state finished >Thread-4437::DEBUG::2014-09-09 11:59:31,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4437::DEBUG::2014-09-09 11:59:31,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4437::DEBUG::2014-09-09 11:59:31,718::task::993::Storage.TaskManager.Task::(_decref) Task=`46190c55-ed30-47fb-b7f2-b58f3b1c48fb`::ref 0 aborting False >Thread-4437::DEBUG::2014-09-09 11:59:31,718::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4437::DEBUG::2014-09-09 11:59:31,718::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:31,748::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:31,749::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4438::DEBUG::2014-09-09 11:59:31,749::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4438::DEBUG::2014-09-09 11:59:31,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`926cc0e4-12c3-4e2e-9421-d952533081ce`::moving from state init -> state preparing >Thread-4438::INFO::2014-09-09 11:59:31,750::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4438::DEBUG::2014-09-09 11:59:31,750::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bad4a58d-2e65-4a73-92f1-ff06403e5ef6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4438::DEBUG::2014-09-09 11:59:31,750::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4438::DEBUG::2014-09-09 11:59:31,750::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4438::DEBUG::2014-09-09 11:59:31,750::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bad4a58d-2e65-4a73-92f1-ff06403e5ef6`::Granted request >Thread-4438::DEBUG::2014-09-09 11:59:31,750::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`926cc0e4-12c3-4e2e-9421-d952533081ce`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4438::DEBUG::2014-09-09 11:59:31,750::task::993::Storage.TaskManager.Task::(_decref) Task=`926cc0e4-12c3-4e2e-9421-d952533081ce`::ref 1 aborting False >Thread-4438::INFO::2014-09-09 11:59:31,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4438::DEBUG::2014-09-09 11:59:31,752::task::1191::Storage.TaskManager.Task::(prepare) Task=`926cc0e4-12c3-4e2e-9421-d952533081ce`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4438::DEBUG::2014-09-09 11:59:31,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`926cc0e4-12c3-4e2e-9421-d952533081ce`::moving from state preparing -> state finished >Thread-4438::DEBUG::2014-09-09 11:59:31,752::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4438::DEBUG::2014-09-09 11:59:31,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4438::DEBUG::2014-09-09 11:59:31,753::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4438::DEBUG::2014-09-09 11:59:31,753::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4438::DEBUG::2014-09-09 11:59:31,753::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4438::DEBUG::2014-09-09 11:59:31,753::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4438::DEBUG::2014-09-09 11:59:31,753::task::993::Storage.TaskManager.Task::(_decref) Task=`926cc0e4-12c3-4e2e-9421-d952533081ce`::ref 0 aborting False >Thread-4438::DEBUG::2014-09-09 11:59:31,753::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4438::DEBUG::2014-09-09 11:59:31,753::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:32,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:32,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896234 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:34,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:34,708::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4439::DEBUG::2014-09-09 11:59:34,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:34,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:35,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896262 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) (9619) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:35,239::__init__::225::IOProcess::(_processLogs) (9619) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:35,241::__init__::225::IOProcess::(_processLogs) DEBUG|(9619) Building response >Thread-19::DEBUG::2014-09-09 11:59:35,241::__init__::225::IOProcess::(_processLogs) (9619) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:35,241::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:35,242::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:59:35,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:59:35,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0008742 s, 406 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:35,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:35,251::__init__::225::IOProcess::(_processLogs) (9620) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:35,251::__init__::225::IOProcess::(_processLogs) (9620) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:35,251::__init__::225::IOProcess::(_processLogs) DEBUG|(9620) Building response >Thread-19::DEBUG::2014-09-09 11:59:35,251::__init__::225::IOProcess::(_processLogs) (9620) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:35,251::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:35,252::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:37,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:37,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903306 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:37,360::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:37,360::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) (9621) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) (9621) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:37,361::__init__::225::IOProcess::(_processLogs) DEBUG|(9621) Building response >Thread-19::DEBUG::2014-09-09 11:59:37,362::__init__::225::IOProcess::(_processLogs) (9621) Queuing response >Thread-24::DEBUG::2014-09-09 11:59:37,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:37,362::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:37,367::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:59:37,370::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00103993 s, 527 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) (9622) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) (9622) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:37,371::__init__::225::IOProcess::(_processLogs) DEBUG|(9622) Building response >Thread-19::DEBUG::2014-09-09 11:59:37,372::__init__::225::IOProcess::(_processLogs) (9622) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:37,372::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:37,372::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:37,373::__init__::225::IOProcess::(_processLogs) (9623) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) (9623) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) (9623) Building response >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) (9623) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:59:37,374::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) (9624) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) (9624) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) (9624) Building response >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) (9624) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:37,375::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:37,376::__init__::225::IOProcess::(_processLogs) (9625) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:37,377::__init__::225::IOProcess::(_processLogs) (9625) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:37,377::__init__::225::IOProcess::(_processLogs) (9625) Building response >Thread-19::DEBUG::2014-09-09 11:59:37,377::__init__::225::IOProcess::(_processLogs) (9625) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:37,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:37,377::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:37,715::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:37,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4440::DEBUG::2014-09-09 11:59:37,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:39,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:39,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896795 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:40,627::__init__::225::IOProcess::(_processLogs) (9626) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:40,628::__init__::225::IOProcess::(_processLogs) (9626) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:40,628::__init__::225::IOProcess::(_processLogs) DEBUG|(9626) Building response >Thread-19::DEBUG::2014-09-09 11:59:40,628::__init__::225::IOProcess::(_processLogs) (9626) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:40,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:40,629::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:59:40,629::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 11:59:40,637::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111907 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:40,637::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:40,637::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:40,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:40,637::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) (9627) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) (9627) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) DEBUG|(9627) Building response >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) (9627) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:40,638::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:40,639::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:40,730::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:40,730::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4441::DEBUG::2014-09-09 11:59:40,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`031c5eb4-e7b4-40f6-8ec5-b1f2da56357d`::moving from state init -> state preparing >Thread-4441::INFO::2014-09-09 11:59:40,731::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4441::INFO::2014-09-09 11:59:40,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111907', 'lastCheck': '0.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103993', 'lastCheck': '3.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0008742', 'lastCheck': '5.5', 'valid': True}} >Thread-4441::DEBUG::2014-09-09 11:59:40,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`031c5eb4-e7b4-40f6-8ec5-b1f2da56357d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111907', 'lastCheck': '0.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103993', 'lastCheck': '3.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0008742', 'lastCheck': '5.5', 'valid': True}} >Thread-4441::DEBUG::2014-09-09 11:59:40,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`031c5eb4-e7b4-40f6-8ec5-b1f2da56357d`::moving from state preparing -> state finished >Thread-4441::DEBUG::2014-09-09 11:59:40,732::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4441::DEBUG::2014-09-09 11:59:40,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4441::DEBUG::2014-09-09 11:59:40,732::task::993::Storage.TaskManager.Task::(_decref) Task=`031c5eb4-e7b4-40f6-8ec5-b1f2da56357d`::ref 0 aborting False >Thread-4441::DEBUG::2014-09-09 11:59:40,733::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:40,746::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:40,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4442::DEBUG::2014-09-09 11:59:40,747::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:41,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:41,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901973 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:41,794::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4443::DEBUG::2014-09-09 11:59:41,794::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:59:41,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4443::DEBUG::2014-09-09 11:59:41,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`570190c7-9065-4594-bb48-b20cd0bffcf0`::moving from state init -> state preparing >Thread-4443::INFO::2014-09-09 11:59:41,796::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4443::INFO::2014-09-09 11:59:41,796::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4443::DEBUG::2014-09-09 11:59:41,796::task::1191::Storage.TaskManager.Task::(prepare) Task=`570190c7-9065-4594-bb48-b20cd0bffcf0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4443::DEBUG::2014-09-09 11:59:41,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`570190c7-9065-4594-bb48-b20cd0bffcf0`::moving from state preparing -> state finished >Thread-4443::DEBUG::2014-09-09 11:59:41,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4443::DEBUG::2014-09-09 11:59:41,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4443::DEBUG::2014-09-09 11:59:41,796::task::993::Storage.TaskManager.Task::(_decref) Task=`570190c7-9065-4594-bb48-b20cd0bffcf0`::ref 0 aborting False >Thread-4443::DEBUG::2014-09-09 11:59:41,797::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4443::DEBUG::2014-09-09 11:59:41,797::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:41,841::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4444::DEBUG::2014-09-09 11:59:41,842::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 11:59:41,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4444::DEBUG::2014-09-09 11:59:41,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`94f6f404-c83b-4f6b-baa6-0e46a751c4ea`::moving from state init -> state preparing >Thread-4444::INFO::2014-09-09 11:59:41,843::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4444::DEBUG::2014-09-09 11:59:41,843::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7be94bca-1bb3-4888-92d0-fce8495ed086`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4444::DEBUG::2014-09-09 11:59:41,843::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4444::DEBUG::2014-09-09 11:59:41,843::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4444::DEBUG::2014-09-09 11:59:41,844::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7be94bca-1bb3-4888-92d0-fce8495ed086`::Granted request >Thread-4444::DEBUG::2014-09-09 11:59:41,844::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94f6f404-c83b-4f6b-baa6-0e46a751c4ea`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4444::DEBUG::2014-09-09 11:59:41,844::task::993::Storage.TaskManager.Task::(_decref) Task=`94f6f404-c83b-4f6b-baa6-0e46a751c4ea`::ref 1 aborting False >Thread-4444::INFO::2014-09-09 11:59:41,845::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4444::DEBUG::2014-09-09 11:59:41,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`94f6f404-c83b-4f6b-baa6-0e46a751c4ea`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4444::DEBUG::2014-09-09 11:59:41,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`94f6f404-c83b-4f6b-baa6-0e46a751c4ea`::moving from state preparing -> state finished >Thread-4444::DEBUG::2014-09-09 11:59:41,846::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4444::DEBUG::2014-09-09 11:59:41,846::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4444::DEBUG::2014-09-09 11:59:41,846::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4444::DEBUG::2014-09-09 11:59:41,846::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4444::DEBUG::2014-09-09 11:59:41,846::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4444::DEBUG::2014-09-09 11:59:41,846::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4444::DEBUG::2014-09-09 11:59:41,846::task::993::Storage.TaskManager.Task::(_decref) Task=`94f6f404-c83b-4f6b-baa6-0e46a751c4ea`::ref 0 aborting False >Thread-4444::DEBUG::2014-09-09 11:59:41,847::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4444::DEBUG::2014-09-09 11:59:41,847::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:43,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:43,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896646 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:43,855::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:43,856::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4445::DEBUG::2014-09-09 11:59:43,857::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:59:45,252::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) (9628) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:45,253::__init__::225::IOProcess::(_processLogs) (9628) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:45,254::__init__::225::IOProcess::(_processLogs) DEBUG|(9628) Building response >Thread-19::DEBUG::2014-09-09 11:59:45,254::__init__::225::IOProcess::(_processLogs) (9628) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:45,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:45,254::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:59:45,255::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 11:59:45,261::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000932649 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) (9629) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:45,262::__init__::225::IOProcess::(_processLogs) (9629) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:45,263::__init__::225::IOProcess::(_processLogs) DEBUG|(9629) Building response >Thread-19::DEBUG::2014-09-09 11:59:45,263::__init__::225::IOProcess::(_processLogs) (9629) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:45,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:45,263::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:45,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:45,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903518 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:46,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:46,885::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4446::DEBUG::2014-09-09 11:59:46,886::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) (9630) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:47,377::__init__::225::IOProcess::(_processLogs) (9630) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:47,378::__init__::225::IOProcess::(_processLogs) DEBUG|(9630) Building response >Thread-19::DEBUG::2014-09-09 11:59:47,378::__init__::225::IOProcess::(_processLogs) (9630) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:47,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:47,379::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:59:47,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 11:59:47,386::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000991732 s, 553 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:47,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:47,387::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:47,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:47,387::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:47,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:47,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:47,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:47,388::__init__::225::IOProcess::(_processLogs) (9631) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:47,388::__init__::225::IOProcess::(_processLogs) (9631) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:47,388::__init__::225::IOProcess::(_processLogs) DEBUG|(9631) Building response >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) (9631) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:47,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) (9632) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) (9632) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) DEBUG|(9632) Building response >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) (9632) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:47,390::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) (9633) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) (9633) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) DEBUG|(9633) Building response >Thread-19::DEBUG::2014-09-09 11:59:47,391::__init__::225::IOProcess::(_processLogs) (9633) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:47,392::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:47,392::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:47,392::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:47,392::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:59:47,392::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) (9634) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) (9634) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) (9634) Building response >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) (9634) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:47,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:47,394::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:59:47,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:47,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899335 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 11:59:49,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:49,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0950604 s, 10.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:49,895::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:49,897::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4447::DEBUG::2014-09-09 11:59:49,899::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) (9635) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:50,640::__init__::225::IOProcess::(_processLogs) (9635) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:50,641::__init__::225::IOProcess::(_processLogs) DEBUG|(9635) Building response >Thread-19::DEBUG::2014-09-09 11:59:50,641::__init__::225::IOProcess::(_processLogs) (9635) Queuing response >Thread-23::DEBUG::2014-09-09 11:59:50,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:50,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:50,647::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 11:59:50,649::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113255 s, 992 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:50,649::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:50,649::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 11:59:50,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) (9636) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) (9636) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9636) Building response >Thread-19::DEBUG::2014-09-09 11:59:50,650::__init__::225::IOProcess::(_processLogs) (9636) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:50,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:50,651::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 11:59:51,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:51,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896645 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:51,978::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:51,979::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4448::DEBUG::2014-09-09 11:59:51,979::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4448::DEBUG::2014-09-09 11:59:51,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e9fb425-9882-4813-8192-f8429de2f02d`::moving from state init -> state preparing >Thread-4448::INFO::2014-09-09 11:59:51,980::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4448::INFO::2014-09-09 11:59:51,980::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4448::DEBUG::2014-09-09 11:59:51,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e9fb425-9882-4813-8192-f8429de2f02d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4448::DEBUG::2014-09-09 11:59:51,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e9fb425-9882-4813-8192-f8429de2f02d`::moving from state preparing -> state finished >Thread-4448::DEBUG::2014-09-09 11:59:51,981::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4448::DEBUG::2014-09-09 11:59:51,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4448::DEBUG::2014-09-09 11:59:51,981::task::993::Storage.TaskManager.Task::(_decref) Task=`3e9fb425-9882-4813-8192-f8429de2f02d`::ref 0 aborting False >Thread-4448::DEBUG::2014-09-09 11:59:51,981::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4448::DEBUG::2014-09-09 11:59:51,981::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:52,009::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:52,010::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4449::DEBUG::2014-09-09 11:59:52,010::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4449::DEBUG::2014-09-09 11:59:52,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`acb07975-92e2-43e7-9c33-3bdd82fdbdcd`::moving from state init -> state preparing >Thread-4449::INFO::2014-09-09 11:59:52,011::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4449::DEBUG::2014-09-09 11:59:52,011::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fabafb04-80bb-4e0a-8525-f272529650ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4449::DEBUG::2014-09-09 11:59:52,011::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4449::DEBUG::2014-09-09 11:59:52,011::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4449::DEBUG::2014-09-09 11:59:52,011::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fabafb04-80bb-4e0a-8525-f272529650ab`::Granted request >Thread-4449::DEBUG::2014-09-09 11:59:52,012::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`acb07975-92e2-43e7-9c33-3bdd82fdbdcd`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4449::DEBUG::2014-09-09 11:59:52,012::task::993::Storage.TaskManager.Task::(_decref) Task=`acb07975-92e2-43e7-9c33-3bdd82fdbdcd`::ref 1 aborting False >Thread-4449::INFO::2014-09-09 11:59:52,013::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4449::DEBUG::2014-09-09 11:59:52,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`acb07975-92e2-43e7-9c33-3bdd82fdbdcd`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4449::DEBUG::2014-09-09 11:59:52,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`acb07975-92e2-43e7-9c33-3bdd82fdbdcd`::moving from state preparing -> state finished >Thread-4449::DEBUG::2014-09-09 11:59:52,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4449::DEBUG::2014-09-09 11:59:52,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4449::DEBUG::2014-09-09 11:59:52,014::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4449::DEBUG::2014-09-09 11:59:52,014::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4449::DEBUG::2014-09-09 11:59:52,014::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4449::DEBUG::2014-09-09 11:59:52,014::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4449::DEBUG::2014-09-09 11:59:52,014::task::993::Storage.TaskManager.Task::(_decref) Task=`acb07975-92e2-43e7-9c33-3bdd82fdbdcd`::ref 0 aborting False >Thread-4449::DEBUG::2014-09-09 11:59:52,014::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4449::DEBUG::2014-09-09 11:59:52,014::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:52,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:52,908::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4450::DEBUG::2014-09-09 11:59:52,909::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:53,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:54,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901278 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:55,264::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:55,264::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) (9637) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) (9637) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:55,265::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9637) Building response >Thread-19::DEBUG::2014-09-09 11:59:55,266::__init__::225::IOProcess::(_processLogs) (9637) Queuing response >Thread-3443::DEBUG::2014-09-09 11:59:55,266::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:55,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:55,271::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 11:59:55,273::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000897249 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:55,273::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:55,273::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 11:59:55,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:55,273::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:55,273::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) (9638) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) (9638) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9638) Building response >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) (9638) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:55,274::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:55,275::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:55,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:55,921::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4451::DEBUG::2014-09-09 11:59:55,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`c166af57-cbc1-46f7-b608-3ff7f2f4abb6`::moving from state init -> state preparing >Thread-4451::INFO::2014-09-09 11:59:55,922::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4451::INFO::2014-09-09 11:59:55,922::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '5.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000991732', 'lastCheck': '8.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000897249', 'lastCheck': '0.6', 'valid': True}} >Thread-4451::DEBUG::2014-09-09 11:59:55,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`c166af57-cbc1-46f7-b608-3ff7f2f4abb6`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '5.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000991732', 'lastCheck': '8.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000897249', 'lastCheck': '0.6', 'valid': True}} >Thread-4451::DEBUG::2014-09-09 11:59:55,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`c166af57-cbc1-46f7-b608-3ff7f2f4abb6`::moving from state preparing -> state finished >Thread-4451::DEBUG::2014-09-09 11:59:55,922::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4451::DEBUG::2014-09-09 11:59:55,922::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4451::DEBUG::2014-09-09 11:59:55,923::task::993::Storage.TaskManager.Task::(_decref) Task=`c166af57-cbc1-46f7-b608-3ff7f2f4abb6`::ref 0 aborting False >Thread-4451::DEBUG::2014-09-09 11:59:55,923::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:55,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:55,934::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4452::DEBUG::2014-09-09 11:59:55,935::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 11:59:56,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:56,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899098 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:57,393::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) (9639) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) (9639) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:57,394::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9639) Building response >Thread-19::DEBUG::2014-09-09 11:59:57,395::__init__::225::IOProcess::(_processLogs) (9639) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:57,395::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 11:59:57,395::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 11:59:57,395::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 11:59:57,403::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000881862 s, 621 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 11:59:57,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:57,404::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 11:59:57,404::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:57,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:57,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:57,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:57,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:57,405::__init__::225::IOProcess::(_processLogs) (9640) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 11:59:57,405::__init__::225::IOProcess::(_processLogs) (9640) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 11:59:57,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9640) Building response >Thread-19::DEBUG::2014-09-09 11:59:57,405::__init__::225::IOProcess::(_processLogs) (9640) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:57,405::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 11:59:57,406::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 11:59:57,406::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:57,406::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 11:59:57,406::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:57,406::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) (9641) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) (9641) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) (9641) Building response >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) (9641) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:57,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) (9642) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:57,408::__init__::225::IOProcess::(_processLogs) (9642) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) (9642) Building response >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) (9642) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 11:59:57,409::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) (9643) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) (9643) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) (9643) Building response >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) (9643) Queuing response >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 11:59:57,410::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 11:59:58,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 11:59:58,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900031 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 11:59:58,999::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 11:59:59,000::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4453::DEBUG::2014-09-09 11:59:59,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:00,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:00,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898122 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) (9644) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:00,652::__init__::225::IOProcess::(_processLogs) (9644) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:00,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9644) Building response >Thread-19::DEBUG::2014-09-09 12:00:00,653::__init__::225::IOProcess::(_processLogs) (9644) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:00,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:00,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:00:00,654::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:00:00,661::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112404 s, 999 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) (9645) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:00,662::__init__::225::IOProcess::(_processLogs) (9645) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:00,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9645) Building response >Thread-19::DEBUG::2014-09-09 12:00:00,663::__init__::225::IOProcess::(_processLogs) (9645) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:00,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:00,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:02,012::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:02,013::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4454::DEBUG::2014-09-09 12:00:02,015::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:02,056::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:02,057::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4455::DEBUG::2014-09-09 12:00:02,057::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4455::DEBUG::2014-09-09 12:00:02,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`e05508ed-cda5-43df-8566-0c1e72db7054`::moving from state init -> state preparing >Thread-4455::INFO::2014-09-09 12:00:02,058::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4455::INFO::2014-09-09 12:00:02,058::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4455::DEBUG::2014-09-09 12:00:02,058::task::1191::Storage.TaskManager.Task::(prepare) Task=`e05508ed-cda5-43df-8566-0c1e72db7054`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4455::DEBUG::2014-09-09 12:00:02,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`e05508ed-cda5-43df-8566-0c1e72db7054`::moving from state preparing -> state finished >Thread-4455::DEBUG::2014-09-09 12:00:02,058::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4455::DEBUG::2014-09-09 12:00:02,058::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4455::DEBUG::2014-09-09 12:00:02,058::task::993::Storage.TaskManager.Task::(_decref) Task=`e05508ed-cda5-43df-8566-0c1e72db7054`::ref 0 aborting False >Thread-4455::DEBUG::2014-09-09 12:00:02,058::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4455::DEBUG::2014-09-09 12:00:02,059::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:02,086::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:02,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4456::DEBUG::2014-09-09 12:00:02,086::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4456::DEBUG::2014-09-09 12:00:02,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`33f791d9-568b-4d40-8557-a335dec89b6f`::moving from state init -> state preparing >Thread-4456::INFO::2014-09-09 12:00:02,087::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4456::DEBUG::2014-09-09 12:00:02,087::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b74cf585-f0aa-4f47-aefb-e4bb55f38325`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4456::DEBUG::2014-09-09 12:00:02,088::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4456::DEBUG::2014-09-09 12:00:02,088::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4456::DEBUG::2014-09-09 12:00:02,088::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b74cf585-f0aa-4f47-aefb-e4bb55f38325`::Granted request >Thread-4456::DEBUG::2014-09-09 12:00:02,088::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`33f791d9-568b-4d40-8557-a335dec89b6f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4456::DEBUG::2014-09-09 12:00:02,088::task::993::Storage.TaskManager.Task::(_decref) Task=`33f791d9-568b-4d40-8557-a335dec89b6f`::ref 1 aborting False >Thread-4456::INFO::2014-09-09 12:00:02,090::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4456::DEBUG::2014-09-09 12:00:02,090::task::1191::Storage.TaskManager.Task::(prepare) Task=`33f791d9-568b-4d40-8557-a335dec89b6f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4456::DEBUG::2014-09-09 12:00:02,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`33f791d9-568b-4d40-8557-a335dec89b6f`::moving from state preparing -> state finished >Thread-4456::DEBUG::2014-09-09 12:00:02,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4456::DEBUG::2014-09-09 12:00:02,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4456::DEBUG::2014-09-09 12:00:02,090::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4456::DEBUG::2014-09-09 12:00:02,090::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4456::DEBUG::2014-09-09 12:00:02,090::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4456::DEBUG::2014-09-09 12:00:02,090::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4456::DEBUG::2014-09-09 12:00:02,090::task::993::Storage.TaskManager.Task::(_decref) Task=`33f791d9-568b-4d40-8557-a335dec89b6f`::ref 0 aborting False >Thread-4456::DEBUG::2014-09-09 12:00:02,091::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283244494848', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4456::DEBUG::2014-09-09 12:00:02,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:02,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:02,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896052 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:00:04,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:04,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897099 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:05,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:05,028::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4457::DEBUG::2014-09-09 12:00:05,029::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:00:05,275::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:05,275::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) (9646) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:05,276::__init__::225::IOProcess::(_processLogs) (9646) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:05,277::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9646) Building response >Thread-19::DEBUG::2014-09-09 12:00:05,277::__init__::225::IOProcess::(_processLogs) (9646) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:05,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:05,277::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:00:05,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:00:05,285::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000831703 s, 427 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:05,285::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:05,285::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:05,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) (9647) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) (9647) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9647) Building response >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) (9647) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:05,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:05,287::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:06,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:06,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897542 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:07,410::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:07,410::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:07,410::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:07,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) (9648) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) (9648) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9648) Building response >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) (9648) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:07,411::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:00:07,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:00:07,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00108231 s, 506 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:07,419::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) (9649) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:07,420::__init__::225::IOProcess::(_processLogs) (9649) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:07,421::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9649) Building response >Thread-19::DEBUG::2014-09-09 12:00:07,421::__init__::225::IOProcess::(_processLogs) (9649) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:07,421::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:07,421::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:00:07,422::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:07,422::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:00:07,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:07,422::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:07,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:07,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) (9650) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) (9650) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) (9650) Building response >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) (9650) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:07,423::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) (9651) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) (9651) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) (9651) Building response >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) (9651) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:07,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) (9652) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:07,425::__init__::225::IOProcess::(_processLogs) (9652) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:07,426::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9652) Building response >Thread-19::DEBUG::2014-09-09 12:00:07,426::__init__::225::IOProcess::(_processLogs) (9652) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:07,427::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:07,427::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:08,036::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:08,036::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4458::DEBUG::2014-09-09 12:00:08,037::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:08,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:08,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898169 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:10,664::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) (9653) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:10,665::__init__::225::IOProcess::(_processLogs) (9653) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:10,666::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|(9653) Building response >Thread-19::DEBUG::2014-09-09 12:00:10,666::__init__::225::IOProcess::(_processLogs) (9653) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:10,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:10,666::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:00:10,667::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:00:10,675::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.001336 s, 841 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:10,675::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) (9654) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:10,676::__init__::225::IOProcess::(_processLogs) (9654) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:10,677::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|(9654) Building response >Thread-19::DEBUG::2014-09-09 12:00:10,677::__init__::225::IOProcess::(_processLogs) (9654) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:10,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:10,677::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:10,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:10,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899698 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:11,049::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:11,050::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4459::DEBUG::2014-09-09 12:00:11,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a9fe1e1-84b9-4135-92ae-e8a729f13b3d`::moving from state init -> state preparing >Thread-4459::INFO::2014-09-09 12:00:11,052::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4459::INFO::2014-09-09 12:00:11,052::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001336', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108231', 'lastCheck': '3.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000831703', 'lastCheck': '5.8', 'valid': True}} >Thread-4459::DEBUG::2014-09-09 12:00:11,052::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a9fe1e1-84b9-4135-92ae-e8a729f13b3d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001336', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108231', 'lastCheck': '3.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000831703', 'lastCheck': '5.8', 'valid': True}} >Thread-4459::DEBUG::2014-09-09 12:00:11,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a9fe1e1-84b9-4135-92ae-e8a729f13b3d`::moving from state preparing -> state finished >Thread-4459::DEBUG::2014-09-09 12:00:11,052::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4459::DEBUG::2014-09-09 12:00:11,052::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4459::DEBUG::2014-09-09 12:00:11,052::task::993::Storage.TaskManager.Task::(_decref) Task=`0a9fe1e1-84b9-4135-92ae-e8a729f13b3d`::ref 0 aborting False >Thread-4459::DEBUG::2014-09-09 12:00:11,053::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:11,069::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:11,070::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4460::DEBUG::2014-09-09 12:00:11,071::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:12,131::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:12,132::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4461::DEBUG::2014-09-09 12:00:12,132::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4461::DEBUG::2014-09-09 12:00:12,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6a2dd5f-5a88-403a-a2b7-018ac5260a6e`::moving from state init -> state preparing >Thread-4461::INFO::2014-09-09 12:00:12,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4461::INFO::2014-09-09 12:00:12,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4461::DEBUG::2014-09-09 12:00:12,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6a2dd5f-5a88-403a-a2b7-018ac5260a6e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4461::DEBUG::2014-09-09 12:00:12,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6a2dd5f-5a88-403a-a2b7-018ac5260a6e`::moving from state preparing -> state finished >Thread-4461::DEBUG::2014-09-09 12:00:12,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4461::DEBUG::2014-09-09 12:00:12,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4461::DEBUG::2014-09-09 12:00:12,134::task::993::Storage.TaskManager.Task::(_decref) Task=`c6a2dd5f-5a88-403a-a2b7-018ac5260a6e`::ref 0 aborting False >Thread-4461::DEBUG::2014-09-09 12:00:12,134::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4461::DEBUG::2014-09-09 12:00:12,134::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:12,160::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:12,161::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4462::DEBUG::2014-09-09 12:00:12,161::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4462::DEBUG::2014-09-09 12:00:12,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`7782c181-c1c2-42c1-9acf-a4548f483771`::moving from state init -> state preparing >Thread-4462::INFO::2014-09-09 12:00:12,162::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4462::DEBUG::2014-09-09 12:00:12,162::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d94467c7-6fbd-4500-9a37-32c722241b5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4462::DEBUG::2014-09-09 12:00:12,162::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4462::DEBUG::2014-09-09 12:00:12,162::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4462::DEBUG::2014-09-09 12:00:12,162::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d94467c7-6fbd-4500-9a37-32c722241b5f`::Granted request >Thread-4462::DEBUG::2014-09-09 12:00:12,163::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7782c181-c1c2-42c1-9acf-a4548f483771`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4462::DEBUG::2014-09-09 12:00:12,163::task::993::Storage.TaskManager.Task::(_decref) Task=`7782c181-c1c2-42c1-9acf-a4548f483771`::ref 1 aborting False >Thread-4462::INFO::2014-09-09 12:00:12,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4462::DEBUG::2014-09-09 12:00:12,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`7782c181-c1c2-42c1-9acf-a4548f483771`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4462::DEBUG::2014-09-09 12:00:12,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`7782c181-c1c2-42c1-9acf-a4548f483771`::moving from state preparing -> state finished >Thread-4462::DEBUG::2014-09-09 12:00:12,165::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4462::DEBUG::2014-09-09 12:00:12,165::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4462::DEBUG::2014-09-09 12:00:12,165::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4462::DEBUG::2014-09-09 12:00:12,165::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4462::DEBUG::2014-09-09 12:00:12,165::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4462::DEBUG::2014-09-09 12:00:12,165::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4462::DEBUG::2014-09-09 12:00:12,165::task::993::Storage.TaskManager.Task::(_decref) Task=`7782c181-c1c2-42c1-9acf-a4548f483771`::ref 0 aborting False >Thread-4462::DEBUG::2014-09-09 12:00:12,166::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4462::DEBUG::2014-09-09 12:00:12,166::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:12,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:12,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898102 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:14,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:14,147::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4463::DEBUG::2014-09-09 12:00:14,148::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:14,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:15,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901083 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) (9655) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:15,288::__init__::225::IOProcess::(_processLogs) (9655) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:15,289::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|(9655) Building response >Thread-19::DEBUG::2014-09-09 12:00:15,289::__init__::225::IOProcess::(_processLogs) (9655) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:15,289::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:15,290::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:00:15,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:00:15,297::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000909676 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) (9652) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:15,298::__init__::225::IOProcess::(_processLogs) (9656) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:15,299::__init__::225::IOProcess::(_processLogs) (9656) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:15,299::__init__::225::IOProcess::(_processLogs) DEBUG|(9656) Building response >Thread-19::DEBUG::2014-09-09 12:00:15,299::__init__::225::IOProcess::(_processLogs) (9656) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:15,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:15,299::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:17,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:17,164::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:17,165::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4464::DEBUG::2014-09-09 12:00:17,166::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:17,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895551 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:17,427::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:17,427::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:17,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:17,427::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:17,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:17,428::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:17,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:17,428::__init__::225::IOProcess::(_processLogs) (9657) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:17,428::__init__::225::IOProcess::(_processLogs) (9657) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:17,429::__init__::225::IOProcess::(_processLogs) DEBUG|(9657) Building response >Thread-19::DEBUG::2014-09-09 12:00:17,429::__init__::225::IOProcess::(_processLogs) (9657) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:17,429::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:00:17,430::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:17,430::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:00:17,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000939894 s, 583 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) (9658) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:17,440::__init__::225::IOProcess::(_processLogs) (9658) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:17,441::__init__::225::IOProcess::(_processLogs) DEBUG|(9658) Building response >Thread-19::DEBUG::2014-09-09 12:00:17,441::__init__::225::IOProcess::(_processLogs) (9658) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:17,441::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:17,441::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:17,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) (9659) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) (9659) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) (9659) Building response >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) (9659) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:00:17,443::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) (9660) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) (9660) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) (9660) Building response >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) (9660) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:17,444::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:17,445::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:17,445::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:00:17,445::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:17,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:17,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) (9661) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) (9661) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) (9661) Building response >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) (9661) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:17,446::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:00:19,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:19,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897139 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:20,175::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:20,177::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4465::DEBUG::2014-09-09 12:00:20,180::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:00:20,678::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:20,678::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:20,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:20,678::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:20,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:20,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:20,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:20,679::__init__::225::IOProcess::(_processLogs) (9662) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:20,679::__init__::225::IOProcess::(_processLogs) (9662) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:20,679::__init__::225::IOProcess::(_processLogs) DEBUG|(9662) Building response >Thread-19::DEBUG::2014-09-09 12:00:20,680::__init__::225::IOProcess::(_processLogs) (9662) Queuing response >Thread-23::DEBUG::2014-09-09 12:00:20,680::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:20,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:20,685::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:00:20,687::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111339 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) (9663) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:20,688::__init__::225::IOProcess::(_processLogs) (9663) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:20,689::__init__::225::IOProcess::(_processLogs) DEBUG|(9663) Building response >Thread-19::DEBUG::2014-09-09 12:00:20,689::__init__::225::IOProcess::(_processLogs) (9663) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:20,689::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:20,690::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:21,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:21,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896458 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:22,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:22,214::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4466::DEBUG::2014-09-09 12:00:22,214::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4466::DEBUG::2014-09-09 12:00:22,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`f22b814a-022a-4636-b318-d621c7ec92d5`::moving from state init -> state preparing >Thread-4466::INFO::2014-09-09 12:00:22,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4466::INFO::2014-09-09 12:00:22,215::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4466::DEBUG::2014-09-09 12:00:22,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`f22b814a-022a-4636-b318-d621c7ec92d5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4466::DEBUG::2014-09-09 12:00:22,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`f22b814a-022a-4636-b318-d621c7ec92d5`::moving from state preparing -> state finished >Thread-4466::DEBUG::2014-09-09 12:00:22,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4466::DEBUG::2014-09-09 12:00:22,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4466::DEBUG::2014-09-09 12:00:22,216::task::993::Storage.TaskManager.Task::(_decref) Task=`f22b814a-022a-4636-b318-d621c7ec92d5`::ref 0 aborting False >Thread-4466::DEBUG::2014-09-09 12:00:22,216::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4466::DEBUG::2014-09-09 12:00:22,216::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:22,247::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:22,248::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4467::DEBUG::2014-09-09 12:00:22,248::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4467::DEBUG::2014-09-09 12:00:22,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9416eaf-4ae6-44ea-9d92-09ccd586da0d`::moving from state init -> state preparing >Thread-4467::INFO::2014-09-09 12:00:22,249::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4467::DEBUG::2014-09-09 12:00:22,249::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`70880ab3-bcb3-45ad-977c-755453399853`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4467::DEBUG::2014-09-09 12:00:22,249::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4467::DEBUG::2014-09-09 12:00:22,249::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4467::DEBUG::2014-09-09 12:00:22,249::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`70880ab3-bcb3-45ad-977c-755453399853`::Granted request >Thread-4467::DEBUG::2014-09-09 12:00:22,249::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9416eaf-4ae6-44ea-9d92-09ccd586da0d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4467::DEBUG::2014-09-09 12:00:22,250::task::993::Storage.TaskManager.Task::(_decref) Task=`d9416eaf-4ae6-44ea-9d92-09ccd586da0d`::ref 1 aborting False >Thread-4467::INFO::2014-09-09 12:00:22,251::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4467::DEBUG::2014-09-09 12:00:22,251::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9416eaf-4ae6-44ea-9d92-09ccd586da0d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4467::DEBUG::2014-09-09 12:00:22,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9416eaf-4ae6-44ea-9d92-09ccd586da0d`::moving from state preparing -> state finished >Thread-4467::DEBUG::2014-09-09 12:00:22,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4467::DEBUG::2014-09-09 12:00:22,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4467::DEBUG::2014-09-09 12:00:22,252::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4467::DEBUG::2014-09-09 12:00:22,252::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4467::DEBUG::2014-09-09 12:00:22,252::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4467::DEBUG::2014-09-09 12:00:22,252::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4467::DEBUG::2014-09-09 12:00:22,252::task::993::Storage.TaskManager.Task::(_decref) Task=`d9416eaf-4ae6-44ea-9d92-09ccd586da0d`::ref 0 aborting False >Thread-4467::DEBUG::2014-09-09 12:00:22,252::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4467::DEBUG::2014-09-09 12:00:22,252::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:23,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:23,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4468::DEBUG::2014-09-09 12:00:23,193::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:23,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:23,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900765 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:25,300::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) (9664) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) (9664) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) DEBUG|(9664) Building response >Thread-19::DEBUG::2014-09-09 12:00:25,301::__init__::225::IOProcess::(_processLogs) (9664) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:25,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:25,302::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:00:25,302::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:00:25,308::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00112729 s, 315 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:25,309::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:25,309::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:25,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:25,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:25,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:25,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) (9665) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) (9665) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) DEBUG|(9665) Building response >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) (9665) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:25,310::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:25,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:25,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900256 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:26,199::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:26,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4469::DEBUG::2014-09-09 12:00:26,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`76558906-ffc7-43f9-bd52-2ee097039683`::moving from state init -> state preparing >Thread-4469::INFO::2014-09-09 12:00:26,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4469::INFO::2014-09-09 12:00:26,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111339', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939894', 'lastCheck': '8.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112729', 'lastCheck': '0.9', 'valid': True}} >Thread-4469::DEBUG::2014-09-09 12:00:26,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`76558906-ffc7-43f9-bd52-2ee097039683`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111339', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939894', 'lastCheck': '8.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112729', 'lastCheck': '0.9', 'valid': True}} >Thread-4469::DEBUG::2014-09-09 12:00:26,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`76558906-ffc7-43f9-bd52-2ee097039683`::moving from state preparing -> state finished >Thread-4469::DEBUG::2014-09-09 12:00:26,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4469::DEBUG::2014-09-09 12:00:26,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4469::DEBUG::2014-09-09 12:00:26,203::task::993::Storage.TaskManager.Task::(_decref) Task=`76558906-ffc7-43f9-bd52-2ee097039683`::ref 0 aborting False >Thread-4469::DEBUG::2014-09-09 12:00:26,204::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:26,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:26,212::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4470::DEBUG::2014-09-09 12:00:26,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:00:27,446::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:27,446::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:27,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:27,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:27,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:27,447::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:27,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-24::DEBUG::2014-09-09 12:00:27,447::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:27,448::__init__::225::IOProcess::(_processLogs) (9666) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:27,453::__init__::225::IOProcess::(_processLogs) (9666) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:27,453::__init__::225::IOProcess::(_processLogs) (9666) Building response >Thread-19::DEBUG::2014-09-09 12:00:27,453::__init__::225::IOProcess::(_processLogs) (9666) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:27,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:27,453::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:00:27,455::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000894523 s, 613 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:27,456::__init__::225::IOProcess::(_processLogs) (9667) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:27,457::__init__::225::IOProcess::(_processLogs) (9667) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:27,457::__init__::225::IOProcess::(_processLogs) DEBUG|(9667) Building response >Thread-19::DEBUG::2014-09-09 12:00:27,457::__init__::225::IOProcess::(_processLogs) (9667) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:27,457::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:27,458::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:00:27,458::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:27,458::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:00:27,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:27,458::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:27,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) (9668) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) (9668) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) (9668) Building response >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) (9668) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:00:27,459::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) (9669) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) (9669) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) (9669) Building response >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) (9669) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:27,460::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:27,461::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:27,461::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:00:27,461::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:27,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) (9670) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) (9670) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) (9670) Building response >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) (9670) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:27,462::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:00:27,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:27,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904915 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:29,281::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:29,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4471::DEBUG::2014-09-09 12:00:29,283::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:29,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:29,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897052 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:30,690::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:30,690::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:30,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:30,690::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) (9671) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) (9671) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) Message size is 169DEBUG|(9671) Building response >Thread-19::DEBUG::2014-09-09 12:00:30,691::__init__::225::IOProcess::(_processLogs) (9671) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:30,692::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:00:30,692::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:30,692::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:00:30,699::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107408 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) (9672) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:30,700::__init__::225::IOProcess::(_processLogs) (9672) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:30,701::__init__::225::IOProcess::(_processLogs) DEBUG|(9672) Building response >Thread-19::DEBUG::2014-09-09 12:00:30,701::__init__::225::IOProcess::(_processLogs) (9672) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:30,701::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:30,702::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:31,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:31,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902194 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:32,290::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:32,291::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4472::DEBUG::2014-09-09 12:00:32,291::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4472::DEBUG::2014-09-09 12:00:32,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`19c0301d-23ca-4abc-8b2f-aa210a7ff5ee`::moving from state init -> state preparing >Thread-4472::INFO::2014-09-09 12:00:32,292::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4472::INFO::2014-09-09 12:00:32,292::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4472::DEBUG::2014-09-09 12:00:32,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`19c0301d-23ca-4abc-8b2f-aa210a7ff5ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4472::DEBUG::2014-09-09 12:00:32,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`19c0301d-23ca-4abc-8b2f-aa210a7ff5ee`::moving from state preparing -> state finished >Thread-4472::DEBUG::2014-09-09 12:00:32,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4472::DEBUG::2014-09-09 12:00:32,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4472::DEBUG::2014-09-09 12:00:32,293::task::993::Storage.TaskManager.Task::(_decref) Task=`19c0301d-23ca-4abc-8b2f-aa210a7ff5ee`::ref 0 aborting False >Thread-4472::DEBUG::2014-09-09 12:00:32,293::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4472::DEBUG::2014-09-09 12:00:32,293::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:32,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:32,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4473::DEBUG::2014-09-09 12:00:32,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:32,346::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4474::DEBUG::2014-09-09 12:00:32,347::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:00:32,347::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4474::DEBUG::2014-09-09 12:00:32,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`648b5526-8032-497e-8ac5-ba1f31125889`::moving from state init -> state preparing >Thread-4474::INFO::2014-09-09 12:00:32,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4474::DEBUG::2014-09-09 12:00:32,348::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f6b8be68-3d75-4ff8-a58d-e92de7735ab4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4474::DEBUG::2014-09-09 12:00:32,348::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4474::DEBUG::2014-09-09 12:00:32,348::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4474::DEBUG::2014-09-09 12:00:32,348::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f6b8be68-3d75-4ff8-a58d-e92de7735ab4`::Granted request >Thread-4474::DEBUG::2014-09-09 12:00:32,349::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`648b5526-8032-497e-8ac5-ba1f31125889`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4474::DEBUG::2014-09-09 12:00:32,349::task::993::Storage.TaskManager.Task::(_decref) Task=`648b5526-8032-497e-8ac5-ba1f31125889`::ref 1 aborting False >Thread-4474::INFO::2014-09-09 12:00:32,350::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4474::DEBUG::2014-09-09 12:00:32,350::task::1191::Storage.TaskManager.Task::(prepare) Task=`648b5526-8032-497e-8ac5-ba1f31125889`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4474::DEBUG::2014-09-09 12:00:32,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`648b5526-8032-497e-8ac5-ba1f31125889`::moving from state preparing -> state finished >Thread-4474::DEBUG::2014-09-09 12:00:32,350::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4474::DEBUG::2014-09-09 12:00:32,351::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4474::DEBUG::2014-09-09 12:00:32,351::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4474::DEBUG::2014-09-09 12:00:32,351::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4474::DEBUG::2014-09-09 12:00:32,351::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4474::DEBUG::2014-09-09 12:00:32,351::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4474::DEBUG::2014-09-09 12:00:32,351::task::993::Storage.TaskManager.Task::(_decref) Task=`648b5526-8032-497e-8ac5-ba1f31125889`::ref 0 aborting False >Thread-4474::DEBUG::2014-09-09 12:00:32,351::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4474::DEBUG::2014-09-09 12:00:32,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:33,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:34,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089647 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:35,304::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:35,305::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4475::DEBUG::2014-09-09 12:00:35,306::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:00:35,311::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:35,311::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) (9673) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:35,312::__init__::225::IOProcess::(_processLogs) (9673) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:35,314::__init__::225::IOProcess::(_processLogs) DEBUG|(9673) Building response >Thread-19::DEBUG::2014-09-09 12:00:35,314::__init__::225::IOProcess::(_processLogs) (9673) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:35,314::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:00:35,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:35,315::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:00:35,322::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000914267 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:35,323::__init__::225::IOProcess::(_processLogs) (9674) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:35,324::__init__::225::IOProcess::(_processLogs) (9674) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:35,324::__init__::225::IOProcess::(_processLogs) DEBUG|(9674) Building response >Thread-19::DEBUG::2014-09-09 12:00:35,324::__init__::225::IOProcess::(_processLogs) (9674) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:35,324::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:35,325::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:36,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:36,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902766 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:37,462::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:37,462::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:37,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:37,462::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:37,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:37,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:37,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:37,463::__init__::225::IOProcess::(_processLogs) (9675) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:37,463::__init__::225::IOProcess::(_processLogs) (9675) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:37,463::__init__::225::IOProcess::(_processLogs) DEBUG|(9675) Building response >Thread-24::DEBUG::2014-09-09 12:00:37,463::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:37,464::__init__::225::IOProcess::(_processLogs) (9675) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:37,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:37,469::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:00:37,472::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00124522 s, 440 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:37,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:37,472::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:37,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) (9676) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) (9676) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) DEBUG|(9676) Building response >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) (9676) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:37,473::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:37,474::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:00:37,474::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:37,474::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:00:37,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) (9677) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) (9677) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) (9677) Building response >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) (9677) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:37,475::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:37,476::__init__::225::IOProcess::(_processLogs) (9678) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) (9678) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) (9678) Building response >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) (9678) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:37,477::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) (9679) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) (9679) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) (9679) Building response >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) (9679) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:37,478::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:00:38,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:38,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897758 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:38,319::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:38,320::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4476::DEBUG::2014-09-09 12:00:38,322::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:40,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:40,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904293 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:40,702::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:40,702::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:40,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:40,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:40,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:40,703::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:40,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:40,703::__init__::225::IOProcess::(_processLogs) (9680) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:40,703::__init__::225::IOProcess::(_processLogs) (9680) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:40,704::__init__::225::IOProcess::(_processLogs) DEBUG|(9680) Building response >Thread-19::DEBUG::2014-09-09 12:00:40,704::__init__::225::IOProcess::(_processLogs) (9680) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:40,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:40,704::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:00:40,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:00:40,712::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108744 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:40,712::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) (9681) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:40,713::__init__::225::IOProcess::(_processLogs) (9681) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:40,714::__init__::225::IOProcess::(_processLogs) DEBUG|(9681) Building response >Thread-19::DEBUG::2014-09-09 12:00:40,714::__init__::225::IOProcess::(_processLogs) (9681) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:40,714::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:40,714::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:41,334::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:41,335::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4477::DEBUG::2014-09-09 12:00:41,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5a0cec9-5d8e-49a8-b9c2-b714a205cbbd`::moving from state init -> state preparing >Thread-4477::INFO::2014-09-09 12:00:41,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4477::INFO::2014-09-09 12:00:41,336::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108744', 'lastCheck': '0.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00124522', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000914267', 'lastCheck': '6.0', 'valid': True}} >Thread-4477::DEBUG::2014-09-09 12:00:41,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5a0cec9-5d8e-49a8-b9c2-b714a205cbbd`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108744', 'lastCheck': '0.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00124522', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000914267', 'lastCheck': '6.0', 'valid': True}} >Thread-4477::DEBUG::2014-09-09 12:00:41,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5a0cec9-5d8e-49a8-b9c2-b714a205cbbd`::moving from state preparing -> state finished >Thread-4477::DEBUG::2014-09-09 12:00:41,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4477::DEBUG::2014-09-09 12:00:41,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4477::DEBUG::2014-09-09 12:00:41,337::task::993::Storage.TaskManager.Task::(_decref) Task=`c5a0cec9-5d8e-49a8-b9c2-b714a205cbbd`::ref 0 aborting False >Thread-4477::DEBUG::2014-09-09 12:00:41,337::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:41,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:41,351::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4478::DEBUG::2014-09-09 12:00:41,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:42,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:42,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897192 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:42,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4479::DEBUG::2014-09-09 12:00:42,575::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:00:42,575::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4479::DEBUG::2014-09-09 12:00:42,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fa2094b-0646-4221-9b52-5506e918204f`::moving from state init -> state preparing >Thread-4479::INFO::2014-09-09 12:00:42,576::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4479::INFO::2014-09-09 12:00:42,576::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4479::DEBUG::2014-09-09 12:00:42,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fa2094b-0646-4221-9b52-5506e918204f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4479::DEBUG::2014-09-09 12:00:42,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fa2094b-0646-4221-9b52-5506e918204f`::moving from state preparing -> state finished >Thread-4479::DEBUG::2014-09-09 12:00:42,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4479::DEBUG::2014-09-09 12:00:42,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4479::DEBUG::2014-09-09 12:00:42,577::task::993::Storage.TaskManager.Task::(_decref) Task=`7fa2094b-0646-4221-9b52-5506e918204f`::ref 0 aborting False >Thread-4479::DEBUG::2014-09-09 12:00:42,577::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4479::DEBUG::2014-09-09 12:00:42,577::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:42,630::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:42,630::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4480::DEBUG::2014-09-09 12:00:42,630::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4480::DEBUG::2014-09-09 12:00:42,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`a500b509-50a9-414c-aee9-3f04620d7d73`::moving from state init -> state preparing >Thread-4480::INFO::2014-09-09 12:00:42,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4480::DEBUG::2014-09-09 12:00:42,631::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d2c877a5-baa2-45f5-9c3d-152d9ec8c900`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4480::DEBUG::2014-09-09 12:00:42,631::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4480::DEBUG::2014-09-09 12:00:42,632::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4480::DEBUG::2014-09-09 12:00:42,632::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d2c877a5-baa2-45f5-9c3d-152d9ec8c900`::Granted request >Thread-4480::DEBUG::2014-09-09 12:00:42,632::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a500b509-50a9-414c-aee9-3f04620d7d73`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4480::DEBUG::2014-09-09 12:00:42,632::task::993::Storage.TaskManager.Task::(_decref) Task=`a500b509-50a9-414c-aee9-3f04620d7d73`::ref 1 aborting False >Thread-4480::INFO::2014-09-09 12:00:42,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4480::DEBUG::2014-09-09 12:00:42,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`a500b509-50a9-414c-aee9-3f04620d7d73`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4480::DEBUG::2014-09-09 12:00:42,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`a500b509-50a9-414c-aee9-3f04620d7d73`::moving from state preparing -> state finished >Thread-4480::DEBUG::2014-09-09 12:00:42,634::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4480::DEBUG::2014-09-09 12:00:42,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4480::DEBUG::2014-09-09 12:00:42,634::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4480::DEBUG::2014-09-09 12:00:42,634::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4480::DEBUG::2014-09-09 12:00:42,634::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4480::DEBUG::2014-09-09 12:00:42,634::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4480::DEBUG::2014-09-09 12:00:42,634::task::993::Storage.TaskManager.Task::(_decref) Task=`a500b509-50a9-414c-aee9-3f04620d7d73`::ref 0 aborting False >Thread-4480::DEBUG::2014-09-09 12:00:42,635::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4480::DEBUG::2014-09-09 12:00:42,635::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:44,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:44,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090104 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:44,593::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:44,594::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4481::DEBUG::2014-09-09 12:00:44,595::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:00:45,325::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:45,325::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:45,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:45,326::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:45,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:45,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:45,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:45,326::__init__::225::IOProcess::(_processLogs) (9682) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:45,327::__init__::225::IOProcess::(_processLogs) (9682) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:45,327::__init__::225::IOProcess::(_processLogs) DEBUG|(9682) Building response >Thread-19::DEBUG::2014-09-09 12:00:45,327::__init__::225::IOProcess::(_processLogs) (9682) Queuing response >Thread-3443::DEBUG::2014-09-09 12:00:45,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:45,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:45,333::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:00:45,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000934207 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:45,335::__init__::225::IOProcess::(_processLogs) (9683) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:45,336::__init__::225::IOProcess::(_processLogs) (9683) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:45,336::__init__::225::IOProcess::(_processLogs) DEBUG|(9683) Building response >Thread-19::DEBUG::2014-09-09 12:00:45,336::__init__::225::IOProcess::(_processLogs) (9683) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:45,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:45,337::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:46,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:46,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898715 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:47,478::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:47,478::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) (9684) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:47,479::__init__::225::IOProcess::(_processLogs) (9684) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:47,480::__init__::225::IOProcess::(_processLogs) DEBUG|(9684) Building response >Thread-19::DEBUG::2014-09-09 12:00:47,480::__init__::225::IOProcess::(_processLogs) (9684) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:47,480::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:47,481::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:00:47,481::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:00:47,489::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00096616 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:47,489::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) (9685) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) (9685) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) DEBUG|(9685) Building response >Thread-19::DEBUG::2014-09-09 12:00:47,490::__init__::225::IOProcess::(_processLogs) (9685) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:47,491::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:47,491::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:00:47,491::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) (9686) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) (9686) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) DEBUG|(9686) Building response >Thread-19::DEBUG::2014-09-09 12:00:47,492::__init__::225::IOProcess::(_processLogs) (9686) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:47,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:47,494::__init__::225::IOProcess::(_processLogs) (9687) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:47,494::__init__::225::IOProcess::(_processLogs) (9687) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:47,494::__init__::225::IOProcess::(_processLogs) DEBUG|(9687) Building response >Thread-19::DEBUG::2014-09-09 12:00:47,494::__init__::225::IOProcess::(_processLogs) (9687) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:47,494::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:47,494::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:47,495::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:47,495::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:00:47,495::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:47,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:47,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:47,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) (9688) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) (9688) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) (9688) Building response >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) (9688) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:47,496::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:48,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:48,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4482::DEBUG::2014-09-09 12:00:48,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:48,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:48,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904995 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:50,715::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:50,715::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) (9689) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) (9689) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:50,716::__init__::225::IOProcess::(_processLogs) DEBUG|(9689) Building response >Thread-19::DEBUG::2014-09-09 12:00:50,717::__init__::225::IOProcess::(_processLogs) (9689) Queuing response >Thread-23::DEBUG::2014-09-09 12:00:50,717::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:50,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:50,722::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:00:50,724::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011726 s, 958 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) (9690) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:50,725::__init__::225::IOProcess::(_processLogs) (9690) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:50,726::__init__::225::IOProcess::(_processLogs) DEBUG|(9690) Building response >Thread-19::DEBUG::2014-09-09 12:00:50,726::__init__::225::IOProcess::(_processLogs) (9690) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:50,726::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:50,727::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:50,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:50,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896518 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:51,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:51,306::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4483::DEBUG::2014-09-09 12:00:51,307::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:52,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:52,918::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:52,919::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4484::DEBUG::2014-09-09 12:00:52,919::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4484::DEBUG::2014-09-09 12:00:52,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ce6f080-fc3e-4f85-a582-ce090c52f807`::moving from state init -> state preparing >Thread-4484::INFO::2014-09-09 12:00:52,920::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4484::INFO::2014-09-09 12:00:52,920::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4484::DEBUG::2014-09-09 12:00:52,920::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ce6f080-fc3e-4f85-a582-ce090c52f807`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4484::DEBUG::2014-09-09 12:00:52,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ce6f080-fc3e-4f85-a582-ce090c52f807`::moving from state preparing -> state finished >Thread-4484::DEBUG::2014-09-09 12:00:52,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4484::DEBUG::2014-09-09 12:00:52,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4484::DEBUG::2014-09-09 12:00:52,921::task::993::Storage.TaskManager.Task::(_decref) Task=`9ce6f080-fc3e-4f85-a582-ce090c52f807`::ref 0 aborting False >Thread-4484::DEBUG::2014-09-09 12:00:52,921::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4484::DEBUG::2014-09-09 12:00:52,921::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:52,954::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:52,956::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4485::DEBUG::2014-09-09 12:00:52,956::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4485::DEBUG::2014-09-09 12:00:52,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`00f9d9a5-c520-409b-8115-4e80181792e1`::moving from state init -> state preparing >Thread-4485::INFO::2014-09-09 12:00:52,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4485::DEBUG::2014-09-09 12:00:52,960::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`424ab54e-7c0b-4a47-8ed9-c138a0d6a3eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4485::DEBUG::2014-09-09 12:00:52,960::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4485::DEBUG::2014-09-09 12:00:52,961::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4485::DEBUG::2014-09-09 12:00:52,961::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`424ab54e-7c0b-4a47-8ed9-c138a0d6a3eb`::Granted request >Thread-4485::DEBUG::2014-09-09 12:00:52,962::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`00f9d9a5-c520-409b-8115-4e80181792e1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4485::DEBUG::2014-09-09 12:00:52,963::task::993::Storage.TaskManager.Task::(_decref) Task=`00f9d9a5-c520-409b-8115-4e80181792e1`::ref 1 aborting False >Dummy-97::DEBUG::2014-09-09 12:00:52,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0980622 s, 10.4 MB/s\n'; <rc> = 0 >Thread-4485::INFO::2014-09-09 12:00:52,970::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4485::DEBUG::2014-09-09 12:00:52,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`00f9d9a5-c520-409b-8115-4e80181792e1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4485::DEBUG::2014-09-09 12:00:52,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`00f9d9a5-c520-409b-8115-4e80181792e1`::moving from state preparing -> state finished >Thread-4485::DEBUG::2014-09-09 12:00:52,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4485::DEBUG::2014-09-09 12:00:52,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4485::DEBUG::2014-09-09 12:00:52,973::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4485::DEBUG::2014-09-09 12:00:52,973::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4485::DEBUG::2014-09-09 12:00:52,974::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4485::DEBUG::2014-09-09 12:00:52,974::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4485::DEBUG::2014-09-09 12:00:52,975::task::993::Storage.TaskManager.Task::(_decref) Task=`00f9d9a5-c520-409b-8115-4e80181792e1`::ref 0 aborting False >Thread-4485::DEBUG::2014-09-09 12:00:52,975::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4485::DEBUG::2014-09-09 12:00:52,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:54,320::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:54,321::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4486::DEBUG::2014-09-09 12:00:54,322::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:00:54,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:55,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897797 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:55,337::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:55,337::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:55,337::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:55,337::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:55,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:55,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:55,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:55,338::__init__::225::IOProcess::(_processLogs) (9691) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:55,338::__init__::225::IOProcess::(_processLogs) (9691) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:55,338::__init__::225::IOProcess::(_processLogs) DEBUG|(9691) Building response >Thread-19::DEBUG::2014-09-09 12:00:55,338::__init__::225::IOProcess::(_processLogs) (9691) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:55,338::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:00:55,339::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:55,339::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:00:55,346::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000888345 s, 400 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:55,346::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:55,346::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:00:55,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:55,346::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:55,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) (9692) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) (9692) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) DEBUG|(9692) Building response >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) (9692) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:55,347::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:55,348::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:00:57,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:57,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.090071 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:57,335::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:57,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4487::DEBUG::2014-09-09 12:00:57,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`58be634b-668e-4908-9df6-253758706c0f`::moving from state init -> state preparing >Thread-4487::INFO::2014-09-09 12:00:57,338::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4487::INFO::2014-09-09 12:00:57,338::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011726', 'lastCheck': '6.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096616', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000888345', 'lastCheck': '2.0', 'valid': True}} >Thread-4487::DEBUG::2014-09-09 12:00:57,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`58be634b-668e-4908-9df6-253758706c0f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011726', 'lastCheck': '6.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096616', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000888345', 'lastCheck': '2.0', 'valid': True}} >Thread-4487::DEBUG::2014-09-09 12:00:57,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`58be634b-668e-4908-9df6-253758706c0f`::moving from state preparing -> state finished >Thread-4487::DEBUG::2014-09-09 12:00:57,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4487::DEBUG::2014-09-09 12:00:57,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4487::DEBUG::2014-09-09 12:00:57,338::task::993::Storage.TaskManager.Task::(_decref) Task=`58be634b-668e-4908-9df6-253758706c0f`::ref 0 aborting False >Thread-4487::DEBUG::2014-09-09 12:00:57,339::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:00:57,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:00:57,355::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4488::DEBUG::2014-09-09 12:00:57,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) (9693) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:57,496::__init__::225::IOProcess::(_processLogs) (9693) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:57,497::__init__::225::IOProcess::(_processLogs) DEBUG|(9693) Building response >Thread-19::DEBUG::2014-09-09 12:00:57,497::__init__::225::IOProcess::(_processLogs) (9693) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:57,497::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:00:57,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:00:57,497::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:00:57,506::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00093393 s, 587 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:00:57,506::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:57,506::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:00:57,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:57,506::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) (9694) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) (9694) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) DEBUG|(9694) Building response >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) (9694) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:57,507::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:00:57,508::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:00:57,508::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:57,508::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:00:57,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) (9695) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) (9695) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) (9695) Building response >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) (9695) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:57,509::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:57,510::__init__::225::IOProcess::(_processLogs) (9696) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) (9696) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) (9696) Building response >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) (9696) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:00:57,511::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) (9697) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) (9697) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) (9697) Building response >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) (9697) Queuing response >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:00:57,512::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:00:59,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:00:59,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896581 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:00,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:00,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4489::DEBUG::2014-09-09 12:01:00,492::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:00,727::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:00,727::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:00,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:00,727::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:00,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) (9698) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) (9698) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) DEBUG|(9698) Building response >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) (9698) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:00,728::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:00,729::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:01:00,729::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:01:00,736::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114323 s, 982 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:00,737::__init__::225::IOProcess::(_processLogs) (9699) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:00,738::__init__::225::IOProcess::(_processLogs) (9699) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:00,738::__init__::225::IOProcess::(_processLogs) DEBUG|(9699) Building response >Thread-19::DEBUG::2014-09-09 12:01:00,738::__init__::225::IOProcess::(_processLogs) (9699) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:00,738::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:00,738::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:01,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:01,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0906573 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:03,017::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4490::DEBUG::2014-09-09 12:01:03,018::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:01:03,018::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4490::DEBUG::2014-09-09 12:01:03,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8b81bb6-210b-45d4-8804-d3756b89bef5`::moving from state init -> state preparing >Thread-4490::INFO::2014-09-09 12:01:03,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4490::INFO::2014-09-09 12:01:03,019::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4490::DEBUG::2014-09-09 12:01:03,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8b81bb6-210b-45d4-8804-d3756b89bef5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4490::DEBUG::2014-09-09 12:01:03,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8b81bb6-210b-45d4-8804-d3756b89bef5`::moving from state preparing -> state finished >Thread-4490::DEBUG::2014-09-09 12:01:03,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4490::DEBUG::2014-09-09 12:01:03,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4490::DEBUG::2014-09-09 12:01:03,020::task::993::Storage.TaskManager.Task::(_decref) Task=`f8b81bb6-210b-45d4-8804-d3756b89bef5`::ref 0 aborting False >Thread-4490::DEBUG::2014-09-09 12:01:03,020::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4490::DEBUG::2014-09-09 12:01:03,020::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:03,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:03,199::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4491::DEBUG::2014-09-09 12:01:03,199::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4491::DEBUG::2014-09-09 12:01:03,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`da09c5c9-e2b7-4021-83ae-1aef602423cd`::moving from state init -> state preparing >Thread-4491::INFO::2014-09-09 12:01:03,200::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4491::DEBUG::2014-09-09 12:01:03,200::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d8d02f45-a709-4e70-a908-cfb561869b76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4491::DEBUG::2014-09-09 12:01:03,200::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4491::DEBUG::2014-09-09 12:01:03,200::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4491::DEBUG::2014-09-09 12:01:03,200::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d8d02f45-a709-4e70-a908-cfb561869b76`::Granted request >Thread-4491::DEBUG::2014-09-09 12:01:03,200::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`da09c5c9-e2b7-4021-83ae-1aef602423cd`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4491::DEBUG::2014-09-09 12:01:03,200::task::993::Storage.TaskManager.Task::(_decref) Task=`da09c5c9-e2b7-4021-83ae-1aef602423cd`::ref 1 aborting False >Thread-4491::INFO::2014-09-09 12:01:03,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4491::DEBUG::2014-09-09 12:01:03,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`da09c5c9-e2b7-4021-83ae-1aef602423cd`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4491::DEBUG::2014-09-09 12:01:03,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`da09c5c9-e2b7-4021-83ae-1aef602423cd`::moving from state preparing -> state finished >Thread-4491::DEBUG::2014-09-09 12:01:03,202::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4491::DEBUG::2014-09-09 12:01:03,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4491::DEBUG::2014-09-09 12:01:03,203::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4491::DEBUG::2014-09-09 12:01:03,203::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4491::DEBUG::2014-09-09 12:01:03,203::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4491::DEBUG::2014-09-09 12:01:03,203::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4491::DEBUG::2014-09-09 12:01:03,203::task::993::Storage.TaskManager.Task::(_decref) Task=`da09c5c9-e2b7-4021-83ae-1aef602423cd`::ref 0 aborting False >Thread-4491::DEBUG::2014-09-09 12:01:03,203::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4491::DEBUG::2014-09-09 12:01:03,203::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:03,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:03,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897077 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:03,506::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:03,506::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4492::DEBUG::2014-09-09 12:01:03,507::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:05,348::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) (9700) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) (9700) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:05,349::__init__::225::IOProcess::(_processLogs) DEBUG|(9700) Building response >Thread-19::DEBUG::2014-09-09 12:01:05,350::__init__::225::IOProcess::(_processLogs) (9700) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:05,350::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:05,350::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:01:05,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:01:05,358::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000878007 s, 404 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:05,358::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:05,358::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:05,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) (9701) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) (9701) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) DEBUG|(9701) Building response >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) (9701) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:05,359::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:05,360::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:05,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:05,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897137 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:06,516::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:06,517::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4493::DEBUG::2014-09-09 12:01:06,518::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:07,512::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:07,512::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) (9702) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:07,513::__init__::225::IOProcess::(_processLogs) (9702) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:07,514::__init__::225::IOProcess::(_processLogs) DEBUG|(9702) Building response >Thread-19::DEBUG::2014-09-09 12:01:07,514::__init__::225::IOProcess::(_processLogs) (9702) Queuing response >Thread-24::DEBUG::2014-09-09 12:01:07,514::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:07,515::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:07,520::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:01:07,522::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000988614 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:07,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:07,522::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) (9703) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) (9703) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) DEBUG|(9703) Building response >Thread-19::DEBUG::2014-09-09 12:01:07,523::__init__::225::IOProcess::(_processLogs) (9703) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:07,524::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:07,524::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:01:07,524::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:07,524::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:01:07,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) (9704) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) (9704) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) (9704) Building response >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) (9704) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:07,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:07,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) (9705) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) (9705) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) (9705) Building response >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) (9705) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:01:07,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) (9706) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) (9706) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) DEBUG|(9706) Building response >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) (9706) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:07,528::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:07,529::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:01:07,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:07,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898124 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:09,524::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:09,525::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4494::DEBUG::2014-09-09 12:01:09,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:09,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:09,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898051 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:10,739::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:10,739::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) (9707) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:10,740::__init__::225::IOProcess::(_processLogs) (9707) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:10,741::__init__::225::IOProcess::(_processLogs) DEBUG|(9707) Building response >Thread-19::DEBUG::2014-09-09 12:01:10,741::__init__::225::IOProcess::(_processLogs) (9707) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:10,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:10,742::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:01:10,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:01:10,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110858 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:10,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:10,751::__init__::225::IOProcess::(_processLogs) (9708) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:10,751::__init__::225::IOProcess::(_processLogs) (9708) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:10,751::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9708) Building response >Thread-19::DEBUG::2014-09-09 12:01:10,752::__init__::225::IOProcess::(_processLogs) (9708) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:10,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:10,752::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:11,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:11,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897848 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:12,533::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:12,533::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4495::DEBUG::2014-09-09 12:01:12,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`f030b20a-c7be-4f6f-b719-e92b6e43fc3b`::moving from state init -> state preparing >Thread-4495::INFO::2014-09-09 12:01:12,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4495::INFO::2014-09-09 12:01:12,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110858', 'lastCheck': '1.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000988614', 'lastCheck': '5.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878007', 'lastCheck': '7.2', 'valid': True}} >Thread-4495::DEBUG::2014-09-09 12:01:12,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`f030b20a-c7be-4f6f-b719-e92b6e43fc3b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110858', 'lastCheck': '1.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000988614', 'lastCheck': '5.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878007', 'lastCheck': '7.2', 'valid': True}} >Thread-4495::DEBUG::2014-09-09 12:01:12,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`f030b20a-c7be-4f6f-b719-e92b6e43fc3b`::moving from state preparing -> state finished >Thread-4495::DEBUG::2014-09-09 12:01:12,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4495::DEBUG::2014-09-09 12:01:12,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4495::DEBUG::2014-09-09 12:01:12,535::task::993::Storage.TaskManager.Task::(_decref) Task=`f030b20a-c7be-4f6f-b719-e92b6e43fc3b`::ref 0 aborting False >Thread-4495::DEBUG::2014-09-09 12:01:12,536::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:12,545::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:12,546::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4496::DEBUG::2014-09-09 12:01:12,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:13,600::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4497::DEBUG::2014-09-09 12:01:13,600::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:01:13,601::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4497::DEBUG::2014-09-09 12:01:13,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c7bc3d6-0761-4767-b1ca-1e67329ab6dc`::moving from state init -> state preparing >Thread-4497::INFO::2014-09-09 12:01:13,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4497::INFO::2014-09-09 12:01:13,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4497::DEBUG::2014-09-09 12:01:13,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c7bc3d6-0761-4767-b1ca-1e67329ab6dc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4497::DEBUG::2014-09-09 12:01:13,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c7bc3d6-0761-4767-b1ca-1e67329ab6dc`::moving from state preparing -> state finished >Thread-4497::DEBUG::2014-09-09 12:01:13,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4497::DEBUG::2014-09-09 12:01:13,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4497::DEBUG::2014-09-09 12:01:13,602::task::993::Storage.TaskManager.Task::(_decref) Task=`4c7bc3d6-0761-4767-b1ca-1e67329ab6dc`::ref 0 aborting False >Thread-4497::DEBUG::2014-09-09 12:01:13,602::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4497::DEBUG::2014-09-09 12:01:13,603::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:13,883::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:13,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4498::DEBUG::2014-09-09 12:01:13,883::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4498::DEBUG::2014-09-09 12:01:13,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bb2d184-05b2-42d1-8d3a-17c81552625f`::moving from state init -> state preparing >Thread-4498::INFO::2014-09-09 12:01:13,884::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4498::DEBUG::2014-09-09 12:01:13,884::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`21ae66ba-54f9-47d8-a0f6-49cc4a636085`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4498::DEBUG::2014-09-09 12:01:13,884::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4498::DEBUG::2014-09-09 12:01:13,885::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4498::DEBUG::2014-09-09 12:01:13,885::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`21ae66ba-54f9-47d8-a0f6-49cc4a636085`::Granted request >Thread-4498::DEBUG::2014-09-09 12:01:13,885::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3bb2d184-05b2-42d1-8d3a-17c81552625f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4498::DEBUG::2014-09-09 12:01:13,885::task::993::Storage.TaskManager.Task::(_decref) Task=`3bb2d184-05b2-42d1-8d3a-17c81552625f`::ref 1 aborting False >Thread-4498::INFO::2014-09-09 12:01:13,887::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4498::DEBUG::2014-09-09 12:01:13,887::task::1191::Storage.TaskManager.Task::(prepare) Task=`3bb2d184-05b2-42d1-8d3a-17c81552625f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4498::DEBUG::2014-09-09 12:01:13,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bb2d184-05b2-42d1-8d3a-17c81552625f`::moving from state preparing -> state finished >Thread-4498::DEBUG::2014-09-09 12:01:13,887::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4498::DEBUG::2014-09-09 12:01:13,887::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4498::DEBUG::2014-09-09 12:01:13,887::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4498::DEBUG::2014-09-09 12:01:13,887::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4498::DEBUG::2014-09-09 12:01:13,887::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4498::DEBUG::2014-09-09 12:01:13,887::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4498::DEBUG::2014-09-09 12:01:13,888::task::993::Storage.TaskManager.Task::(_decref) Task=`3bb2d184-05b2-42d1-8d3a-17c81552625f`::ref 0 aborting False >Thread-4498::DEBUG::2014-09-09 12:01:13,888::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4498::DEBUG::2014-09-09 12:01:13,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:13,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:14,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895723 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) (9709) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:15,361::__init__::225::IOProcess::(_processLogs) (9709) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:15,362::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9709) Building response >Thread-3443::DEBUG::2014-09-09 12:01:15,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:15,362::__init__::225::IOProcess::(_processLogs) (9709) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:15,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:15,367::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:01:15,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000847757 s, 419 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:15,370::__init__::225::IOProcess::(_processLogs) (9710) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:15,371::__init__::225::IOProcess::(_processLogs) (9710) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:15,371::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9710) Building response >Thread-19::DEBUG::2014-09-09 12:01:15,371::__init__::225::IOProcess::(_processLogs) (9710) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:15,371::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:15,372::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:16,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:16,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896573 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:16,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:16,221::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4499::DEBUG::2014-09-09 12:01:16,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:17,529::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:17,529::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:17,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:17,530::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:17,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:17,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:17,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:17,531::__init__::225::IOProcess::(_processLogs) (9711) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:17,531::__init__::225::IOProcess::(_processLogs) (9711) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:17,531::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9711) Building response >Thread-24::DEBUG::2014-09-09 12:01:17,532::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:17,532::__init__::225::IOProcess::(_processLogs) (9711) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:17,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:17,537::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:01:17,540::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000994474 s, 551 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) (9712) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:17,541::__init__::225::IOProcess::(_processLogs) (9712) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:17,542::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9712) Building response >Thread-19::DEBUG::2014-09-09 12:01:17,542::__init__::225::IOProcess::(_processLogs) (9712) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:17,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:17,542::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:01:17,542::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:17,543::__init__::225::IOProcess::(_processLogs) (9713) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) (9713) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) (9713) Building response >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) (9713) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:17,544::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) (9714) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) (9714) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) (9714) Building response >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) (9714) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:17,545::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:17,546::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:17,546::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:01:17,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:17,546::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:17,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:17,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) (9715) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) (9715) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) (9715) Building response >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) (9715) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:17,547::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:01:18,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:18,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898685 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:19,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:19,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4500::DEBUG::2014-09-09 12:01:19,234::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:20,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:20,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897371 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:20,752::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:20,752::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:20,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:20,752::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:20,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:20,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:20,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:20,753::__init__::225::IOProcess::(_processLogs) (9716) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:20,753::__init__::225::IOProcess::(_processLogs) (9716) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:20,753::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9716) Building response >Thread-19::DEBUG::2014-09-09 12:01:20,754::__init__::225::IOProcess::(_processLogs) (9716) Queuing response >Thread-23::DEBUG::2014-09-09 12:01:20,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:20,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:20,759::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:01:20,761::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104148 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:20,761::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:20,761::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:20,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) (9717) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) (9717) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9717) Building response >Thread-19::DEBUG::2014-09-09 12:01:20,762::__init__::225::IOProcess::(_processLogs) (9717) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:20,763::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:20,763::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:22,241::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:22,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4501::DEBUG::2014-09-09 12:01:22,243::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:22,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:22,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899312 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:24,351::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:24,352::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4502::DEBUG::2014-09-09 12:01:24,352::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4502::DEBUG::2014-09-09 12:01:24,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`65de196c-2019-49bb-ae1d-e141a68e7612`::moving from state init -> state preparing >Thread-4502::INFO::2014-09-09 12:01:24,353::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4502::INFO::2014-09-09 12:01:24,353::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4502::DEBUG::2014-09-09 12:01:24,353::task::1191::Storage.TaskManager.Task::(prepare) Task=`65de196c-2019-49bb-ae1d-e141a68e7612`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4502::DEBUG::2014-09-09 12:01:24,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`65de196c-2019-49bb-ae1d-e141a68e7612`::moving from state preparing -> state finished >Thread-4502::DEBUG::2014-09-09 12:01:24,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4502::DEBUG::2014-09-09 12:01:24,353::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4502::DEBUG::2014-09-09 12:01:24,353::task::993::Storage.TaskManager.Task::(_decref) Task=`65de196c-2019-49bb-ae1d-e141a68e7612`::ref 0 aborting False >Thread-4502::DEBUG::2014-09-09 12:01:24,354::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4502::DEBUG::2014-09-09 12:01:24,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:24,425::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:24,425::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4503::DEBUG::2014-09-09 12:01:24,425::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4503::DEBUG::2014-09-09 12:01:24,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f064ff0-b62f-4d95-8a06-beecffdea69f`::moving from state init -> state preparing >Thread-4503::INFO::2014-09-09 12:01:24,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4503::DEBUG::2014-09-09 12:01:24,426::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`822ba58d-7ae5-45a0-8af8-a34fe47e1fa7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4503::DEBUG::2014-09-09 12:01:24,426::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4503::DEBUG::2014-09-09 12:01:24,427::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4503::DEBUG::2014-09-09 12:01:24,427::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`822ba58d-7ae5-45a0-8af8-a34fe47e1fa7`::Granted request >Thread-4503::DEBUG::2014-09-09 12:01:24,427::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6f064ff0-b62f-4d95-8a06-beecffdea69f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4503::DEBUG::2014-09-09 12:01:24,427::task::993::Storage.TaskManager.Task::(_decref) Task=`6f064ff0-b62f-4d95-8a06-beecffdea69f`::ref 1 aborting False >Thread-4503::INFO::2014-09-09 12:01:24,429::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4503::DEBUG::2014-09-09 12:01:24,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f064ff0-b62f-4d95-8a06-beecffdea69f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4503::DEBUG::2014-09-09 12:01:24,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f064ff0-b62f-4d95-8a06-beecffdea69f`::moving from state preparing -> state finished >Thread-4503::DEBUG::2014-09-09 12:01:24,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4503::DEBUG::2014-09-09 12:01:24,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4503::DEBUG::2014-09-09 12:01:24,429::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4503::DEBUG::2014-09-09 12:01:24,429::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4503::DEBUG::2014-09-09 12:01:24,429::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4503::DEBUG::2014-09-09 12:01:24,429::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4503::DEBUG::2014-09-09 12:01:24,429::task::993::Storage.TaskManager.Task::(_decref) Task=`6f064ff0-b62f-4d95-8a06-beecffdea69f`::ref 0 aborting False >Thread-4503::DEBUG::2014-09-09 12:01:24,430::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4503::DEBUG::2014-09-09 12:01:24,430::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:24,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:24,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897328 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:25,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:25,253::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4504::DEBUG::2014-09-09 12:01:25,254::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:25,372::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:25,372::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:25,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:25,372::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:25,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:25,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:25,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:25,373::__init__::225::IOProcess::(_processLogs) (9718) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:25,373::__init__::225::IOProcess::(_processLogs) (9718) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:25,373::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9718) Building response >Thread-19::DEBUG::2014-09-09 12:01:25,373::__init__::225::IOProcess::(_processLogs) (9718) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:25,373::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:01:25,374::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:25,374::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:01:25,381::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000930939 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:25,381::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:25,381::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:25,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:25,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:25,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) (9719) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) (9719) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) DEBUG|(9719) Building response >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) (9719) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:25,382::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:25,383::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:26,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:26,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897886 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:27,547::__init__::225::IOProcess::(_processLogs) (9720) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:27,548::__init__::225::IOProcess::(_processLogs) (9720) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:27,548::__init__::225::IOProcess::(_processLogs) DEBUG|(9720) Building response >Thread-19::DEBUG::2014-09-09 12:01:27,548::__init__::225::IOProcess::(_processLogs) (9720) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:27,548::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:01:27,549::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:01:27,549::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:01:27,556::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000971892 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) (9721) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:27,557::__init__::225::IOProcess::(_processLogs) (9721) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:27,558::__init__::225::IOProcess::(_processLogs) DEBUG|(9721) Building response >Thread-19::DEBUG::2014-09-09 12:01:27,558::__init__::225::IOProcess::(_processLogs) (9721) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:27,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:27,558::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:27,559::__init__::225::IOProcess::(_processLogs) (9722) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) (9722) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) (9722) Building response >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) (9722) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:27,560::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) (9723) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) (9723) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) (9723) Building response >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) (9723) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:27,561::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:01:27,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:27,562::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:27,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:27,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:27,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:27,562::__init__::225::IOProcess::(_processLogs) (9724) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:27,563::__init__::225::IOProcess::(_processLogs) (9724) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:27,563::__init__::225::IOProcess::(_processLogs) (9724) Building response >Thread-19::DEBUG::2014-09-09 12:01:27,563::__init__::225::IOProcess::(_processLogs) (9724) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:27,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:27,563::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:28,260::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:28,261::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4505::DEBUG::2014-09-09 12:01:28,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`41c22a3b-936e-4532-acf6-e57258ed4b8c`::moving from state init -> state preparing >Thread-4505::INFO::2014-09-09 12:01:28,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4505::INFO::2014-09-09 12:01:28,262::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104148', 'lastCheck': '7.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971892', 'lastCheck': '0.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000930939', 'lastCheck': '2.9', 'valid': True}} >Thread-4505::DEBUG::2014-09-09 12:01:28,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`41c22a3b-936e-4532-acf6-e57258ed4b8c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104148', 'lastCheck': '7.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971892', 'lastCheck': '0.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000930939', 'lastCheck': '2.9', 'valid': True}} >Thread-4505::DEBUG::2014-09-09 12:01:28,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`41c22a3b-936e-4532-acf6-e57258ed4b8c`::moving from state preparing -> state finished >Thread-4505::DEBUG::2014-09-09 12:01:28,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4505::DEBUG::2014-09-09 12:01:28,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4505::DEBUG::2014-09-09 12:01:28,263::task::993::Storage.TaskManager.Task::(_decref) Task=`41c22a3b-936e-4532-acf6-e57258ed4b8c`::ref 0 aborting False >Thread-4505::DEBUG::2014-09-09 12:01:28,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:28,273::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:28,274::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4506::DEBUG::2014-09-09 12:01:28,274::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:28,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:28,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897668 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:01:30,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:30,764::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:30,769::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) (9725) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) (9725) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:30,770::__init__::225::IOProcess::(_processLogs) DEBUG|(9725) Building response >Thread-23::DEBUG::2014-09-09 12:01:30,771::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:30,771::__init__::225::IOProcess::(_processLogs) (9725) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:30,776::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:30,776::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:01:30,861::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00100859 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:30,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:30,863::__init__::225::IOProcess::(_processLogs) Message size is 147 >Dummy-97::DEBUG::2014-09-09 12:01:30,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904285 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:30,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:30,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:30,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:30,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:30,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:30,866::__init__::225::IOProcess::(_processLogs) (9726) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:30,867::__init__::225::IOProcess::(_processLogs) (9726) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:30,867::__init__::225::IOProcess::(_processLogs) (9726) Building response >Thread-19::DEBUG::2014-09-09 12:01:30,868::__init__::225::IOProcess::(_processLogs) (9726) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:30,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:30,869::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:31,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:31,490::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4507::DEBUG::2014-09-09 12:01:31,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:32,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:32,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895028 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:34,499::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:34,500::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4508::DEBUG::2014-09-09 12:01:34,500::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:34,535::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:34,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4509::DEBUG::2014-09-09 12:01:34,536::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4509::DEBUG::2014-09-09 12:01:34,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5ae31e1-3aa3-4fee-9a53-427b408deb23`::moving from state init -> state preparing >Thread-4509::INFO::2014-09-09 12:01:34,537::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4509::INFO::2014-09-09 12:01:34,537::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4509::DEBUG::2014-09-09 12:01:34,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5ae31e1-3aa3-4fee-9a53-427b408deb23`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4509::DEBUG::2014-09-09 12:01:34,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5ae31e1-3aa3-4fee-9a53-427b408deb23`::moving from state preparing -> state finished >Thread-4509::DEBUG::2014-09-09 12:01:34,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4509::DEBUG::2014-09-09 12:01:34,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4509::DEBUG::2014-09-09 12:01:34,537::task::993::Storage.TaskManager.Task::(_decref) Task=`e5ae31e1-3aa3-4fee-9a53-427b408deb23`::ref 0 aborting False >Thread-4509::DEBUG::2014-09-09 12:01:34,537::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4509::DEBUG::2014-09-09 12:01:34,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:34,592::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4510::DEBUG::2014-09-09 12:01:34,592::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:01:34,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4510::DEBUG::2014-09-09 12:01:34,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c479a81-b30d-4b8f-9d06-625e6d87d997`::moving from state init -> state preparing >Thread-4510::INFO::2014-09-09 12:01:34,593::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4510::DEBUG::2014-09-09 12:01:34,594::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`81649d47-3504-4053-9ad7-754e2b39c519`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4510::DEBUG::2014-09-09 12:01:34,594::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4510::DEBUG::2014-09-09 12:01:34,594::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4510::DEBUG::2014-09-09 12:01:34,594::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`81649d47-3504-4053-9ad7-754e2b39c519`::Granted request >Thread-4510::DEBUG::2014-09-09 12:01:34,595::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3c479a81-b30d-4b8f-9d06-625e6d87d997`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4510::DEBUG::2014-09-09 12:01:34,595::task::993::Storage.TaskManager.Task::(_decref) Task=`3c479a81-b30d-4b8f-9d06-625e6d87d997`::ref 1 aborting False >Thread-4510::INFO::2014-09-09 12:01:34,597::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4510::DEBUG::2014-09-09 12:01:34,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c479a81-b30d-4b8f-9d06-625e6d87d997`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4510::DEBUG::2014-09-09 12:01:34,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c479a81-b30d-4b8f-9d06-625e6d87d997`::moving from state preparing -> state finished >Thread-4510::DEBUG::2014-09-09 12:01:34,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4510::DEBUG::2014-09-09 12:01:34,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4510::DEBUG::2014-09-09 12:01:34,597::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4510::DEBUG::2014-09-09 12:01:34,597::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4510::DEBUG::2014-09-09 12:01:34,597::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4510::DEBUG::2014-09-09 12:01:34,597::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4510::DEBUG::2014-09-09 12:01:34,598::task::993::Storage.TaskManager.Task::(_decref) Task=`3c479a81-b30d-4b8f-9d06-625e6d87d997`::ref 0 aborting False >Thread-4510::DEBUG::2014-09-09 12:01:34,598::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4510::DEBUG::2014-09-09 12:01:34,598::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:34,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:35,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896726 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:35,383::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) (9727) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:35,384::__init__::225::IOProcess::(_processLogs) (9727) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:35,386::__init__::225::IOProcess::(_processLogs) DEBUG|(9727) Building response >Thread-19::DEBUG::2014-09-09 12:01:35,386::__init__::225::IOProcess::(_processLogs) (9727) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:35,386::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:01:35,387::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:35,387::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:01:35,394::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000967461 s, 367 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:35,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:35,396::__init__::225::IOProcess::(_processLogs) (9728) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:35,396::__init__::225::IOProcess::(_processLogs) (9728) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:35,396::__init__::225::IOProcess::(_processLogs) DEBUG|(9728) Building response >Thread-19::DEBUG::2014-09-09 12:01:35,396::__init__::225::IOProcess::(_processLogs) (9728) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:35,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:35,396::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:37,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:37,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900068 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:37,510::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:37,510::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4511::DEBUG::2014-09-09 12:01:37,511::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:37,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) (9729) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) (9729) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) DEBUG|(9729) Building response >Thread-19::DEBUG::2014-09-09 12:01:37,563::__init__::225::IOProcess::(_processLogs) (9729) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:37,564::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:01:37,564::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:01:37,564::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:01:37,572::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000979155 s, 560 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:37,572::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:37,572::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) (9730) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) (9730) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:37,573::__init__::225::IOProcess::(_processLogs) DEBUG|(9730) Building response >Thread-19::DEBUG::2014-09-09 12:01:37,574::__init__::225::IOProcess::(_processLogs) (9730) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:37,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:37,574::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:01:37,574::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:37,574::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:01:37,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) (9731) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) (9731) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) (9731) Building response >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) (9731) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:37,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:37,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) (9732) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) (9732) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) (9732) Building response >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) (9732) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:01:37,577::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) (9733) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) (9733) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) (9733) Building response >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) (9733) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:37,578::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:37,579::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:01:39,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:39,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089751 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:40,518::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:40,519::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4512::DEBUG::2014-09-09 12:01:40,520::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:40,866::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:40,866::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) (9734) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:40,867::__init__::225::IOProcess::(_processLogs) (9734) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:40,868::__init__::225::IOProcess::(_processLogs) DEBUG|(9734) Building response >Thread-19::DEBUG::2014-09-09 12:01:40,868::__init__::225::IOProcess::(_processLogs) (9734) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:40,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:40,868::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:01:40,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:01:40,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113681 s, 988 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:40,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:40,878::__init__::225::IOProcess::(_processLogs) (9735) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:40,878::__init__::225::IOProcess::(_processLogs) (9735) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:40,878::__init__::225::IOProcess::(_processLogs) (9735) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:40,878::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:01:41,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:41,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896291 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:01:43,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:43,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896661 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:43,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:43,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4513::DEBUG::2014-09-09 12:01:43,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`67ef8334-3b6f-4182-aba4-69e5591646d5`::moving from state init -> state preparing >Thread-4513::INFO::2014-09-09 12:01:43,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4513::INFO::2014-09-09 12:01:43,531::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113681', 'lastCheck': '2.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000979155', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000967461', 'lastCheck': '8.1', 'valid': True}} >Thread-4513::DEBUG::2014-09-09 12:01:43,531::task::1191::Storage.TaskManager.Task::(prepare) Task=`67ef8334-3b6f-4182-aba4-69e5591646d5`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113681', 'lastCheck': '2.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000979155', 'lastCheck': '6.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000967461', 'lastCheck': '8.1', 'valid': True}} >Thread-4513::DEBUG::2014-09-09 12:01:43,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`67ef8334-3b6f-4182-aba4-69e5591646d5`::moving from state preparing -> state finished >Thread-4513::DEBUG::2014-09-09 12:01:43,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4513::DEBUG::2014-09-09 12:01:43,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4513::DEBUG::2014-09-09 12:01:43,531::task::993::Storage.TaskManager.Task::(_decref) Task=`67ef8334-3b6f-4182-aba4-69e5591646d5`::ref 0 aborting False >Thread-4513::DEBUG::2014-09-09 12:01:43,532::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:43,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:43,542::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4514::DEBUG::2014-09-09 12:01:43,543::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:44,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:44,971::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4515::DEBUG::2014-09-09 12:01:44,971::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4515::DEBUG::2014-09-09 12:01:44,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b4a6cfc-7a75-4360-804c-dca2ee32f189`::moving from state init -> state preparing >Thread-4515::INFO::2014-09-09 12:01:44,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4515::INFO::2014-09-09 12:01:44,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4515::DEBUG::2014-09-09 12:01:44,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b4a6cfc-7a75-4360-804c-dca2ee32f189`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4515::DEBUG::2014-09-09 12:01:44,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b4a6cfc-7a75-4360-804c-dca2ee32f189`::moving from state preparing -> state finished >Thread-4515::DEBUG::2014-09-09 12:01:44,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4515::DEBUG::2014-09-09 12:01:44,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4515::DEBUG::2014-09-09 12:01:44,972::task::993::Storage.TaskManager.Task::(_decref) Task=`5b4a6cfc-7a75-4360-804c-dca2ee32f189`::ref 0 aborting False >Thread-4515::DEBUG::2014-09-09 12:01:44,972::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4515::DEBUG::2014-09-09 12:01:44,973::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:45,021::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4516::DEBUG::2014-09-09 12:01:45,021::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:01:45,021::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4516::DEBUG::2014-09-09 12:01:45,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`e47ec6f2-26d6-4646-9a52-c854824317aa`::moving from state init -> state preparing >Thread-4516::INFO::2014-09-09 12:01:45,022::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4516::DEBUG::2014-09-09 12:01:45,022::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2ab56778-9bce-4be1-9ba2-54fb4d4a2428`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4516::DEBUG::2014-09-09 12:01:45,022::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4516::DEBUG::2014-09-09 12:01:45,023::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4516::DEBUG::2014-09-09 12:01:45,023::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2ab56778-9bce-4be1-9ba2-54fb4d4a2428`::Granted request >Thread-4516::DEBUG::2014-09-09 12:01:45,023::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e47ec6f2-26d6-4646-9a52-c854824317aa`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4516::DEBUG::2014-09-09 12:01:45,023::task::993::Storage.TaskManager.Task::(_decref) Task=`e47ec6f2-26d6-4646-9a52-c854824317aa`::ref 1 aborting False >Thread-4516::INFO::2014-09-09 12:01:45,025::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4516::DEBUG::2014-09-09 12:01:45,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`e47ec6f2-26d6-4646-9a52-c854824317aa`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4516::DEBUG::2014-09-09 12:01:45,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`e47ec6f2-26d6-4646-9a52-c854824317aa`::moving from state preparing -> state finished >Thread-4516::DEBUG::2014-09-09 12:01:45,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4516::DEBUG::2014-09-09 12:01:45,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4516::DEBUG::2014-09-09 12:01:45,025::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4516::DEBUG::2014-09-09 12:01:45,025::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4516::DEBUG::2014-09-09 12:01:45,025::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4516::DEBUG::2014-09-09 12:01:45,025::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4516::DEBUG::2014-09-09 12:01:45,026::task::993::Storage.TaskManager.Task::(_decref) Task=`e47ec6f2-26d6-4646-9a52-c854824317aa`::ref 0 aborting False >Thread-4516::DEBUG::2014-09-09 12:01:45,026::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283243446272', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4516::DEBUG::2014-09-09 12:01:45,026::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:45,397::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:45,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:45,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:45,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:45,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:45,398::__init__::225::IOProcess::(_processLogs) (9736) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:45,398::__init__::225::IOProcess::(_processLogs) (9736) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:45,398::__init__::225::IOProcess::(_processLogs) (9736) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:45,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:01:45,398::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:01:45,405::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000946463 s, 375 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:45,405::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:45,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:45,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:45,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:45,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:45,406::__init__::225::IOProcess::(_processLogs) (9737) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:45,406::__init__::225::IOProcess::(_processLogs) (9737) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:45,406::__init__::225::IOProcess::(_processLogs) (9737) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:45,406::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:01:45,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:45,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896701 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:46,993::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:46,994::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4517::DEBUG::2014-09-09 12:01:46,995::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:47,578::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:47,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:47,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:47,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:47,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:47,579::__init__::225::IOProcess::(_processLogs) (9738) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:47,579::__init__::225::IOProcess::(_processLogs) (9738) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:47,580::__init__::225::IOProcess::(_processLogs) (9738) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:47,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:01:47,580::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:01:47,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104508 s, 524 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) (9739) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:47,588::__init__::225::IOProcess::(_processLogs) (9739) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:47,589::__init__::225::IOProcess::(_processLogs) (9739) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:47,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:47,589::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) (9740) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) (9740) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:47,590::__init__::225::IOProcess::(_processLogs) (9740) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:47,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) (9741) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:47,592::__init__::225::IOProcess::(_processLogs) (9741) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:47,593::__init__::225::IOProcess::(_processLogs) (9741) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:47,593::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:47,593::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:47,593::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:01:47,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) (9742) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) (9742) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) (9742) Building response >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) (9742) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:47,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:47,595::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:01:47,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:47,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898396 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:01:49,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:49,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0954436 s, 10.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:50,040::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:50,042::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4518::DEBUG::2014-09-09 12:01:50,045::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) (9743) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:50,879::__init__::225::IOProcess::(_processLogs) (9743) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:50,880::__init__::225::IOProcess::(_processLogs) (9743) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:50,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:01:50,880::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:01:50,887::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111818 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:50,887::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:01:50,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:50,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:50,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:50,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:50,888::__init__::225::IOProcess::(_processLogs) (9744) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:50,888::__init__::225::IOProcess::(_processLogs) (9744) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:50,888::__init__::225::IOProcess::(_processLogs) (9744) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:50,888::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:01:51,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:51,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897508 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:53,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:53,054::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4519::DEBUG::2014-09-09 12:01:53,055::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:53,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:54,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0901175 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:55,233::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4520::DEBUG::2014-09-09 12:01:55,233::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:01:55,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4520::DEBUG::2014-09-09 12:01:55,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3a1eaf4-b661-4cb5-8283-94a36ae65130`::moving from state init -> state preparing >Thread-4520::INFO::2014-09-09 12:01:55,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4520::INFO::2014-09-09 12:01:55,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4520::DEBUG::2014-09-09 12:01:55,235::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3a1eaf4-b661-4cb5-8283-94a36ae65130`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4520::DEBUG::2014-09-09 12:01:55,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3a1eaf4-b661-4cb5-8283-94a36ae65130`::moving from state preparing -> state finished >Thread-4520::DEBUG::2014-09-09 12:01:55,235::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4520::DEBUG::2014-09-09 12:01:55,235::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4520::DEBUG::2014-09-09 12:01:55,235::task::993::Storage.TaskManager.Task::(_decref) Task=`e3a1eaf4-b661-4cb5-8283-94a36ae65130`::ref 0 aborting False >Thread-4520::DEBUG::2014-09-09 12:01:55,235::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4520::DEBUG::2014-09-09 12:01:55,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:55,396::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:55,397::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4521::DEBUG::2014-09-09 12:01:55,397::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4521::DEBUG::2014-09-09 12:01:55,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`520d68ae-a266-421c-ae7a-55377b8cca68`::moving from state init -> state preparing >Thread-4521::INFO::2014-09-09 12:01:55,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4521::DEBUG::2014-09-09 12:01:55,398::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d6f4fa33-d5cb-44f7-8ead-8bd6f91882be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4521::DEBUG::2014-09-09 12:01:55,398::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4521::DEBUG::2014-09-09 12:01:55,398::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4521::DEBUG::2014-09-09 12:01:55,398::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d6f4fa33-d5cb-44f7-8ead-8bd6f91882be`::Granted request >Thread-4521::DEBUG::2014-09-09 12:01:55,398::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`520d68ae-a266-421c-ae7a-55377b8cca68`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4521::DEBUG::2014-09-09 12:01:55,399::task::993::Storage.TaskManager.Task::(_decref) Task=`520d68ae-a266-421c-ae7a-55377b8cca68`::ref 1 aborting False >Thread-4521::INFO::2014-09-09 12:01:55,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4521::DEBUG::2014-09-09 12:01:55,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`520d68ae-a266-421c-ae7a-55377b8cca68`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4521::DEBUG::2014-09-09 12:01:55,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`520d68ae-a266-421c-ae7a-55377b8cca68`::moving from state preparing -> state finished >Thread-4521::DEBUG::2014-09-09 12:01:55,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4521::DEBUG::2014-09-09 12:01:55,401::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4521::DEBUG::2014-09-09 12:01:55,401::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4521::DEBUG::2014-09-09 12:01:55,401::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4521::DEBUG::2014-09-09 12:01:55,401::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4521::DEBUG::2014-09-09 12:01:55,401::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4521::DEBUG::2014-09-09 12:01:55,401::task::993::Storage.TaskManager.Task::(_decref) Task=`520d68ae-a266-421c-ae7a-55377b8cca68`::ref 0 aborting False >Thread-4521::DEBUG::2014-09-09 12:01:55,401::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4521::DEBUG::2014-09-09 12:01:55,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:55,407::__init__::225::IOProcess::(_processLogs) (9745) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:55,408::__init__::225::IOProcess::(_processLogs) (9745) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:55,408::__init__::225::IOProcess::(_processLogs) (9745) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:55,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:01:55,408::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:01:55,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0009996 s, 355 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:55,415::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:01:55,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:55,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:55,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:55,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:55,416::__init__::225::IOProcess::(_processLogs) (9746) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:55,416::__init__::225::IOProcess::(_processLogs) (9746) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:55,416::__init__::225::IOProcess::(_processLogs) (9746) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:55,416::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:56,064::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:56,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4522::DEBUG::2014-09-09 12:01:56,065::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:01:56,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:56,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899272 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:57,594::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) (9747) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) (9747) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:57,595::__init__::225::IOProcess::(_processLogs) (9747) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:57,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:01:57,596::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:01:57,604::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000926893 s, 591 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:01:57,604::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:01:57,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:57,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:57,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:57,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:57,605::__init__::225::IOProcess::(_processLogs) (9748) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:01:57,605::__init__::225::IOProcess::(_processLogs) (9748) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:01:57,605::__init__::225::IOProcess::(_processLogs) (9748) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:57,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:57,606::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:01:57,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:01:57,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:57,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:57,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:57,606::__init__::225::IOProcess::(_processLogs) (9749) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) (9749) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) (9749) Building response >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) (9749) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:57,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) (9750) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) (9750) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) (9750) Building response >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) (9750) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:01:57,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:01:57,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:01:57,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:01:57,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:01:57,609::__init__::225::IOProcess::(_processLogs) (9751) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:01:57,609::__init__::225::IOProcess::(_processLogs) (9751) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:01:57,609::__init__::225::IOProcess::(_processLogs) (9751) Building response >Thread-19::DEBUG::2014-09-09 12:01:57,610::__init__::225::IOProcess::(_processLogs) (9751) Queuing response >Thread-19::DEBUG::2014-09-09 12:01:57,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:01:57,610::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:01:58,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:01:58,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897147 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:59,074::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:59,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4523::DEBUG::2014-09-09 12:01:59,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac574bdc-7ff4-42f8-8662-bff64b86ba0b`::moving from state init -> state preparing >Thread-4523::INFO::2014-09-09 12:01:59,076::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4523::INFO::2014-09-09 12:01:59,076::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111818', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926893', 'lastCheck': '1.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009996', 'lastCheck': '3.7', 'valid': True}} >Thread-4523::DEBUG::2014-09-09 12:01:59,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac574bdc-7ff4-42f8-8662-bff64b86ba0b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111818', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000926893', 'lastCheck': '1.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009996', 'lastCheck': '3.7', 'valid': True}} >Thread-4523::DEBUG::2014-09-09 12:01:59,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac574bdc-7ff4-42f8-8662-bff64b86ba0b`::moving from state preparing -> state finished >Thread-4523::DEBUG::2014-09-09 12:01:59,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4523::DEBUG::2014-09-09 12:01:59,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4523::DEBUG::2014-09-09 12:01:59,077::task::993::Storage.TaskManager.Task::(_decref) Task=`ac574bdc-7ff4-42f8-8662-bff64b86ba0b`::ref 0 aborting False >Thread-4523::DEBUG::2014-09-09 12:01:59,077::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:01:59,086::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:01:59,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4524::DEBUG::2014-09-09 12:01:59,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:00,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:00,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900203 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:00,889::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) (9752) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) (9752) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:00,890::__init__::225::IOProcess::(_processLogs) (9752) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:00,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:02:00,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:02:00,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00122513 s, 917 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) (9753) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:00,899::__init__::225::IOProcess::(_processLogs) (9753) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:00,900::__init__::225::IOProcess::(_processLogs) (9753) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:00,900::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:02:02,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:02,445::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:02,446::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4525::DEBUG::2014-09-09 12:02:02,447::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:02,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895976 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:02:04,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:04,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0909271 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:05,417::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:05,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:05,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:05,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:05,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:05,418::__init__::225::IOProcess::(_processLogs) (9754) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:05,418::__init__::225::IOProcess::(_processLogs) (9754) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:05,418::__init__::225::IOProcess::(_processLogs) (9754) Queuing response >Thread-3443::DEBUG::2014-09-09 12:02:05,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:05,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:05,424::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:02:05,426::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000917787 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) (9755) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:05,427::__init__::225::IOProcess::(_processLogs) (9755) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:05,428::__init__::225::IOProcess::(_processLogs) (9755) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:05,428::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:05,455::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:05,456::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4526::DEBUG::2014-09-09 12:02:05,457::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:05,641::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:05,642::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4527::DEBUG::2014-09-09 12:02:05,642::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4527::DEBUG::2014-09-09 12:02:05,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8edb40c-97f1-4223-a19c-94af8808ad70`::moving from state init -> state preparing >Thread-4527::INFO::2014-09-09 12:02:05,643::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4527::INFO::2014-09-09 12:02:05,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4527::DEBUG::2014-09-09 12:02:05,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8edb40c-97f1-4223-a19c-94af8808ad70`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4527::DEBUG::2014-09-09 12:02:05,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8edb40c-97f1-4223-a19c-94af8808ad70`::moving from state preparing -> state finished >Thread-4527::DEBUG::2014-09-09 12:02:05,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4527::DEBUG::2014-09-09 12:02:05,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4527::DEBUG::2014-09-09 12:02:05,643::task::993::Storage.TaskManager.Task::(_decref) Task=`f8edb40c-97f1-4223-a19c-94af8808ad70`::ref 0 aborting False >Thread-4527::DEBUG::2014-09-09 12:02:05,643::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4527::DEBUG::2014-09-09 12:02:05,643::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:05,772::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4528::DEBUG::2014-09-09 12:02:05,773::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:02:05,773::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4528::DEBUG::2014-09-09 12:02:05,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`2609e72d-ca69-4997-8a90-a01abd0a0c47`::moving from state init -> state preparing >Thread-4528::INFO::2014-09-09 12:02:05,774::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4528::DEBUG::2014-09-09 12:02:05,774::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1810b6bb-2146-4e16-8f08-b0295a044dfe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4528::DEBUG::2014-09-09 12:02:05,774::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4528::DEBUG::2014-09-09 12:02:05,774::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4528::DEBUG::2014-09-09 12:02:05,774::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1810b6bb-2146-4e16-8f08-b0295a044dfe`::Granted request >Thread-4528::DEBUG::2014-09-09 12:02:05,775::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2609e72d-ca69-4997-8a90-a01abd0a0c47`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4528::DEBUG::2014-09-09 12:02:05,775::task::993::Storage.TaskManager.Task::(_decref) Task=`2609e72d-ca69-4997-8a90-a01abd0a0c47`::ref 1 aborting False >Thread-4528::INFO::2014-09-09 12:02:05,776::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4528::DEBUG::2014-09-09 12:02:05,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`2609e72d-ca69-4997-8a90-a01abd0a0c47`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4528::DEBUG::2014-09-09 12:02:05,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`2609e72d-ca69-4997-8a90-a01abd0a0c47`::moving from state preparing -> state finished >Thread-4528::DEBUG::2014-09-09 12:02:05,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4528::DEBUG::2014-09-09 12:02:05,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4528::DEBUG::2014-09-09 12:02:05,777::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4528::DEBUG::2014-09-09 12:02:05,777::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4528::DEBUG::2014-09-09 12:02:05,777::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4528::DEBUG::2014-09-09 12:02:05,777::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4528::DEBUG::2014-09-09 12:02:05,777::task::993::Storage.TaskManager.Task::(_decref) Task=`2609e72d-ca69-4997-8a90-a01abd0a0c47`::ref 0 aborting False >Thread-4528::DEBUG::2014-09-09 12:02:05,777::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4528::DEBUG::2014-09-09 12:02:05,778::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:06,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:06,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896479 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) (9756) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) (9756) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:07,610::__init__::225::IOProcess::(_processLogs) (9756) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:07,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:02:07,611::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:07,611::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:02:07,619::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000938741 s, 584 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:07,619::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:07,619::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:07,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:07,619::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) (9757) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) (9757) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) DEBUG|(9757) Building response >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) (9757) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:07,620::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:07,621::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:02:07,621::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:07,621::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:02:07,621::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) (9758) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) (9758) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) (9758) Building response >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) (9758) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:07,622::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:07,623::__init__::225::IOProcess::(_processLogs) (9759) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) (9759) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) (9759) Building response >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) (9759) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:07,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:07,625::__init__::225::IOProcess::(_processLogs) (9760) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:07,625::__init__::225::IOProcess::(_processLogs) (9760) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:07,625::__init__::225::IOProcess::(_processLogs) DEBUG|(9760) Building response >Thread-19::DEBUG::2014-09-09 12:02:07,625::__init__::225::IOProcess::(_processLogs) (9760) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:07,625::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:07,626::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:08,466::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:08,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4529::DEBUG::2014-09-09 12:02:08,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:08,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:08,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897093 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:02:10,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:10,901::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:10,901::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:10,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:10,901::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:10,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:10,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:10,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:10,902::__init__::225::IOProcess::(_processLogs) (9761) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:10,902::__init__::225::IOProcess::(_processLogs) (9761) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:10,929::__init__::225::IOProcess::(_processLogs) DEBUG|(9761) Building response >Thread-19::DEBUG::2014-09-09 12:02:10,930::__init__::225::IOProcess::(_processLogs) (9761) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:10,931::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:02:10,932::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:10,932::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:02:10,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0982941 s, 10.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:02:10,940::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103126 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:10,941::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:10,942::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:10,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:10,943::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:10,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:10,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:10,946::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:10,947::__init__::225::IOProcess::(_processLogs) (9762) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:10,948::__init__::225::IOProcess::(_processLogs) (9762) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:10,949::__init__::225::IOProcess::(_processLogs) (9762) Building response >Thread-19::DEBUG::2014-09-09 12:02:10,949::__init__::225::IOProcess::(_processLogs) (9762) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:10,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:10,951::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:11,475::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:11,476::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4530::DEBUG::2014-09-09 12:02:11,477::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:12,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:13,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897819 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:14,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:14,485::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4531::DEBUG::2014-09-09 12:02:14,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`49cac123-6096-4492-b045-8df4c6ec1b63`::moving from state init -> state preparing >Thread-4531::INFO::2014-09-09 12:02:14,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4531::INFO::2014-09-09 12:02:14,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103126', 'lastCheck': '3.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000938741', 'lastCheck': '6.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000917787', 'lastCheck': '9.1', 'valid': True}} >Thread-4531::DEBUG::2014-09-09 12:02:14,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`49cac123-6096-4492-b045-8df4c6ec1b63`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103126', 'lastCheck': '3.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000938741', 'lastCheck': '6.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000917787', 'lastCheck': '9.1', 'valid': True}} >Thread-4531::DEBUG::2014-09-09 12:02:14,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`49cac123-6096-4492-b045-8df4c6ec1b63`::moving from state preparing -> state finished >Thread-4531::DEBUG::2014-09-09 12:02:14,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4531::DEBUG::2014-09-09 12:02:14,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4531::DEBUG::2014-09-09 12:02:14,487::task::993::Storage.TaskManager.Task::(_decref) Task=`49cac123-6096-4492-b045-8df4c6ec1b63`::ref 0 aborting False >Thread-4531::DEBUG::2014-09-09 12:02:14,488::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:14,494::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:14,495::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4532::DEBUG::2014-09-09 12:02:14,496::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:15,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:15,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089867 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:15,429::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:15,429::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:15,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) (9763) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) (9763) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:15,430::__init__::225::IOProcess::(_processLogs) DEBUG|(9763) Building response >Thread-19::DEBUG::2014-09-09 12:02:15,431::__init__::225::IOProcess::(_processLogs) (9763) Queuing response >Thread-3443::DEBUG::2014-09-09 12:02:15,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:15,431::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:15,436::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:02:15,438::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000924654 s, 384 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:15,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:15,440::__init__::225::IOProcess::(_processLogs) (9764) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:15,440::__init__::225::IOProcess::(_processLogs) (9764) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:15,440::__init__::225::IOProcess::(_processLogs) DEBUG|(9764) Building response >Thread-19::DEBUG::2014-09-09 12:02:15,440::__init__::225::IOProcess::(_processLogs) (9764) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:15,440::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:15,441::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:15,982::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:15,983::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4533::DEBUG::2014-09-09 12:02:15,983::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4533::DEBUG::2014-09-09 12:02:15,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcacb49e-1403-4aed-a8c4-4e6f28258476`::moving from state init -> state preparing >Thread-4533::INFO::2014-09-09 12:02:15,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4533::INFO::2014-09-09 12:02:15,984::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4533::DEBUG::2014-09-09 12:02:15,984::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcacb49e-1403-4aed-a8c4-4e6f28258476`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4533::DEBUG::2014-09-09 12:02:15,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcacb49e-1403-4aed-a8c4-4e6f28258476`::moving from state preparing -> state finished >Thread-4533::DEBUG::2014-09-09 12:02:15,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4533::DEBUG::2014-09-09 12:02:15,984::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4533::DEBUG::2014-09-09 12:02:15,984::task::993::Storage.TaskManager.Task::(_decref) Task=`bcacb49e-1403-4aed-a8c4-4e6f28258476`::ref 0 aborting False >Thread-4533::DEBUG::2014-09-09 12:02:15,985::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4533::DEBUG::2014-09-09 12:02:15,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:16,023::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:16,024::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4534::DEBUG::2014-09-09 12:02:16,024::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4534::DEBUG::2014-09-09 12:02:16,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f0e4ece-97f4-4c2e-a0eb-f18ec0575b92`::moving from state init -> state preparing >Thread-4534::INFO::2014-09-09 12:02:16,025::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4534::DEBUG::2014-09-09 12:02:16,025::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1d88e55-3eec-428c-8433-2ba6794b05bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4534::DEBUG::2014-09-09 12:02:16,025::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4534::DEBUG::2014-09-09 12:02:16,025::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4534::DEBUG::2014-09-09 12:02:16,025::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b1d88e55-3eec-428c-8433-2ba6794b05bd`::Granted request >Thread-4534::DEBUG::2014-09-09 12:02:16,025::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2f0e4ece-97f4-4c2e-a0eb-f18ec0575b92`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4534::DEBUG::2014-09-09 12:02:16,026::task::993::Storage.TaskManager.Task::(_decref) Task=`2f0e4ece-97f4-4c2e-a0eb-f18ec0575b92`::ref 1 aborting False >Thread-4534::INFO::2014-09-09 12:02:16,027::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4534::DEBUG::2014-09-09 12:02:16,027::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f0e4ece-97f4-4c2e-a0eb-f18ec0575b92`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4534::DEBUG::2014-09-09 12:02:16,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f0e4ece-97f4-4c2e-a0eb-f18ec0575b92`::moving from state preparing -> state finished >Thread-4534::DEBUG::2014-09-09 12:02:16,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4534::DEBUG::2014-09-09 12:02:16,028::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4534::DEBUG::2014-09-09 12:02:16,028::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4534::DEBUG::2014-09-09 12:02:16,028::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4534::DEBUG::2014-09-09 12:02:16,028::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4534::DEBUG::2014-09-09 12:02:16,028::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4534::DEBUG::2014-09-09 12:02:16,028::task::993::Storage.TaskManager.Task::(_decref) Task=`2f0e4ece-97f4-4c2e-a0eb-f18ec0575b92`::ref 0 aborting False >Thread-4534::DEBUG::2014-09-09 12:02:16,028::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4534::DEBUG::2014-09-09 12:02:16,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:17,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:17,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900206 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:17,626::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:17,626::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:17,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:17,626::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:17,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:17,627::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:17,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:17,627::__init__::225::IOProcess::(_processLogs) (9765) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:17,627::__init__::225::IOProcess::(_processLogs) (9765) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:17,628::__init__::225::IOProcess::(_processLogs) DEBUG|(9765) Building response >Thread-19::DEBUG::2014-09-09 12:02:17,628::__init__::225::IOProcess::(_processLogs) (9765) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:17,628::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:17,628::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:02:17,629::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:02:17,638::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000953659 s, 575 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) (9766) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) (9766) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:17,639::__init__::225::IOProcess::(_processLogs) DEBUG|(9766) Building response >Thread-19::DEBUG::2014-09-09 12:02:17,640::__init__::225::IOProcess::(_processLogs) (9766) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:17,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:17,640::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:02:17,640::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) (9767) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:17,641::__init__::225::IOProcess::(_processLogs) (9767) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) (9767) Building response >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) (9767) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:02:17,642::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) (9768) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) (9768) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) (9768) Building response >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) (9768) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:17,643::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:17,644::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:17,644::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:02:17,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:17,644::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:17,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) (9769) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) (9769) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) (9769) Building response >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) (9769) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:17,645::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:17,764::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:17,765::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4535::DEBUG::2014-09-09 12:02:17,766::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:19,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:19,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938933 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:20,771::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:20,771::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4536::DEBUG::2014-09-09 12:02:20,772::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:02:20,947::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:20,947::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:20,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:20,947::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) (9770) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) (9770) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) DEBUG|(9770) Building response >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) (9770) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:20,948::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:02:20,949::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:02:20,956::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109221 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:20,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:20,956::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) (9771) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) (9771) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) DEBUG|(9771) Building response >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) (9771) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:20,957::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:20,958::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:02:21,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:21,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895495 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:02:23,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:23,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895731 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:23,778::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:23,778::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4537::DEBUG::2014-09-09 12:02:23,779::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:02:25,441::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:25,441::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) (9772) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) (9772) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9772) Building response >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) (9772) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:25,442::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:02:25,443::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:25,443::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:02:25,450::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00090727 s, 391 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) (9773) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) (9773) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:25,451::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9773) Building response >Thread-19::DEBUG::2014-09-09 12:02:25,452::__init__::225::IOProcess::(_processLogs) (9773) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:25,452::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:25,452::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:02:25,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:25,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896221 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:26,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:26,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4538::DEBUG::2014-09-09 12:02:26,243::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4538::DEBUG::2014-09-09 12:02:26,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bd93b35-566e-496c-b7af-a6efd2c4a54e`::moving from state init -> state preparing >Thread-4538::INFO::2014-09-09 12:02:26,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4538::INFO::2014-09-09 12:02:26,244::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4538::DEBUG::2014-09-09 12:02:26,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bd93b35-566e-496c-b7af-a6efd2c4a54e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4538::DEBUG::2014-09-09 12:02:26,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bd93b35-566e-496c-b7af-a6efd2c4a54e`::moving from state preparing -> state finished >Thread-4538::DEBUG::2014-09-09 12:02:26,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4538::DEBUG::2014-09-09 12:02:26,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4538::DEBUG::2014-09-09 12:02:26,245::task::993::Storage.TaskManager.Task::(_decref) Task=`0bd93b35-566e-496c-b7af-a6efd2c4a54e`::ref 0 aborting False >Thread-4538::DEBUG::2014-09-09 12:02:26,245::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4538::DEBUG::2014-09-09 12:02:26,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:26,384::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4539::DEBUG::2014-09-09 12:02:26,384::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:02:26,385::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4539::DEBUG::2014-09-09 12:02:26,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`16fb9b6e-4d62-481d-9a73-3980c0ed08e5`::moving from state init -> state preparing >Thread-4539::INFO::2014-09-09 12:02:26,386::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4539::DEBUG::2014-09-09 12:02:26,386::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f7bb9c43-42a0-47c5-bb45-3319f36afd00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4539::DEBUG::2014-09-09 12:02:26,386::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4539::DEBUG::2014-09-09 12:02:26,386::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4539::DEBUG::2014-09-09 12:02:26,386::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f7bb9c43-42a0-47c5-bb45-3319f36afd00`::Granted request >Thread-4539::DEBUG::2014-09-09 12:02:26,386::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`16fb9b6e-4d62-481d-9a73-3980c0ed08e5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4539::DEBUG::2014-09-09 12:02:26,387::task::993::Storage.TaskManager.Task::(_decref) Task=`16fb9b6e-4d62-481d-9a73-3980c0ed08e5`::ref 1 aborting False >Thread-4539::INFO::2014-09-09 12:02:26,388::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4539::DEBUG::2014-09-09 12:02:26,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`16fb9b6e-4d62-481d-9a73-3980c0ed08e5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4539::DEBUG::2014-09-09 12:02:26,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`16fb9b6e-4d62-481d-9a73-3980c0ed08e5`::moving from state preparing -> state finished >Thread-4539::DEBUG::2014-09-09 12:02:26,389::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4539::DEBUG::2014-09-09 12:02:26,389::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4539::DEBUG::2014-09-09 12:02:26,389::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4539::DEBUG::2014-09-09 12:02:26,389::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4539::DEBUG::2014-09-09 12:02:26,389::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4539::DEBUG::2014-09-09 12:02:26,389::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4539::DEBUG::2014-09-09 12:02:26,389::task::993::Storage.TaskManager.Task::(_decref) Task=`16fb9b6e-4d62-481d-9a73-3980c0ed08e5`::ref 0 aborting False >Thread-4539::DEBUG::2014-09-09 12:02:26,389::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4539::DEBUG::2014-09-09 12:02:26,389::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:26,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:26,785::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4540::DEBUG::2014-09-09 12:02:26,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) (9774) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:27,645::__init__::225::IOProcess::(_processLogs) (9774) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:27,646::__init__::225::IOProcess::(_processLogs) (9774) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:27,646::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:02:27,646::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:02:27,654::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000989054 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:27,654::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:27,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:27,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:27,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:27,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:27,655::__init__::225::IOProcess::(_processLogs) (9775) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:27,655::__init__::225::IOProcess::(_processLogs) (9775) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:27,655::__init__::225::IOProcess::(_processLogs) (9775) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:27,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) (9776) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) (9776) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) (9776) Building response >Thread-19::DEBUG::2014-09-09 12:02:27,656::__init__::225::IOProcess::(_processLogs) (9776) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:27,657::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:27,657::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:02:27,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) (9777) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) (9777) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) (9777) Building response >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) (9777) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:02:27,658::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) (9778) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) (9778) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) (9778) Building response >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) (9778) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:27,659::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:02:27,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:27,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895501 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:29,792::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:29,793::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4541::DEBUG::2014-09-09 12:02:29,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`f848e4db-bee6-49e1-ae7c-4416b1736388`::moving from state init -> state preparing >Thread-4541::INFO::2014-09-09 12:02:29,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4541::INFO::2014-09-09 12:02:29,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109221', 'lastCheck': '8.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989054', 'lastCheck': '2.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00090727', 'lastCheck': '4.3', 'valid': True}} >Thread-4541::DEBUG::2014-09-09 12:02:29,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`f848e4db-bee6-49e1-ae7c-4416b1736388`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109221', 'lastCheck': '8.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989054', 'lastCheck': '2.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00090727', 'lastCheck': '4.3', 'valid': True}} >Thread-4541::DEBUG::2014-09-09 12:02:29,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`f848e4db-bee6-49e1-ae7c-4416b1736388`::moving from state preparing -> state finished >Thread-4541::DEBUG::2014-09-09 12:02:29,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4541::DEBUG::2014-09-09 12:02:29,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4541::DEBUG::2014-09-09 12:02:29,795::task::993::Storage.TaskManager.Task::(_decref) Task=`f848e4db-bee6-49e1-ae7c-4416b1736388`::ref 0 aborting False >Thread-4541::DEBUG::2014-09-09 12:02:29,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:29,802::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:29,803::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4542::DEBUG::2014-09-09 12:02:29,804::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:29,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:29,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895336 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) (9779) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) (9779) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) (9779) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:30,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:02:30,960::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:02:30,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0012036 s, 933 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:30,967::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) (9780) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) (9780) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:30,968::__init__::225::IOProcess::(_processLogs) (9780) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:30,969::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:02:31,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:32,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895191 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:33,197::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:33,198::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4543::DEBUG::2014-09-09 12:02:33,199::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:34,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:34,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896651 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:35,453::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:35,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:35,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:35,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:35,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:35,453::__init__::225::IOProcess::(_processLogs) (9781) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:35,454::__init__::225::IOProcess::(_processLogs) (9781) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:35,455::__init__::225::IOProcess::(_processLogs) (9781) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:35,455::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:02:35,456::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:02:35,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000948745 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:35,464::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:35,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:35,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:35,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) (9782) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) (9782) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) DEBUG|(9782) Building response >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) (9782) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:35,465::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:35,466::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:02:36,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:36,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:36,213::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4544::DEBUG::2014-09-09 12:02:36,215::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:36,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895504 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:36,609::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:36,610::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4545::DEBUG::2014-09-09 12:02:36,610::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4545::DEBUG::2014-09-09 12:02:36,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c067c00-02b1-417e-947e-df145194d0e8`::moving from state init -> state preparing >Thread-4545::INFO::2014-09-09 12:02:36,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4545::INFO::2014-09-09 12:02:36,611::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4545::DEBUG::2014-09-09 12:02:36,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c067c00-02b1-417e-947e-df145194d0e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4545::DEBUG::2014-09-09 12:02:36,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c067c00-02b1-417e-947e-df145194d0e8`::moving from state preparing -> state finished >Thread-4545::DEBUG::2014-09-09 12:02:36,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4545::DEBUG::2014-09-09 12:02:36,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4545::DEBUG::2014-09-09 12:02:36,612::task::993::Storage.TaskManager.Task::(_decref) Task=`4c067c00-02b1-417e-947e-df145194d0e8`::ref 0 aborting False >Thread-4545::DEBUG::2014-09-09 12:02:36,612::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4545::DEBUG::2014-09-09 12:02:36,612::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:36,666::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:36,667::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4546::DEBUG::2014-09-09 12:02:36,667::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4546::DEBUG::2014-09-09 12:02:36,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`df447461-a679-4483-a914-c4bf94f1060e`::moving from state init -> state preparing >Thread-4546::INFO::2014-09-09 12:02:36,670::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4546::DEBUG::2014-09-09 12:02:36,671::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2c4b279a-b8ec-4179-82ca-2921df7353b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4546::DEBUG::2014-09-09 12:02:36,671::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4546::DEBUG::2014-09-09 12:02:36,672::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4546::DEBUG::2014-09-09 12:02:36,672::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2c4b279a-b8ec-4179-82ca-2921df7353b2`::Granted request >Thread-4546::DEBUG::2014-09-09 12:02:36,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`df447461-a679-4483-a914-c4bf94f1060e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4546::DEBUG::2014-09-09 12:02:36,674::task::993::Storage.TaskManager.Task::(_decref) Task=`df447461-a679-4483-a914-c4bf94f1060e`::ref 1 aborting False >Thread-4546::INFO::2014-09-09 12:02:36,677::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4546::DEBUG::2014-09-09 12:02:36,677::task::1191::Storage.TaskManager.Task::(prepare) Task=`df447461-a679-4483-a914-c4bf94f1060e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4546::DEBUG::2014-09-09 12:02:36,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`df447461-a679-4483-a914-c4bf94f1060e`::moving from state preparing -> state finished >Thread-4546::DEBUG::2014-09-09 12:02:36,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4546::DEBUG::2014-09-09 12:02:36,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4546::DEBUG::2014-09-09 12:02:36,677::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4546::DEBUG::2014-09-09 12:02:36,678::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4546::DEBUG::2014-09-09 12:02:36,678::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4546::DEBUG::2014-09-09 12:02:36,678::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4546::DEBUG::2014-09-09 12:02:36,678::task::993::Storage.TaskManager.Task::(_decref) Task=`df447461-a679-4483-a914-c4bf94f1060e`::ref 0 aborting False >Thread-4546::DEBUG::2014-09-09 12:02:36,678::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4546::DEBUG::2014-09-09 12:02:36,678::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:02:37,660::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:37,660::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:37,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:37,661::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:37,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:37,661::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:37,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-24::DEBUG::2014-09-09 12:02:37,662::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:37,662::__init__::225::IOProcess::(_processLogs) (9783) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:37,667::__init__::225::IOProcess::(_processLogs) (9783) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:37,667::__init__::225::IOProcess::(_processLogs) (9783) Building response >Thread-19::DEBUG::2014-09-09 12:02:37,667::__init__::225::IOProcess::(_processLogs) (9783) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:37,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:37,668::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:02:37,670::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0009504 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:37,670::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:37,670::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:37,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:37,670::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) (9784) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) (9784) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) DEBUG|(9784) Building response >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) (9784) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:37,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:37,672::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:02:37,672::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:37,672::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:02:37,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:37,672::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) (9785) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) (9785) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) (9785) Building response >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) (9785) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:37,673::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) (9786) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) (9786) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:37,674::__init__::225::IOProcess::(_processLogs) (9786) Building response >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) (9786) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:37,675::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) (9787) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) (9787) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) (9787) Building response >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) (9787) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:37,676::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:02:38,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:38,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089618 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:39,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:39,220::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4547::DEBUG::2014-09-09 12:02:39,221::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:40,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:40,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089514 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:40,969::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) (9788) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:40,970::__init__::225::IOProcess::(_processLogs) (9788) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:40,971::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9788) Building response >Thread-19::DEBUG::2014-09-09 12:02:40,971::__init__::225::IOProcess::(_processLogs) (9788) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:40,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:40,971::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:02:40,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:02:40,980::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00121908 s, 921 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:40,980::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:40,980::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:40,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) (9789) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) (9789) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9789) Building response >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) (9789) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:40,981::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:40,982::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:42,227::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:42,228::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4548::DEBUG::2014-09-09 12:02:42,229::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:42,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:42,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894776 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:02:44,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:44,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894654 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:45,234::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:45,235::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4549::DEBUG::2014-09-09 12:02:45,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d68d269-25e1-417e-8482-d181c15c12c8`::moving from state init -> state preparing >Thread-4549::INFO::2014-09-09 12:02:45,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4549::INFO::2014-09-09 12:02:45,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00121908', 'lastCheck': '4.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009504', 'lastCheck': '7.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948745', 'lastCheck': '9.8', 'valid': True}} >Thread-4549::DEBUG::2014-09-09 12:02:45,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d68d269-25e1-417e-8482-d181c15c12c8`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00121908', 'lastCheck': '4.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0009504', 'lastCheck': '7.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948745', 'lastCheck': '9.8', 'valid': True}} >Thread-4549::DEBUG::2014-09-09 12:02:45,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d68d269-25e1-417e-8482-d181c15c12c8`::moving from state preparing -> state finished >Thread-4549::DEBUG::2014-09-09 12:02:45,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4549::DEBUG::2014-09-09 12:02:45,237::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4549::DEBUG::2014-09-09 12:02:45,237::task::993::Storage.TaskManager.Task::(_decref) Task=`2d68d269-25e1-417e-8482-d181c15c12c8`::ref 0 aborting False >Thread-4549::DEBUG::2014-09-09 12:02:45,238::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:45,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:45,245::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4550::DEBUG::2014-09-09 12:02:45,246::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:02:45,466::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) (9790) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) (9790) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9790) Building response >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) (9790) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:45,467::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:45,468::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:02:45,468::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:02:45,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000848953 s, 418 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) (9791) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) (9791) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:45,476::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9791) Building response >Thread-19::DEBUG::2014-09-09 12:02:45,477::__init__::225::IOProcess::(_processLogs) (9791) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:45,477::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:45,478::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:02:46,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:46,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894923 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:46,876::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:46,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4551::DEBUG::2014-09-09 12:02:46,877::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4551::DEBUG::2014-09-09 12:02:46,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ae5e463-5a5f-493c-8fe6-d2cb7779ac1d`::moving from state init -> state preparing >Thread-4551::INFO::2014-09-09 12:02:46,879::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4551::INFO::2014-09-09 12:02:46,879::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4551::DEBUG::2014-09-09 12:02:46,879::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ae5e463-5a5f-493c-8fe6-d2cb7779ac1d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4551::DEBUG::2014-09-09 12:02:46,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ae5e463-5a5f-493c-8fe6-d2cb7779ac1d`::moving from state preparing -> state finished >Thread-4551::DEBUG::2014-09-09 12:02:46,880::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4551::DEBUG::2014-09-09 12:02:46,880::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4551::DEBUG::2014-09-09 12:02:46,880::task::993::Storage.TaskManager.Task::(_decref) Task=`9ae5e463-5a5f-493c-8fe6-d2cb7779ac1d`::ref 0 aborting False >Thread-4551::DEBUG::2014-09-09 12:02:46,880::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4551::DEBUG::2014-09-09 12:02:46,880::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:46,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:46,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4552::DEBUG::2014-09-09 12:02:46,926::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4552::DEBUG::2014-09-09 12:02:46,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`03bbdc1d-3576-4fe4-8317-06b506a96018`::moving from state init -> state preparing >Thread-4552::INFO::2014-09-09 12:02:46,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4552::DEBUG::2014-09-09 12:02:46,927::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`04450e27-0093-4240-9fb3-6ec4bde8142a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4552::DEBUG::2014-09-09 12:02:46,927::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4552::DEBUG::2014-09-09 12:02:46,927::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4552::DEBUG::2014-09-09 12:02:46,927::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`04450e27-0093-4240-9fb3-6ec4bde8142a`::Granted request >Thread-4552::DEBUG::2014-09-09 12:02:46,928::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`03bbdc1d-3576-4fe4-8317-06b506a96018`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4552::DEBUG::2014-09-09 12:02:46,928::task::993::Storage.TaskManager.Task::(_decref) Task=`03bbdc1d-3576-4fe4-8317-06b506a96018`::ref 1 aborting False >Thread-4552::INFO::2014-09-09 12:02:46,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4552::DEBUG::2014-09-09 12:02:46,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`03bbdc1d-3576-4fe4-8317-06b506a96018`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4552::DEBUG::2014-09-09 12:02:46,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`03bbdc1d-3576-4fe4-8317-06b506a96018`::moving from state preparing -> state finished >Thread-4552::DEBUG::2014-09-09 12:02:46,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4552::DEBUG::2014-09-09 12:02:46,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4552::DEBUG::2014-09-09 12:02:46,930::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4552::DEBUG::2014-09-09 12:02:46,930::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4552::DEBUG::2014-09-09 12:02:46,930::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4552::DEBUG::2014-09-09 12:02:46,930::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4552::DEBUG::2014-09-09 12:02:46,930::task::993::Storage.TaskManager.Task::(_decref) Task=`03bbdc1d-3576-4fe4-8317-06b506a96018`::ref 0 aborting False >Thread-4552::DEBUG::2014-09-09 12:02:46,930::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283242397696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4552::DEBUG::2014-09-09 12:02:46,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:02:47,676::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:47,676::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:47,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:47,676::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:47,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:47,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:47,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:47,677::__init__::225::IOProcess::(_processLogs) (9792) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:47,677::__init__::225::IOProcess::(_processLogs) (9792) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:47,677::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9792) Building response >Thread-19::DEBUG::2014-09-09 12:02:47,678::__init__::225::IOProcess::(_processLogs) (9792) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:47,678::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:02:47,678::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:47,678::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:02:47,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000907575 s, 604 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) (9793) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:47,687::__init__::225::IOProcess::(_processLogs) (9793) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:47,688::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9793) Building response >Thread-19::DEBUG::2014-09-09 12:02:47,688::__init__::225::IOProcess::(_processLogs) (9793) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:47,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:47,688::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) (9794) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) (9794) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:47,689::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(9794) Building response >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) (9794) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:47,690::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) (9795) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) (9795) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9795) Building response >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) (9795) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:47,691::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:47,692::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:47,692::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:47,692::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:02:47,692::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:47,692::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) (9796) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) (9796) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) (9796) Building response >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) (9796) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:47,693::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:48,597::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:48,598::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4553::DEBUG::2014-09-09 12:02:48,599::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:48,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:48,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895839 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:02:50,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) (9797) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:50,983::__init__::225::IOProcess::(_processLogs) (9797) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:50,994::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9797) Building response >Thread-19::DEBUG::2014-09-09 12:02:50,994::__init__::225::IOProcess::(_processLogs) (9797) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:50,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:50,995::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:02:50,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:51,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0967046 s, 10.6 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:02:51,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105306 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:51,004::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:51,005::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:02:51,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:51,006::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:51,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:51,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:51,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:51,008::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9798) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:51,009::__init__::225::IOProcess::(_processLogs) (9798) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:51,009::__init__::225::IOProcess::(_processLogs) (9798) Building response >Thread-19::DEBUG::2014-09-09 12:02:51,010::__init__::225::IOProcess::(_processLogs) (9798) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:51,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:51,011::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:51,702::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:51,703::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4554::DEBUG::2014-09-09 12:02:51,704::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:53,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:53,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896057 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:54,711::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:54,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4555::DEBUG::2014-09-09 12:02:54,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:55,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:55,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895974 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:55,478::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:55,478::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:55,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:55,478::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:55,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:55,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:55,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:55,479::__init__::225::IOProcess::(_processLogs) (9799) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:55,479::__init__::225::IOProcess::(_processLogs) (9799) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:55,479::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9799) Building response >Thread-19::DEBUG::2014-09-09 12:02:55,480::__init__::225::IOProcess::(_processLogs) (9799) Queuing response >Thread-3443::DEBUG::2014-09-09 12:02:55,480::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:02:55,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:55,485::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:02:55,487::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000872078 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) (9800) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) (9800) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:55,488::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9800) Building response >Thread-19::DEBUG::2014-09-09 12:02:55,489::__init__::225::IOProcess::(_processLogs) (9800) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:55,489::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:55,489::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:57,070::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:57,071::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4556::DEBUG::2014-09-09 12:02:57,071::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4556::DEBUG::2014-09-09 12:02:57,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e05d199-8208-427f-95c6-fd035fa2325e`::moving from state init -> state preparing >Thread-4556::INFO::2014-09-09 12:02:57,072::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4556::INFO::2014-09-09 12:02:57,072::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4556::DEBUG::2014-09-09 12:02:57,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e05d199-8208-427f-95c6-fd035fa2325e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4556::DEBUG::2014-09-09 12:02:57,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e05d199-8208-427f-95c6-fd035fa2325e`::moving from state preparing -> state finished >Thread-4556::DEBUG::2014-09-09 12:02:57,072::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4556::DEBUG::2014-09-09 12:02:57,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4556::DEBUG::2014-09-09 12:02:57,072::task::993::Storage.TaskManager.Task::(_decref) Task=`2e05d199-8208-427f-95c6-fd035fa2325e`::ref 0 aborting False >Thread-4556::DEBUG::2014-09-09 12:02:57,072::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4556::DEBUG::2014-09-09 12:02:57,073::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:57,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:57,118::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4557::DEBUG::2014-09-09 12:02:57,118::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4557::DEBUG::2014-09-09 12:02:57,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`2936bc10-6a84-479b-a1c8-c60106fa8fd1`::moving from state init -> state preparing >Thread-4557::INFO::2014-09-09 12:02:57,119::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4557::DEBUG::2014-09-09 12:02:57,119::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2e360fbf-5e54-4f08-a8f9-542910050a8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4557::DEBUG::2014-09-09 12:02:57,119::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4557::DEBUG::2014-09-09 12:02:57,120::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4557::DEBUG::2014-09-09 12:02:57,120::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2e360fbf-5e54-4f08-a8f9-542910050a8e`::Granted request >Thread-4557::DEBUG::2014-09-09 12:02:57,121::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2936bc10-6a84-479b-a1c8-c60106fa8fd1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4557::DEBUG::2014-09-09 12:02:57,121::task::993::Storage.TaskManager.Task::(_decref) Task=`2936bc10-6a84-479b-a1c8-c60106fa8fd1`::ref 1 aborting False >Thread-4557::INFO::2014-09-09 12:02:57,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283589476352', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283589476352', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4557::DEBUG::2014-09-09 12:02:57,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`2936bc10-6a84-479b-a1c8-c60106fa8fd1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283589476352', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283589476352', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4557::DEBUG::2014-09-09 12:02:57,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`2936bc10-6a84-479b-a1c8-c60106fa8fd1`::moving from state preparing -> state finished >Thread-4557::DEBUG::2014-09-09 12:02:57,122::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4557::DEBUG::2014-09-09 12:02:57,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4557::DEBUG::2014-09-09 12:02:57,123::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4557::DEBUG::2014-09-09 12:02:57,123::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4557::DEBUG::2014-09-09 12:02:57,123::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4557::DEBUG::2014-09-09 12:02:57,123::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4557::DEBUG::2014-09-09 12:02:57,123::task::993::Storage.TaskManager.Task::(_decref) Task=`2936bc10-6a84-479b-a1c8-c60106fa8fd1`::ref 0 aborting False >Thread-4557::DEBUG::2014-09-09 12:02:57,123::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283589476352', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283589476352', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4557::DEBUG::2014-09-09 12:02:57,124::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:57,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:57,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896531 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:57,693::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:57,693::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:57,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:57,693::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:57,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) (9801) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) (9801) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9801) Building response >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) (9801) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:57,694::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:02:57,695::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:02:57,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:02:57,703::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000955798 s, 573 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:02:57,704::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:57,704::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:02:57,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:57,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:57,704::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:57,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:57,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:57,705::__init__::225::IOProcess::(_processLogs) (9802) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:02:57,705::__init__::225::IOProcess::(_processLogs) (9802) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:02:57,705::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9802) Building response >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) (9802) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:57,706::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) (9803) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) (9803) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) (9803) Building response >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) (9803) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:02:57,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) (9804) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) (9804) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) (9804) Building response >Thread-19::DEBUG::2014-09-09 12:02:57,708::__init__::225::IOProcess::(_processLogs) (9804) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:57,709::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:57,709::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:02:57,709::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:02:57,709::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:02:57,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:02:57,709::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) (9805) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) (9805) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) (9805) Building response >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) (9805) Queuing response >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:02:57,710::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:02:57,725::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:02:57,726::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4558::DEBUG::2014-09-09 12:02:57,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:02:59,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:02:59,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895846 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:00,734::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:00,735::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4559::DEBUG::2014-09-09 12:03:00,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`712387e5-8c40-4f15-8fc4-93cca367f7d3`::moving from state init -> state preparing >Thread-4559::INFO::2014-09-09 12:03:00,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4559::INFO::2014-09-09 12:03:00,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105306', 'lastCheck': '9.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955798', 'lastCheck': '3.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000872078', 'lastCheck': '5.2', 'valid': True}} >Thread-4559::DEBUG::2014-09-09 12:03:00,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`712387e5-8c40-4f15-8fc4-93cca367f7d3`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105306', 'lastCheck': '9.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955798', 'lastCheck': '3.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000872078', 'lastCheck': '5.2', 'valid': True}} >Thread-4559::DEBUG::2014-09-09 12:03:00,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`712387e5-8c40-4f15-8fc4-93cca367f7d3`::moving from state preparing -> state finished >Thread-4559::DEBUG::2014-09-09 12:03:00,737::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4559::DEBUG::2014-09-09 12:03:00,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4559::DEBUG::2014-09-09 12:03:00,737::task::993::Storage.TaskManager.Task::(_decref) Task=`712387e5-8c40-4f15-8fc4-93cca367f7d3`::ref 0 aborting False >Thread-4559::DEBUG::2014-09-09 12:03:00,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:00,746::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:00,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4560::DEBUG::2014-09-09 12:03:00,748::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:01,009::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:01,009::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:01,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:01,009::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:01,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:01,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:01,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:01,010::__init__::225::IOProcess::(_processLogs) (9806) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:01,010::__init__::225::IOProcess::(_processLogs) (9806) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:01,010::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9806) Building response >Thread-23::DEBUG::2014-09-09 12:03:01,010::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:01,011::__init__::225::IOProcess::(_processLogs) (9806) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:01,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:01,016::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:03:01,018::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107755 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:01,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:01,020::__init__::225::IOProcess::(_processLogs) (9807) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:01,020::__init__::225::IOProcess::(_processLogs) (9807) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:01,020::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9807) Building response >Thread-19::DEBUG::2014-09-09 12:03:01,020::__init__::225::IOProcess::(_processLogs) (9807) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:01,020::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:03:01,021::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:01,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:01,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896227 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:03:03,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:03,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895807 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:04,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:04,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4561::DEBUG::2014-09-09 12:03:04,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:05,490::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:05,490::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:05,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:05,490::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:05,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:05,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:05,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:05,491::__init__::225::IOProcess::(_processLogs) (9808) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:05,491::__init__::225::IOProcess::(_processLogs) (9808) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:05,491::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9808) Building response >Thread-19::DEBUG::2014-09-09 12:03:05,491::__init__::225::IOProcess::(_processLogs) (9808) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:05,491::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:03:05,492::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:05,492::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:03:05,499::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000885526 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) (9809) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:05,500::__init__::225::IOProcess::(_processLogs) (9809) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:05,501::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9809) Building response >Thread-19::DEBUG::2014-09-09 12:03:05,501::__init__::225::IOProcess::(_processLogs) (9809) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:05,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:05,502::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:05,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:05,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089466 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:07,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4562::DEBUG::2014-09-09 12:03:07,255::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:03:07,255::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4562::DEBUG::2014-09-09 12:03:07,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf557872-34b8-4bdb-9de8-f6aa77ec78a2`::moving from state init -> state preparing >Thread-4562::INFO::2014-09-09 12:03:07,256::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4562::INFO::2014-09-09 12:03:07,256::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4562::DEBUG::2014-09-09 12:03:07,256::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf557872-34b8-4bdb-9de8-f6aa77ec78a2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4562::DEBUG::2014-09-09 12:03:07,256::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf557872-34b8-4bdb-9de8-f6aa77ec78a2`::moving from state preparing -> state finished >Thread-4562::DEBUG::2014-09-09 12:03:07,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4562::DEBUG::2014-09-09 12:03:07,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4562::DEBUG::2014-09-09 12:03:07,257::task::993::Storage.TaskManager.Task::(_decref) Task=`cf557872-34b8-4bdb-9de8-f6aa77ec78a2`::ref 0 aborting False >Thread-4562::DEBUG::2014-09-09 12:03:07,257::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4562::DEBUG::2014-09-09 12:03:07,257::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:07,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:07,711::__init__::225::IOProcess::(_processLogs) (9810) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:07,711::__init__::225::IOProcess::(_processLogs) (9810) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:07,711::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9810) Building response >Thread-19::DEBUG::2014-09-09 12:03:07,711::__init__::225::IOProcess::(_processLogs) (9810) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:07,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:07,711::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:03:07,712::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:03:07,719::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000964483 s, 568 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:07,720::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:07,720::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:07,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:07,720::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:07,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) (9811) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) (9811) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|(9811) Building response >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) (9811) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:07,721::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:03:07,722::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:03:07,722::__init__::225::IOProcess::(_processLogs) (9794) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:07,722::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:03:07,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:07,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) (9812) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) (9812) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) (9812) Building response >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) (9812) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:07,723::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) (9813) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) (9813) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:07,724::__init__::225::IOProcess::(_processLogs) (9813) Building response >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) (9813) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) (9814) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:07,725::__init__::225::IOProcess::(_processLogs) (9814) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:07,726::__init__::225::IOProcess::(_processLogs) (9814) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:07,726::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:03:07,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:07,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895305 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:08,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:08,061::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4563::DEBUG::2014-09-09 12:03:08,061::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4563::DEBUG::2014-09-09 12:03:08,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`95795ada-4210-4431-ab19-bff49991cc90`::moving from state init -> state preparing >Thread-4563::INFO::2014-09-09 12:03:08,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4563::DEBUG::2014-09-09 12:03:08,063::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`73275e43-7fe2-4f83-a094-5cdf4ba6d1e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4563::DEBUG::2014-09-09 12:03:08,063::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4563::DEBUG::2014-09-09 12:03:08,063::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4563::DEBUG::2014-09-09 12:03:08,063::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`73275e43-7fe2-4f83-a094-5cdf4ba6d1e8`::Granted request >Thread-4563::DEBUG::2014-09-09 12:03:08,064::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`95795ada-4210-4431-ab19-bff49991cc90`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4563::DEBUG::2014-09-09 12:03:08,064::task::993::Storage.TaskManager.Task::(_decref) Task=`95795ada-4210-4431-ab19-bff49991cc90`::ref 1 aborting False >Thread-4563::INFO::2014-09-09 12:03:08,065::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283152220160', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283068334080', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283105034240', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4563::DEBUG::2014-09-09 12:03:08,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`95795ada-4210-4431-ab19-bff49991cc90`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283152220160', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283068334080', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283105034240', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4563::DEBUG::2014-09-09 12:03:08,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`95795ada-4210-4431-ab19-bff49991cc90`::moving from state preparing -> state finished >Thread-4563::DEBUG::2014-09-09 12:03:08,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4563::DEBUG::2014-09-09 12:03:08,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4563::DEBUG::2014-09-09 12:03:08,066::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4563::DEBUG::2014-09-09 12:03:08,066::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4563::DEBUG::2014-09-09 12:03:08,066::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4563::DEBUG::2014-09-09 12:03:08,066::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4563::DEBUG::2014-09-09 12:03:08,066::task::993::Storage.TaskManager.Task::(_decref) Task=`95795ada-4210-4431-ab19-bff49991cc90`::ref 0 aborting False >Thread-4563::DEBUG::2014-09-09 12:03:08,066::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283152220160', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283068334080', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283105034240', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4563::DEBUG::2014-09-09 12:03:08,067::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:08,336::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:08,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4564::DEBUG::2014-09-09 12:03:08,337::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:09,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:09,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897618 s, 11.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:03:11,021::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:03:11,023::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:03:11,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) (9815) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) (9815) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:11,024::__init__::225::IOProcess::(_processLogs) (9815) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) (9816) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) (9816) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:11,025::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) (9817) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) (9817) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:11,026::__init__::225::IOProcess::(_processLogs) (9816) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:11,027::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:03:11,027::__init__::225::IOProcess::(_processLogs) (9817) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:11,028::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-23::DEBUG::2014-09-09 12:03:11,030::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:03:11,030::__init__::225::IOProcess::(_processLogs) Message size is 156 >Thread-19::DEBUG::2014-09-09 12:03:11,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,031::__init__::225::IOProcess::(_processLogs) (9818) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:03:11,031::__init__::225::IOProcess::(_processLogs) (9818) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:03:11,056::__init__::225::IOProcess::(_processLogs) (9818) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:11,056::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-23::DEBUG::2014-09-09 12:03:11,056::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:03:11,056::__init__::225::IOProcess::(_processLogs) Message size is 180 >Thread-19::DEBUG::2014-09-09 12:03:11,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,056::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,057::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,057::__init__::225::IOProcess::(_processLogs) (9819) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:03:11,057::__init__::225::IOProcess::(_processLogs) (9819) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:03:11,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9819) Building response >Thread-19::DEBUG::2014-09-09 12:03:11,059::__init__::225::IOProcess::(_processLogs) (9819) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:03:11,059::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 12:03:11,060::__init__::225::IOProcess::(_processLogs) Sending response sized 1554 >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Message size is 173 >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,061::__init__::225::IOProcess::(_processLogs) (9820) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) (9820) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) (9820) Building response >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) (9820) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Message size is 167 >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,063::__init__::225::IOProcess::(_processLogs) (9821) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:11,063::__init__::225::IOProcess::(_processLogs) (9821) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:11,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9821) Building response >Thread-19::DEBUG::2014-09-09 12:03:11,064::__init__::225::IOProcess::(_processLogs) (9821) Queuing response >Thread-23::DEBUG::2014-09-09 12:03:11,064::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:03:11,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::INFO::2014-09-09 12:03:11,065::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 12:03:11,065::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:03:11,065::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-19::DEBUG::2014-09-09 12:03:11,066::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:11,066::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:11,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,066::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) (9822) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) (9822) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) DEBUG|(9822) Building response >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) (9822) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,067::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:03:11,068::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:11,068::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:03:11,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103624 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) (9823) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:11,076::__init__::225::IOProcess::(_processLogs) (9823) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:11,077::__init__::225::IOProcess::(_processLogs) DEBUG|(9823) Building response >Thread-19::DEBUG::2014-09-09 12:03:11,077::__init__::225::IOProcess::(_processLogs) (9823) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:11,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:11,077::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:11,368::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:11,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4568::DEBUG::2014-09-09 12:03:11,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:11,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:12,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895307 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:03:14,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:14,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089487 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:14,403::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:14,404::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4569::DEBUG::2014-09-09 12:03:14,405::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:15,502::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:15,502::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:15,502::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) (9824) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) (9824) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:15,503::__init__::225::IOProcess::(_processLogs) DEBUG|(9824) Building response >Thread-19::DEBUG::2014-09-09 12:03:15,504::__init__::225::IOProcess::(_processLogs) (9824) Queuing response >Thread-3443::DEBUG::2014-09-09 12:03:15,504::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:15,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:15,509::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:03:15,511::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00084716 s, 419 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:15,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:15,513::__init__::225::IOProcess::(_processLogs) (9825) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:15,513::__init__::225::IOProcess::(_processLogs) (9825) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:15,513::__init__::225::IOProcess::(_processLogs) (9825) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:15,514::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:15,514::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:16,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:16,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089541 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:17,439::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:17,439::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4570::DEBUG::2014-09-09 12:03:17,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`1faff9d0-e5a0-4a54-acde-8ec11d2760b9`::moving from state init -> state preparing >Thread-4570::INFO::2014-09-09 12:03:17,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4570::INFO::2014-09-09 12:03:17,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103624', 'lastCheck': '6.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964483', 'lastCheck': '9.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00084716', 'lastCheck': '1.9', 'valid': True}} >Thread-4570::DEBUG::2014-09-09 12:03:17,441::task::1191::Storage.TaskManager.Task::(prepare) Task=`1faff9d0-e5a0-4a54-acde-8ec11d2760b9`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103624', 'lastCheck': '6.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964483', 'lastCheck': '9.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00084716', 'lastCheck': '1.9', 'valid': True}} >Thread-4570::DEBUG::2014-09-09 12:03:17,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`1faff9d0-e5a0-4a54-acde-8ec11d2760b9`::moving from state preparing -> state finished >Thread-4570::DEBUG::2014-09-09 12:03:17,441::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4570::DEBUG::2014-09-09 12:03:17,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4570::DEBUG::2014-09-09 12:03:17,442::task::993::Storage.TaskManager.Task::(_decref) Task=`1faff9d0-e5a0-4a54-acde-8ec11d2760b9`::ref 0 aborting False >Thread-4570::DEBUG::2014-09-09 12:03:17,442::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:17,453::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:17,454::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4571::DEBUG::2014-09-09 12:03:17,455::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-24::DEBUG::2014-09-09 12:03:17,727::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:03:17,729::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) (9826) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:17,730::__init__::225::IOProcess::(_processLogs) (9826) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) (9826) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:17,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) (9827) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) (9827) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,732::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) (9828) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) (9828) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) DEBUG|(9828) Building response >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) (9828) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 12:03:17,733::__init__::225::IOProcess::(_processLogs) (9827) Building response >Thread-19::DEBUG::2014-09-09 12:03:17,734::__init__::225::IOProcess::(_processLogs) (9827) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:17,734::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-24::DEBUG::2014-09-09 12:03:17,735::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:03:17,735::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) (9829) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:03:17,736::__init__::225::IOProcess::(_processLogs) (9829) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:03:17,812::__init__::225::IOProcess::(_processLogs) DEBUG|(9829) Building response >Thread-19::DEBUG::2014-09-09 12:03:17,813::__init__::225::IOProcess::(_processLogs) (9829) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:03:17,813::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:03:17,813::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) (9830) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:03:17,814::__init__::225::IOProcess::(_processLogs) (9830) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:03:17,818::__init__::225::IOProcess::(_processLogs) (9830) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,818::__init__::225::IOProcess::(_processLogs) Sending response sized 786 >Thread-24::DEBUG::2014-09-09 12:03:17,818::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) (9831) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:17,819::__init__::225::IOProcess::(_processLogs) (9831) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:17,820::__init__::225::IOProcess::(_processLogs) (9831) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,820::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:17,820::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 12:03:17,820::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,821::__init__::225::IOProcess::(_processLogs) (9832) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:17,821::__init__::225::IOProcess::(_processLogs) (9832) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:17,834::__init__::225::IOProcess::(_processLogs) (9832) Queuing response >Thread-24::DEBUG::2014-09-09 12:03:17,834::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:03:17,834::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-24::INFO::2014-09-09 12:03:17,835::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-24::INFO::2014-09-09 12:03:17,835::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:03:17,835::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:17,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,836::__init__::225::IOProcess::(_processLogs) (9833) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:17,836::__init__::225::IOProcess::(_processLogs) (9833) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:17,836::__init__::225::IOProcess::(_processLogs) (9833) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,836::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:03:17,837::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:03:17,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000906753 s, 604 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) (9834) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:17,845::__init__::225::IOProcess::(_processLogs) (9834) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:17,846::__init__::225::IOProcess::(_processLogs) (9834) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,846::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:03:17,846::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:03:17,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) (9835) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) (9835) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) (9835) Building response >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) (9835) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,848::__init__::225::IOProcess::(_processLogs) (9836) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) (9836) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) (9836) Building response >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) (9836) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:17,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) (9837) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) (9837) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) (9837) Building response >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) (9837) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:17,850::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:03:18,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:18,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894902 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:19,465::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:19,466::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4575::DEBUG::2014-09-09 12:03:19,466::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4575::DEBUG::2014-09-09 12:03:19,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f4a215b-1c37-42d4-8c96-aeee506c7150`::moving from state init -> state preparing >Thread-4575::INFO::2014-09-09 12:03:19,469::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4575::INFO::2014-09-09 12:03:19,470::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4575::DEBUG::2014-09-09 12:03:19,471::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f4a215b-1c37-42d4-8c96-aeee506c7150`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4575::DEBUG::2014-09-09 12:03:19,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f4a215b-1c37-42d4-8c96-aeee506c7150`::moving from state preparing -> state finished >Thread-4575::DEBUG::2014-09-09 12:03:19,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4575::DEBUG::2014-09-09 12:03:19,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4575::DEBUG::2014-09-09 12:03:19,472::task::993::Storage.TaskManager.Task::(_decref) Task=`8f4a215b-1c37-42d4-8c96-aeee506c7150`::ref 0 aborting False >Thread-4575::DEBUG::2014-09-09 12:03:19,473::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4575::DEBUG::2014-09-09 12:03:19,474::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:19,596::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:19,597::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4576::DEBUG::2014-09-09 12:03:19,597::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4576::DEBUG::2014-09-09 12:03:19,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbc05626-7abc-4a38-9400-f572195f6c17`::moving from state init -> state preparing >Thread-4576::INFO::2014-09-09 12:03:19,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4576::DEBUG::2014-09-09 12:03:19,603::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`612a6481-d3c7-46d7-8c2f-bbd7e3124a39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4576::DEBUG::2014-09-09 12:03:19,603::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4576::DEBUG::2014-09-09 12:03:19,605::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4576::DEBUG::2014-09-09 12:03:19,605::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`612a6481-d3c7-46d7-8c2f-bbd7e3124a39`::Granted request >Thread-4576::DEBUG::2014-09-09 12:03:19,607::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bbc05626-7abc-4a38-9400-f572195f6c17`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4576::DEBUG::2014-09-09 12:03:19,607::task::993::Storage.TaskManager.Task::(_decref) Task=`bbc05626-7abc-4a38-9400-f572195f6c17`::ref 1 aborting False >Thread-4576::INFO::2014-09-09 12:03:19,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283001225216', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282912096256', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282940407808', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4576::DEBUG::2014-09-09 12:03:19,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbc05626-7abc-4a38-9400-f572195f6c17`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283001225216', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282912096256', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282940407808', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4576::DEBUG::2014-09-09 12:03:19,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbc05626-7abc-4a38-9400-f572195f6c17`::moving from state preparing -> state finished >Thread-4576::DEBUG::2014-09-09 12:03:19,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4576::DEBUG::2014-09-09 12:03:19,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4576::DEBUG::2014-09-09 12:03:19,623::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4576::DEBUG::2014-09-09 12:03:19,624::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4576::DEBUG::2014-09-09 12:03:19,624::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4576::DEBUG::2014-09-09 12:03:19,625::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4576::DEBUG::2014-09-09 12:03:19,626::task::993::Storage.TaskManager.Task::(_decref) Task=`bbc05626-7abc-4a38-9400-f572195f6c17`::ref 0 aborting False >Thread-4576::DEBUG::2014-09-09 12:03:19,627::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283001225216', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282912096256', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282940407808', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4576::DEBUG::2014-09-09 12:03:19,628::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:20,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:20,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894691 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) (9838) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:21,078::__init__::225::IOProcess::(_processLogs) (9838) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:21,079::__init__::225::IOProcess::(_processLogs) (9838) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:21,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:03:21,079::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:03:21,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113399 s, 990 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:21,086::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:21,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) (9839) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) (9839) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) (9839) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:21,087::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:21,877::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:21,878::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4577::DEBUG::2014-09-09 12:03:21,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:22,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:22,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089575 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:03:24,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:24,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896404 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:24,885::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:24,886::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4578::DEBUG::2014-09-09 12:03:24,887::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-3443::DEBUG::2014-09-09 12:03:25,514::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:03:25,516::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) (9840) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:25,517::__init__::225::IOProcess::(_processLogs) (9840) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:25,518::__init__::225::IOProcess::(_processLogs) (9840) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:25,519::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:03:25,520::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:03:25,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,522::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-3443::DEBUG::2014-09-09 12:03:25,524::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:03:25,524::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) (9841) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) (9841) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) (9841) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) Message size is 127 >Thread-19::DEBUG::2014-09-09 12:03:25,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) (9842) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) (9842) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) (9842) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,526::__init__::225::IOProcess::(_processLogs) (9842) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Sending response sized 151 >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) (9843) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:03:25,527::__init__::225::IOProcess::(_processLogs) (9843) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:03:25,569::__init__::225::IOProcess::(_processLogs) DEBUG|(9843) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,569::__init__::225::IOProcess::(_processLogs) (9843) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,569::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:03:25,569::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:03:25,570::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:25,570::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,570::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 12:03:25,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,570::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,571::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,571::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,571::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,571::__init__::225::IOProcess::(_processLogs) (9844) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:03:25,571::__init__::225::IOProcess::(_processLogs) (9844) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:03:25,573::__init__::225::IOProcess::(_processLogs) DEBUG|(9844) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,573::__init__::225::IOProcess::(_processLogs) (9844) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,573::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:25,573::__init__::225::IOProcess::(_processLogs) Sending response sized 530 >Thread-3443::DEBUG::2014-09-09 12:03:25,573::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 12:03:25,573::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,573::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) (9845) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) (9845) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:25,574::__init__::225::IOProcess::(_processLogs) (9845) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) (9845) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,575::__init__::225::IOProcess::(_processLogs) (9846) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:03:25,576::__init__::225::IOProcess::(_processLogs) (9846) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:03:25,576::__init__::225::IOProcess::(_processLogs) DEBUG|(9846) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,577::__init__::225::IOProcess::(_processLogs) (9846) Queuing response >Thread-3443::DEBUG::2014-09-09 12:03:25,577::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:03:25,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::INFO::2014-09-09 12:03:25,577::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-19::DEBUG::2014-09-09 12:03:25,578::__init__::225::IOProcess::(_processLogs) Sending response sized 54 >Thread-3443::INFO::2014-09-09 12:03:25,578::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:03:25,578::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,578::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:25,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) (9847) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) (9847) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) DEBUG|(9847) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,579::__init__::225::IOProcess::(_processLogs) (9847) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,580::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:03:25,580::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:25,580::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:03:25,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00095579 s, 371 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) (9848) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:25,588::__init__::225::IOProcess::(_processLogs) (9848) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:25,589::__init__::225::IOProcess::(_processLogs) DEBUG|(9848) Building response >Thread-19::DEBUG::2014-09-09 12:03:25,589::__init__::225::IOProcess::(_processLogs) (9848) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:25,589::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:03:25,590::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:26,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:26,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896996 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:27,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:27,850::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:27,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:27,850::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) (9849) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) (9849) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) DEBUG|(9849) Building response >Thread-19::DEBUG::2014-09-09 12:03:27,851::__init__::225::IOProcess::(_processLogs) (9849) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:27,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:27,852::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:03:27,852::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:03:27,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000934965 s, 586 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:27,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) (9850) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) (9850) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) DEBUG|(9850) Building response >Thread-19::DEBUG::2014-09-09 12:03:27,861::__init__::225::IOProcess::(_processLogs) (9850) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:27,862::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:03:27,862::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:03:27,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:27,862::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:03:27,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) (9851) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) (9851) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) (9851) Building response >Thread-19::DEBUG::2014-09-09 12:03:27,863::__init__::225::IOProcess::(_processLogs) (9851) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:27,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) (9852) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) (9852) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) (9852) Building response >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) (9852) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:03:27,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) (9853) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) (9853) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) (9853) Building response >Thread-19::DEBUG::2014-09-09 12:03:27,866::__init__::225::IOProcess::(_processLogs) (9853) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:27,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:27,867::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:27,893::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:27,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4582::DEBUG::2014-09-09 12:03:27,895::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:28,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:28,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896427 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:29,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:29,849::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4583::DEBUG::2014-09-09 12:03:29,849::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4583::DEBUG::2014-09-09 12:03:29,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`6012583c-8544-470a-bbff-543964d946a6`::moving from state init -> state preparing >Thread-4583::INFO::2014-09-09 12:03:29,850::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4583::INFO::2014-09-09 12:03:29,850::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4583::DEBUG::2014-09-09 12:03:29,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`6012583c-8544-470a-bbff-543964d946a6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4583::DEBUG::2014-09-09 12:03:29,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`6012583c-8544-470a-bbff-543964d946a6`::moving from state preparing -> state finished >Thread-4583::DEBUG::2014-09-09 12:03:29,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4583::DEBUG::2014-09-09 12:03:29,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4583::DEBUG::2014-09-09 12:03:29,851::task::993::Storage.TaskManager.Task::(_decref) Task=`6012583c-8544-470a-bbff-543964d946a6`::ref 0 aborting False >Thread-4583::DEBUG::2014-09-09 12:03:29,851::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4583::DEBUG::2014-09-09 12:03:29,851::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:29,938::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:29,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4584::DEBUG::2014-09-09 12:03:29,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4584::DEBUG::2014-09-09 12:03:29,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`d893572c-654f-4f2f-80eb-059842eb0792`::moving from state init -> state preparing >Thread-4584::INFO::2014-09-09 12:03:29,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4584::DEBUG::2014-09-09 12:03:29,940::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a634bff6-96bc-41ca-b5a1-8222187fa877`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4584::DEBUG::2014-09-09 12:03:29,940::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4584::DEBUG::2014-09-09 12:03:29,940::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4584::DEBUG::2014-09-09 12:03:29,940::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a634bff6-96bc-41ca-b5a1-8222187fa877`::Granted request >Thread-4584::DEBUG::2014-09-09 12:03:29,940::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d893572c-654f-4f2f-80eb-059842eb0792`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4584::DEBUG::2014-09-09 12:03:29,940::task::993::Storage.TaskManager.Task::(_decref) Task=`d893572c-654f-4f2f-80eb-059842eb0792`::ref 1 aborting False >Thread-4584::INFO::2014-09-09 12:03:29,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282894270464', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4584::DEBUG::2014-09-09 12:03:29,942::task::1191::Storage.TaskManager.Task::(prepare) Task=`d893572c-654f-4f2f-80eb-059842eb0792`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282894270464', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4584::DEBUG::2014-09-09 12:03:29,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`d893572c-654f-4f2f-80eb-059842eb0792`::moving from state preparing -> state finished >Thread-4584::DEBUG::2014-09-09 12:03:29,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4584::DEBUG::2014-09-09 12:03:29,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4584::DEBUG::2014-09-09 12:03:29,942::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4584::DEBUG::2014-09-09 12:03:29,943::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4584::DEBUG::2014-09-09 12:03:29,943::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4584::DEBUG::2014-09-09 12:03:29,943::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4584::DEBUG::2014-09-09 12:03:29,943::task::993::Storage.TaskManager.Task::(_decref) Task=`d893572c-654f-4f2f-80eb-059842eb0792`::ref 0 aborting False >Thread-4584::DEBUG::2014-09-09 12:03:29,943::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282894270464', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283590524928', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4584::DEBUG::2014-09-09 12:03:29,943::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:30,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:30,906::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:30,906::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4585::DEBUG::2014-09-09 12:03:30,907::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:30,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895637 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:31,088::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:31,088::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:31,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) (9854) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) (9854) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) DEBUG|(9854) Building response >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) (9854) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:31,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:31,090::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:03:31,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:03:31,097::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112137 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) (9855) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:31,098::__init__::225::IOProcess::(_processLogs) (9855) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:31,099::__init__::225::IOProcess::(_processLogs) (9855) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:31,100::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:32,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:33,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895555 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:33,914::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:33,915::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4586::DEBUG::2014-09-09 12:03:33,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`294822b0-1148-4236-9b60-e0792b95a2cb`::moving from state init -> state preparing >Thread-4586::INFO::2014-09-09 12:03:33,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4586::INFO::2014-09-09 12:03:33,917::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112137', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000934965', 'lastCheck': '6.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00095579', 'lastCheck': '8.3', 'valid': True}} >Thread-4586::DEBUG::2014-09-09 12:03:33,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`294822b0-1148-4236-9b60-e0792b95a2cb`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112137', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000934965', 'lastCheck': '6.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00095579', 'lastCheck': '8.3', 'valid': True}} >Thread-4586::DEBUG::2014-09-09 12:03:33,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`294822b0-1148-4236-9b60-e0792b95a2cb`::moving from state preparing -> state finished >Thread-4586::DEBUG::2014-09-09 12:03:33,918::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4586::DEBUG::2014-09-09 12:03:33,918::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4586::DEBUG::2014-09-09 12:03:33,918::task::993::Storage.TaskManager.Task::(_decref) Task=`294822b0-1148-4236-9b60-e0792b95a2cb`::ref 0 aborting False >Thread-4586::DEBUG::2014-09-09 12:03:33,919::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:33,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:33,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4587::DEBUG::2014-09-09 12:03:33,932::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:35,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:35,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895072 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:35,590::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:35,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:35,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:35,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:35,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:35,590::__init__::225::IOProcess::(_processLogs) (9856) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:35,591::__init__::225::IOProcess::(_processLogs) (9856) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:35,592::__init__::225::IOProcess::(_processLogs) (9856) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:35,593::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:03:35,593::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:03:35,601::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00088316 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) (9857) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) (9857) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:35,602::__init__::225::IOProcess::(_processLogs) (9857) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:35,603::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:37,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:37,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089523 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) (9858) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) (9858) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:37,867::__init__::225::IOProcess::(_processLogs) (9858) Queuing response >Thread-24::DEBUG::2014-09-09 12:03:37,868::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:37,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:37,874::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:03:37,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000875599 s, 626 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:37,876::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:37,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) (9859) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) (9859) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) (9859) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:37,877::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:03:37,878::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:03:37,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:37,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) (9860) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) (9860) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) (9860) Building response >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) (9860) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:37,879::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) (9861) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) (9861) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) (9861) Building response >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) (9861) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:37,880::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:37,881::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:03:37,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:37,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:37,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:37,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:37,882::__init__::225::IOProcess::(_processLogs) (9862) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:37,882::__init__::225::IOProcess::(_processLogs) (9862) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:37,882::__init__::225::IOProcess::(_processLogs) (9862) Building response >Thread-19::DEBUG::2014-09-09 12:03:37,882::__init__::225::IOProcess::(_processLogs) (9862) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:37,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:37,882::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:38,101::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:38,102::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4588::DEBUG::2014-09-09 12:03:38,103::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:39,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:39,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895428 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:40,051::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:40,052::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4589::DEBUG::2014-09-09 12:03:40,052::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4589::DEBUG::2014-09-09 12:03:40,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e78ce28-cdb5-4bfb-943c-7d30e87773e6`::moving from state init -> state preparing >Thread-4589::INFO::2014-09-09 12:03:40,053::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4589::INFO::2014-09-09 12:03:40,053::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4589::DEBUG::2014-09-09 12:03:40,053::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e78ce28-cdb5-4bfb-943c-7d30e87773e6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4589::DEBUG::2014-09-09 12:03:40,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e78ce28-cdb5-4bfb-943c-7d30e87773e6`::moving from state preparing -> state finished >Thread-4589::DEBUG::2014-09-09 12:03:40,053::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4589::DEBUG::2014-09-09 12:03:40,053::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4589::DEBUG::2014-09-09 12:03:40,053::task::993::Storage.TaskManager.Task::(_decref) Task=`8e78ce28-cdb5-4bfb-943c-7d30e87773e6`::ref 0 aborting False >Thread-4589::DEBUG::2014-09-09 12:03:40,054::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4589::DEBUG::2014-09-09 12:03:40,054::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:40,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:40,232::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4590::DEBUG::2014-09-09 12:03:40,232::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4590::DEBUG::2014-09-09 12:03:40,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7e91d13-088e-4382-822b-9ab468715464`::moving from state init -> state preparing >Thread-4590::INFO::2014-09-09 12:03:40,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4590::DEBUG::2014-09-09 12:03:40,234::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`024377aa-f920-4cc2-9b2a-6ea4c7332ad2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4590::DEBUG::2014-09-09 12:03:40,234::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4590::DEBUG::2014-09-09 12:03:40,234::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4590::DEBUG::2014-09-09 12:03:40,234::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`024377aa-f920-4cc2-9b2a-6ea4c7332ad2`::Granted request >Thread-4590::DEBUG::2014-09-09 12:03:40,234::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c7e91d13-088e-4382-822b-9ab468715464`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4590::DEBUG::2014-09-09 12:03:40,234::task::993::Storage.TaskManager.Task::(_decref) Task=`c7e91d13-088e-4382-822b-9ab468715464`::ref 1 aborting False >Thread-4590::INFO::2014-09-09 12:03:40,236::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283328380928', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282991788032', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4590::DEBUG::2014-09-09 12:03:40,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7e91d13-088e-4382-822b-9ab468715464`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283328380928', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282991788032', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4590::DEBUG::2014-09-09 12:03:40,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7e91d13-088e-4382-822b-9ab468715464`::moving from state preparing -> state finished >Thread-4590::DEBUG::2014-09-09 12:03:40,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4590::DEBUG::2014-09-09 12:03:40,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4590::DEBUG::2014-09-09 12:03:40,237::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4590::DEBUG::2014-09-09 12:03:40,237::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4590::DEBUG::2014-09-09 12:03:40,237::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4590::DEBUG::2014-09-09 12:03:40,237::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4590::DEBUG::2014-09-09 12:03:40,237::task::993::Storage.TaskManager.Task::(_decref) Task=`c7e91d13-088e-4382-822b-9ab468715464`::ref 0 aborting False >Thread-4590::DEBUG::2014-09-09 12:03:40,237::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283328380928', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282991788032', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4590::DEBUG::2014-09-09 12:03:40,237::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:41,100::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) (9863) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:41,101::__init__::225::IOProcess::(_processLogs) (9863) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:41,102::__init__::225::IOProcess::(_processLogs) DEBUG|(9863) Building response >Thread-19::DEBUG::2014-09-09 12:03:41,102::__init__::225::IOProcess::(_processLogs) (9863) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:41,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:41,102::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:03:41,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:41,109::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:41,110::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-23::DEBUG::2014-09-09 12:03:41,112::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104427 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:41,113::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-4591::DEBUG::2014-09-09 12:03:41,114::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:41,114::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:41,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:41,115::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:41,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:41,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:41,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:41,115::__init__::225::IOProcess::(_processLogs) (9864) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:41,116::__init__::225::IOProcess::(_processLogs) DEBUG|(9864) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:41,116::__init__::225::IOProcess::(_processLogs) (9864) Building response >Thread-19::DEBUG::2014-09-09 12:03:41,116::__init__::225::IOProcess::(_processLogs) (9864) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:41,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:41,117::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:41,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:41,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0982233 s, 10.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:03:43,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:43,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897296 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:44,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:44,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4592::DEBUG::2014-09-09 12:03:44,122::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:45,604::__init__::225::IOProcess::(_processLogs) (9865) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:45,605::__init__::225::IOProcess::(_processLogs) (9865) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:45,605::__init__::225::IOProcess::(_processLogs) DEBUG|(9865) Building response >Thread-19::DEBUG::2014-09-09 12:03:45,605::__init__::225::IOProcess::(_processLogs) (9865) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:45,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:45,605::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:03:45,606::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:03:45,612::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000885853 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) (9866) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:45,613::__init__::225::IOProcess::(_processLogs) (9866) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:45,614::__init__::225::IOProcess::(_processLogs) DEBUG|(9866) Building response >Thread-19::DEBUG::2014-09-09 12:03:45,614::__init__::225::IOProcess::(_processLogs) (9866) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:45,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:45,614::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:45,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:45,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895451 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:47,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:47,128::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4593::DEBUG::2014-09-09 12:03:47,129::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:47,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:47,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:47,883::__init__::225::IOProcess::(_processLogs) (9867) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:47,883::__init__::225::IOProcess::(_processLogs) (9867) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:47,894::__init__::225::IOProcess::(_processLogs) DEBUG|(9867) Building response >Thread-19::DEBUG::2014-09-09 12:03:47,894::__init__::225::IOProcess::(_processLogs) (9867) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:47,895::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:47,896::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:03:47,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:47,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0977956 s, 10.5 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:03:47,905::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00088879 s, 617 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:47,906::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:47,907::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:47,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:47,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:47,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:47,909::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:47,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:47,910::__init__::225::IOProcess::(_processLogs) (9868) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:47,911::__init__::225::IOProcess::(_processLogs) (9868) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:47,911::__init__::225::IOProcess::(_processLogs) (9868) Building response >Thread-19::DEBUG::2014-09-09 12:03:47,911::__init__::225::IOProcess::(_processLogs) (9868) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:47,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:47,912::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:03:47,913::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:03:47,913::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:03:47,914::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:47,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:47,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:47,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:47,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:47,916::__init__::225::IOProcess::(_processLogs) (9869) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:47,917::__init__::225::IOProcess::(_processLogs) (9869) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:47,917::__init__::225::IOProcess::(_processLogs) (9869) Building response >Thread-19::DEBUG::2014-09-09 12:03:47,918::__init__::225::IOProcess::(_processLogs) (9869) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:47,919::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:47,919::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:47,920::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:47,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:47,921::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:47,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:47,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:47,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:47,922::__init__::225::IOProcess::(_processLogs) (9870) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:47,923::__init__::225::IOProcess::(_processLogs) (9870) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:47,923::__init__::225::IOProcess::(_processLogs) (9870) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:47,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:47,924::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:47,925::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:03:47,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:47,926::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:47,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:47,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:47,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:47,927::__init__::225::IOProcess::(_processLogs) (9871) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:47,927::__init__::225::IOProcess::(_processLogs) (9871) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:47,928::__init__::225::IOProcess::(_processLogs) (9871) Building response >Thread-19::DEBUG::2014-09-09 12:03:47,928::__init__::225::IOProcess::(_processLogs) (9871) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:47,929::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:03:49,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:50,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0943234 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:50,135::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:50,137::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4594::DEBUG::2014-09-09 12:03:50,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`f420924c-1804-4152-863a-8c3355a73ad9`::moving from state init -> state preparing >Thread-4594::INFO::2014-09-09 12:03:50,141::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4594::INFO::2014-09-09 12:03:50,142::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104427', 'lastCheck': '9.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00088879', 'lastCheck': '2.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000885853', 'lastCheck': '4.5', 'valid': True}} >Thread-4594::DEBUG::2014-09-09 12:03:50,143::task::1191::Storage.TaskManager.Task::(prepare) Task=`f420924c-1804-4152-863a-8c3355a73ad9`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104427', 'lastCheck': '9.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00088879', 'lastCheck': '2.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000885853', 'lastCheck': '4.5', 'valid': True}} >Thread-4594::DEBUG::2014-09-09 12:03:50,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`f420924c-1804-4152-863a-8c3355a73ad9`::moving from state preparing -> state finished >Thread-4594::DEBUG::2014-09-09 12:03:50,143::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4594::DEBUG::2014-09-09 12:03:50,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4594::DEBUG::2014-09-09 12:03:50,144::task::993::Storage.TaskManager.Task::(_decref) Task=`f420924c-1804-4152-863a-8c3355a73ad9`::ref 0 aborting False >Thread-4594::DEBUG::2014-09-09 12:03:50,148::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:50,156::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:50,157::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4595::DEBUG::2014-09-09 12:03:50,159::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:50,858::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4596::DEBUG::2014-09-09 12:03:50,859::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:03:50,859::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4596::DEBUG::2014-09-09 12:03:50,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c677ed3-8447-4a7d-b5d3-a7b5690484f0`::moving from state init -> state preparing >Thread-4596::INFO::2014-09-09 12:03:50,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4596::INFO::2014-09-09 12:03:50,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4596::DEBUG::2014-09-09 12:03:50,860::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c677ed3-8447-4a7d-b5d3-a7b5690484f0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4596::DEBUG::2014-09-09 12:03:50,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c677ed3-8447-4a7d-b5d3-a7b5690484f0`::moving from state preparing -> state finished >Thread-4596::DEBUG::2014-09-09 12:03:50,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4596::DEBUG::2014-09-09 12:03:50,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4596::DEBUG::2014-09-09 12:03:50,861::task::993::Storage.TaskManager.Task::(_decref) Task=`6c677ed3-8447-4a7d-b5d3-a7b5690484f0`::ref 0 aborting False >Thread-4596::DEBUG::2014-09-09 12:03:50,861::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4596::DEBUG::2014-09-09 12:03:50,861::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:50,972::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4597::DEBUG::2014-09-09 12:03:50,973::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:03:50,973::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4597::DEBUG::2014-09-09 12:03:50,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`93a1032f-5d20-4e46-b4a8-c93bb6e6de8c`::moving from state init -> state preparing >Thread-4597::INFO::2014-09-09 12:03:50,974::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4597::DEBUG::2014-09-09 12:03:50,974::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ee6fb76d-3f47-4c5c-ba40-b0beb27392d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4597::DEBUG::2014-09-09 12:03:50,974::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4597::DEBUG::2014-09-09 12:03:50,974::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4597::DEBUG::2014-09-09 12:03:50,975::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ee6fb76d-3f47-4c5c-ba40-b0beb27392d8`::Granted request >Thread-4597::DEBUG::2014-09-09 12:03:50,975::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`93a1032f-5d20-4e46-b4a8-c93bb6e6de8c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4597::DEBUG::2014-09-09 12:03:50,975::task::993::Storage.TaskManager.Task::(_decref) Task=`93a1032f-5d20-4e46-b4a8-c93bb6e6de8c`::ref 1 aborting False >Thread-4597::INFO::2014-09-09 12:03:50,976::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4597::DEBUG::2014-09-09 12:03:50,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`93a1032f-5d20-4e46-b4a8-c93bb6e6de8c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4597::DEBUG::2014-09-09 12:03:50,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`93a1032f-5d20-4e46-b4a8-c93bb6e6de8c`::moving from state preparing -> state finished >Thread-4597::DEBUG::2014-09-09 12:03:50,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4597::DEBUG::2014-09-09 12:03:50,977::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4597::DEBUG::2014-09-09 12:03:50,977::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4597::DEBUG::2014-09-09 12:03:50,977::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4597::DEBUG::2014-09-09 12:03:50,977::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4597::DEBUG::2014-09-09 12:03:50,977::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4597::DEBUG::2014-09-09 12:03:50,977::task::993::Storage.TaskManager.Task::(_decref) Task=`93a1032f-5d20-4e46-b4a8-c93bb6e6de8c`::ref 0 aborting False >Thread-4597::DEBUG::2014-09-09 12:03:50,977::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4597::DEBUG::2014-09-09 12:03:50,978::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) (9872) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:51,117::__init__::225::IOProcess::(_processLogs) (9872) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:51,118::__init__::225::IOProcess::(_processLogs) (9872) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:51,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:03:51,118::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:03:51,125::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113832 s, 987 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) (9873) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) (9873) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:51,126::__init__::225::IOProcess::(_processLogs) (9873) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:51,127::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:03:52,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:52,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895953 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:53,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:53,254::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4598::DEBUG::2014-09-09 12:03:53,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:54,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:54,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895017 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:55,615::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:55,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:55,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:55,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:55,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:55,616::__init__::225::IOProcess::(_processLogs) (9874) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:55,616::__init__::225::IOProcess::(_processLogs) (9874) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:55,617::__init__::225::IOProcess::(_processLogs) (9874) Queuing response >Thread-3443::DEBUG::2014-09-09 12:03:55,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:03:55,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:55,622::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:03:55,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000931626 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) (9875) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) (9875) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:55,625::__init__::225::IOProcess::(_processLogs) (9875) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:55,626::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:56,261::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:56,261::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4599::DEBUG::2014-09-09 12:03:56,262::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:03:56,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:56,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895479 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:57,930::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:57,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:57,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:57,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:57,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:57,930::__init__::225::IOProcess::(_processLogs) (9876) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:57,931::__init__::225::IOProcess::(_processLogs) (9876) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:57,931::__init__::225::IOProcess::(_processLogs) (9876) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:57,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:57,931::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:03:57,932::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:03:57,940::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100968 s, 543 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) (9877) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) (9877) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:03:57,941::__init__::225::IOProcess::(_processLogs) (9877) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:57,942::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:03:57,942::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:03:57,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) (9878) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) (9878) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) (9878) Building response >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) (9878) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:57,943::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) (9879) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) (9879) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) (9879) Building response >Thread-19::DEBUG::2014-09-09 12:03:57,944::__init__::225::IOProcess::(_processLogs) (9879) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:57,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:57,945::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:03:57,945::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:03:57,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:03:57,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:03:57,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) (9880) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) (9880) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) (9880) Building response >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) (9880) Queuing response >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:03:57,946::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:03:58,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:03:58,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899389 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:03:59,268::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:03:59,268::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4600::DEBUG::2014-09-09 12:03:59,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:00,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:00,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119718 s, 8.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) (9881) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:01,128::__init__::225::IOProcess::(_processLogs) (9881) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:01,129::__init__::225::IOProcess::(_processLogs) (9881) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:01,129::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:04:01,129::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:04:01,137::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108358 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) (9882) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:01,138::__init__::225::IOProcess::(_processLogs) (9882) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:01,139::__init__::225::IOProcess::(_processLogs) (9882) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:01,139::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:01,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4601::DEBUG::2014-09-09 12:04:01,350::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:04:01,351::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4601::DEBUG::2014-09-09 12:04:01,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`a95cd74f-0303-4e08-90b8-f4ed025731a3`::moving from state init -> state preparing >Thread-4601::INFO::2014-09-09 12:04:01,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4601::INFO::2014-09-09 12:04:01,352::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4601::DEBUG::2014-09-09 12:04:01,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`a95cd74f-0303-4e08-90b8-f4ed025731a3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4601::DEBUG::2014-09-09 12:04:01,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`a95cd74f-0303-4e08-90b8-f4ed025731a3`::moving from state preparing -> state finished >Thread-4601::DEBUG::2014-09-09 12:04:01,352::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4601::DEBUG::2014-09-09 12:04:01,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4601::DEBUG::2014-09-09 12:04:01,352::task::993::Storage.TaskManager.Task::(_decref) Task=`a95cd74f-0303-4e08-90b8-f4ed025731a3`::ref 0 aborting False >Thread-4601::DEBUG::2014-09-09 12:04:01,352::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4601::DEBUG::2014-09-09 12:04:01,353::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:02,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:02,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4602::DEBUG::2014-09-09 12:04:02,279::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:02,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:02,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894752 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:03,641::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4603::DEBUG::2014-09-09 12:04:03,642::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:04:03,641::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4603::DEBUG::2014-09-09 12:04:03,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`07509344-cdcb-4f8f-b21e-2cc839a15cc5`::moving from state init -> state preparing >Thread-4603::INFO::2014-09-09 12:04:03,643::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4603::DEBUG::2014-09-09 12:04:03,643::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1f423ab3-69e7-4c15-80a7-6e8f6334f652`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4603::DEBUG::2014-09-09 12:04:03,643::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4603::DEBUG::2014-09-09 12:04:03,643::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4603::DEBUG::2014-09-09 12:04:03,643::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1f423ab3-69e7-4c15-80a7-6e8f6334f652`::Granted request >Thread-4603::DEBUG::2014-09-09 12:04:03,644::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`07509344-cdcb-4f8f-b21e-2cc839a15cc5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4603::DEBUG::2014-09-09 12:04:03,644::task::993::Storage.TaskManager.Task::(_decref) Task=`07509344-cdcb-4f8f-b21e-2cc839a15cc5`::ref 1 aborting False >Thread-4603::INFO::2014-09-09 12:04:03,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282942504960', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283018002432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4603::DEBUG::2014-09-09 12:04:03,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`07509344-cdcb-4f8f-b21e-2cc839a15cc5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282942504960', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283018002432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4603::DEBUG::2014-09-09 12:04:03,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`07509344-cdcb-4f8f-b21e-2cc839a15cc5`::moving from state preparing -> state finished >Thread-4603::DEBUG::2014-09-09 12:04:03,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4603::DEBUG::2014-09-09 12:04:03,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4603::DEBUG::2014-09-09 12:04:03,646::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4603::DEBUG::2014-09-09 12:04:03,646::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4603::DEBUG::2014-09-09 12:04:03,646::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4603::DEBUG::2014-09-09 12:04:03,646::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4603::DEBUG::2014-09-09 12:04:03,646::task::993::Storage.TaskManager.Task::(_decref) Task=`07509344-cdcb-4f8f-b21e-2cc839a15cc5`::ref 0 aborting False >Thread-4603::DEBUG::2014-09-09 12:04:03,646::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282892173312', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282942504960', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283018002432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4603::DEBUG::2014-09-09 12:04:03,647::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:04,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:04,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895134 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:05,285::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:05,286::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4604::DEBUG::2014-09-09 12:04:05,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe72fefc-16b9-43d1-8cd9-c8d5a5b95a06`::moving from state init -> state preparing >Thread-4604::INFO::2014-09-09 12:04:05,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4604::INFO::2014-09-09 12:04:05,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108358', 'lastCheck': '4.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100968', 'lastCheck': '7.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000931626', 'lastCheck': '9.7', 'valid': True}} >Thread-4604::DEBUG::2014-09-09 12:04:05,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe72fefc-16b9-43d1-8cd9-c8d5a5b95a06`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108358', 'lastCheck': '4.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100968', 'lastCheck': '7.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000931626', 'lastCheck': '9.7', 'valid': True}} >Thread-4604::DEBUG::2014-09-09 12:04:05,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe72fefc-16b9-43d1-8cd9-c8d5a5b95a06`::moving from state preparing -> state finished >Thread-4604::DEBUG::2014-09-09 12:04:05,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4604::DEBUG::2014-09-09 12:04:05,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4604::DEBUG::2014-09-09 12:04:05,288::task::993::Storage.TaskManager.Task::(_decref) Task=`fe72fefc-16b9-43d1-8cd9-c8d5a5b95a06`::ref 0 aborting False >Thread-4604::DEBUG::2014-09-09 12:04:05,289::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:05,297::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:05,297::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4605::DEBUG::2014-09-09 12:04:05,298::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) (9883) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:05,627::__init__::225::IOProcess::(_processLogs) (9883) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:05,628::__init__::225::IOProcess::(_processLogs) (9883) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:05,628::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:04:05,628::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:04:05,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000884211 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:05,636::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:05,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:05,636::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:05,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:05,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:05,637::__init__::225::IOProcess::(_processLogs) (9884) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:05,637::__init__::225::IOProcess::(_processLogs) (9884) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:05,637::__init__::225::IOProcess::(_processLogs) (9884) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:05,637::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:04:06,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:06,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894668 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:07,946::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:07,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:07,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:07,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:07,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:07,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:07,947::__init__::225::IOProcess::(_processLogs) (9885) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:07,947::__init__::225::IOProcess::(_processLogs) (9885) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:07,947::__init__::225::IOProcess::(_processLogs) DEBUG|(9885) Building response >Thread-19::DEBUG::2014-09-09 12:04:07,947::__init__::225::IOProcess::(_processLogs) (9885) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:07,947::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:04:07,948::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:04:07,948::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:04:07,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000875812 s, 626 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:07,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:07,956::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:07,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:07,956::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:07,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) (9886) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) (9886) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) DEBUG|(9886) Building response >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) (9886) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:07,957::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:04:07,958::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:07,958::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:04:07,958::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:07,958::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) (9887) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) (9887) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) (9887) Building response >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) (9887) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:07,959::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) (9888) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) (9888) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:07,960::__init__::225::IOProcess::(_processLogs) (9888) Building response >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) (9888) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) (9889) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:07,961::__init__::225::IOProcess::(_processLogs) (9889) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:07,996::__init__::225::IOProcess::(_processLogs) DEBUG|(9889) Building response >Thread-19::DEBUG::2014-09-09 12:04:07,996::__init__::225::IOProcess::(_processLogs) (9889) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:07,996::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:04:07,997::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:08,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:08,581::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4606::DEBUG::2014-09-09 12:04:08,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:08,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:09,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895823 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:04:11,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:11,140::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:11,140::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:11,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:11,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:11,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:11,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:11,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:11,141::__init__::225::IOProcess::(_processLogs) (9890) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:11,141::__init__::225::IOProcess::(_processLogs) (9890) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:11,166::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9890) Building response >Thread-19::DEBUG::2014-09-09 12:04:11,166::__init__::225::IOProcess::(_processLogs) (9890) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:11,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:11,168::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:04:11,169::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:11,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0985051 s, 10.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:04:11,177::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.000987877 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:11,178::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:11,178::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:11,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:11,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:11,180::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:11,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:11,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:11,182::__init__::225::IOProcess::(_processLogs) (9891) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:11,182::__init__::225::IOProcess::(_processLogs) (9891) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:11,183::__init__::225::IOProcess::(_processLogs) (9891) Building response >Thread-19::DEBUG::2014-09-09 12:04:11,183::__init__::225::IOProcess::(_processLogs) (9891) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:11,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:11,184::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:11,587::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:11,588::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4607::DEBUG::2014-09-09 12:04:11,589::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:13,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:13,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896752 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:14,034::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4608::DEBUG::2014-09-09 12:04:14,034::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:04:14,035::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4608::DEBUG::2014-09-09 12:04:14,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2852f57-d91a-481b-bf2d-5e8d3644d62e`::moving from state init -> state preparing >Thread-4608::INFO::2014-09-09 12:04:14,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4608::INFO::2014-09-09 12:04:14,036::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4608::DEBUG::2014-09-09 12:04:14,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2852f57-d91a-481b-bf2d-5e8d3644d62e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4608::DEBUG::2014-09-09 12:04:14,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2852f57-d91a-481b-bf2d-5e8d3644d62e`::moving from state preparing -> state finished >Thread-4608::DEBUG::2014-09-09 12:04:14,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4608::DEBUG::2014-09-09 12:04:14,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4608::DEBUG::2014-09-09 12:04:14,037::task::993::Storage.TaskManager.Task::(_decref) Task=`e2852f57-d91a-481b-bf2d-5e8d3644d62e`::ref 0 aborting False >Thread-4608::DEBUG::2014-09-09 12:04:14,037::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4608::DEBUG::2014-09-09 12:04:14,037::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:14,101::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:14,102::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4609::DEBUG::2014-09-09 12:04:14,102::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4609::DEBUG::2014-09-09 12:04:14,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed6bff6-9308-4006-83b6-a7ac255f64d3`::moving from state init -> state preparing >Thread-4609::INFO::2014-09-09 12:04:14,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4609::DEBUG::2014-09-09 12:04:14,103::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0dc4f50f-61db-479b-ae64-3f829dbff3ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4609::DEBUG::2014-09-09 12:04:14,103::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4609::DEBUG::2014-09-09 12:04:14,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4609::DEBUG::2014-09-09 12:04:14,104::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0dc4f50f-61db-479b-ae64-3f829dbff3ed`::Granted request >Thread-4609::DEBUG::2014-09-09 12:04:14,104::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9ed6bff6-9308-4006-83b6-a7ac255f64d3`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4609::DEBUG::2014-09-09 12:04:14,104::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed6bff6-9308-4006-83b6-a7ac255f64d3`::ref 1 aborting False >Thread-4609::INFO::2014-09-09 12:04:14,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282893221888', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4609::DEBUG::2014-09-09 12:04:14,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ed6bff6-9308-4006-83b6-a7ac255f64d3`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282893221888', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4609::DEBUG::2014-09-09 12:04:14,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed6bff6-9308-4006-83b6-a7ac255f64d3`::moving from state preparing -> state finished >Thread-4609::DEBUG::2014-09-09 12:04:14,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4609::DEBUG::2014-09-09 12:04:14,106::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4609::DEBUG::2014-09-09 12:04:14,106::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4609::DEBUG::2014-09-09 12:04:14,106::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4609::DEBUG::2014-09-09 12:04:14,106::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4609::DEBUG::2014-09-09 12:04:14,106::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4609::DEBUG::2014-09-09 12:04:14,106::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed6bff6-9308-4006-83b6-a7ac255f64d3`::ref 0 aborting False >Thread-4609::DEBUG::2014-09-09 12:04:14,107::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283587379200', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '282893221888', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4609::DEBUG::2014-09-09 12:04:14,107::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:14,595::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:14,595::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4610::DEBUG::2014-09-09 12:04:14,596::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:15,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:15,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895123 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) (9892) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) (9892) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9892) Building response >Thread-19::DEBUG::2014-09-09 12:04:15,639::__init__::225::IOProcess::(_processLogs) (9892) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:15,640::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:04:15,640::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:15,640::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:04:15,648::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000911618 s, 389 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) (9893) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:15,649::__init__::225::IOProcess::(_processLogs) (9893) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:15,650::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9893) Building response >Thread-19::DEBUG::2014-09-09 12:04:15,650::__init__::225::IOProcess::(_processLogs) (9893) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:15,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:15,650::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:04:17,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:17,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895065 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:17,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:17,603::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4611::DEBUG::2014-09-09 12:04:17,604::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:17,997::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:17,997::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:17,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:17,997::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:17,997::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:17,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:17,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:17,998::__init__::225::IOProcess::(_processLogs) (9894) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:17,998::__init__::225::IOProcess::(_processLogs) (9894) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:17,999::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9894) Building response >Thread-19::DEBUG::2014-09-09 12:04:17,999::__init__::225::IOProcess::(_processLogs) (9894) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:17,999::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:04:17,999::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:04:18,000::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:04:18,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000900097 s, 609 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:18,009::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:18,009::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:18,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) (9895) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) (9895) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:18,010::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9895) Building response >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) (9895) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:18,011::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) (9896) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) (9896) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) (9896) Building response >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) (9896) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:18,012::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:18,013::__init__::225::IOProcess::(_processLogs) (9897) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) (9897) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) (9897) Building response >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) (9897) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:18,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) (9898) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) (9898) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) (9898) Building response >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) (9898) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:18,015::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:04:19,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:19,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938222 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:20,609::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:20,610::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4612::DEBUG::2014-09-09 12:04:20,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`af83a571-6b6e-4c07-ae72-efe97b32f180`::moving from state init -> state preparing >Thread-4612::INFO::2014-09-09 12:04:20,611::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4612::INFO::2014-09-09 12:04:20,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987877', 'lastCheck': '9.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000900097', 'lastCheck': '2.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911618', 'lastCheck': '5.0', 'valid': True}} >Thread-4612::DEBUG::2014-09-09 12:04:20,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`af83a571-6b6e-4c07-ae72-efe97b32f180`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987877', 'lastCheck': '9.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000900097', 'lastCheck': '2.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911618', 'lastCheck': '5.0', 'valid': True}} >Thread-4612::DEBUG::2014-09-09 12:04:20,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`af83a571-6b6e-4c07-ae72-efe97b32f180`::moving from state preparing -> state finished >Thread-4612::DEBUG::2014-09-09 12:04:20,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4612::DEBUG::2014-09-09 12:04:20,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4612::DEBUG::2014-09-09 12:04:20,611::task::993::Storage.TaskManager.Task::(_decref) Task=`af83a571-6b6e-4c07-ae72-efe97b32f180`::ref 0 aborting False >Thread-4612::DEBUG::2014-09-09 12:04:20,612::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:20,618::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:20,619::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4613::DEBUG::2014-09-09 12:04:20,620::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:21,181::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) (9899) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) (9899) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9899) Building response >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) (9899) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:21,182::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:04:21,183::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:04:21,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:04:21,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108121 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) (9900) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:21,191::__init__::225::IOProcess::(_processLogs) (9900) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:21,192::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9900) Building response >Thread-19::DEBUG::2014-09-09 12:04:21,192::__init__::225::IOProcess::(_processLogs) (9900) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:21,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:21,192::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:04:21,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:21,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895425 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:04:23,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:23,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895736 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:24,141::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:24,142::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4614::DEBUG::2014-09-09 12:04:24,142::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:24,360::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:24,361::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4615::DEBUG::2014-09-09 12:04:24,361::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4615::DEBUG::2014-09-09 12:04:24,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e902f67-2807-4a19-8ece-677c1cf860ff`::moving from state init -> state preparing >Thread-4615::INFO::2014-09-09 12:04:24,362::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4615::INFO::2014-09-09 12:04:24,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4615::DEBUG::2014-09-09 12:04:24,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e902f67-2807-4a19-8ece-677c1cf860ff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4615::DEBUG::2014-09-09 12:04:24,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e902f67-2807-4a19-8ece-677c1cf860ff`::moving from state preparing -> state finished >Thread-4615::DEBUG::2014-09-09 12:04:24,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4615::DEBUG::2014-09-09 12:04:24,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4615::DEBUG::2014-09-09 12:04:24,363::task::993::Storage.TaskManager.Task::(_decref) Task=`4e902f67-2807-4a19-8ece-677c1cf860ff`::ref 0 aborting False >Thread-4615::DEBUG::2014-09-09 12:04:24,363::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4615::DEBUG::2014-09-09 12:04:24,363::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:24,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4616::DEBUG::2014-09-09 12:04:24,584::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:04:24,584::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4616::DEBUG::2014-09-09 12:04:24,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`03658374-08d0-4bb9-b1a0-864309e3498e`::moving from state init -> state preparing >Thread-4616::INFO::2014-09-09 12:04:24,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4616::DEBUG::2014-09-09 12:04:24,586::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4b5009db-dac6-4349-9a55-91f9af704ffb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4616::DEBUG::2014-09-09 12:04:24,586::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4616::DEBUG::2014-09-09 12:04:24,586::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4616::DEBUG::2014-09-09 12:04:24,586::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4b5009db-dac6-4349-9a55-91f9af704ffb`::Granted request >Thread-4616::DEBUG::2014-09-09 12:04:24,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`03658374-08d0-4bb9-b1a0-864309e3498e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4616::DEBUG::2014-09-09 12:04:24,586::task::993::Storage.TaskManager.Task::(_decref) Task=`03658374-08d0-4bb9-b1a0-864309e3498e`::ref 1 aborting False >Thread-4616::INFO::2014-09-09 12:04:24,588::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282987593728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283163754496', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4616::DEBUG::2014-09-09 12:04:24,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`03658374-08d0-4bb9-b1a0-864309e3498e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282987593728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283163754496', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4616::DEBUG::2014-09-09 12:04:24,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`03658374-08d0-4bb9-b1a0-864309e3498e`::moving from state preparing -> state finished >Thread-4616::DEBUG::2014-09-09 12:04:24,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4616::DEBUG::2014-09-09 12:04:24,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4616::DEBUG::2014-09-09 12:04:24,588::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4616::DEBUG::2014-09-09 12:04:24,588::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4616::DEBUG::2014-09-09 12:04:24,589::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4616::DEBUG::2014-09-09 12:04:24,589::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4616::DEBUG::2014-09-09 12:04:24,589::task::993::Storage.TaskManager.Task::(_decref) Task=`03658374-08d0-4bb9-b1a0-864309e3498e`::ref 0 aborting False >Thread-4616::DEBUG::2014-09-09 12:04:24,589::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282987593728', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283163754496', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4616::DEBUG::2014-09-09 12:04:24,589::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:25,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:25,651::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:25,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:25,651::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:25,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:25,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:25,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:25,652::__init__::225::IOProcess::(_processLogs) (9901) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:25,652::__init__::225::IOProcess::(_processLogs) (9901) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:25,652::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9901) Building response >Thread-19::DEBUG::2014-09-09 12:04:25,653::__init__::225::IOProcess::(_processLogs) (9901) Queuing response >Thread-3443::DEBUG::2014-09-09 12:04:25,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:25,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:25,658::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:04:25,660::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000885657 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:25,660::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:25,660::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:25,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) (9902) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) (9902) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9902) Building response >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) (9902) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:25,661::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:04:25,662::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:04:25,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:25,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895056 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:27,150::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:27,151::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4617::DEBUG::2014-09-09 12:04:27,152::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:27,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:28,015::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) (9903) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:28,016::__init__::225::IOProcess::(_processLogs) (9903) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:28,084::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9903) Building response >Thread-19::DEBUG::2014-09-09 12:04:28,084::__init__::225::IOProcess::(_processLogs) (9903) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:28,085::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:04:28,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:28,086::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:04:28,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0970866 s, 10.5 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:04:28,094::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000878071 s, 624 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:28,095::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:28,096::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:28,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:28,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:28,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:28,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:28,098::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:28,099::__init__::225::IOProcess::(_processLogs) (9904) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:28,100::__init__::225::IOProcess::(_processLogs) (9904) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:28,100::__init__::225::IOProcess::(_processLogs) (9904) Building response >Thread-19::DEBUG::2014-09-09 12:04:28,101::__init__::225::IOProcess::(_processLogs) (9904) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:28,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:28,101::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:04:28,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:28,103::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:04:28,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:28,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:28,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:28,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:28,105::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:28,106::__init__::225::IOProcess::(_processLogs) (9905) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:28,106::__init__::225::IOProcess::(_processLogs) (9905) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:28,106::__init__::225::IOProcess::(_processLogs) (9905) Building response >Thread-19::DEBUG::2014-09-09 12:04:28,107::__init__::225::IOProcess::(_processLogs) (9905) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:28,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:28,107::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:28,108::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:28,108::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:04:28,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:28,109::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:28,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:28,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:28,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:28,111::__init__::225::IOProcess::(_processLogs) (9906) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:28,111::__init__::225::IOProcess::(_processLogs) (9906) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:28,112::__init__::225::IOProcess::(_processLogs) (9906) Building response >Thread-19::DEBUG::2014-09-09 12:04:28,112::__init__::225::IOProcess::(_processLogs) (9906) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:28,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:28,113::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:28,114::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:04:28,114::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:28,114::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:28,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:28,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:28,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:28,116::__init__::225::IOProcess::(_processLogs) (9907) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:28,116::__init__::225::IOProcess::(_processLogs) (9907) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:28,116::__init__::225::IOProcess::(_processLogs) (9907) Building response >Thread-19::DEBUG::2014-09-09 12:04:28,117::__init__::225::IOProcess::(_processLogs) (9907) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:28,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:28,118::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:04:30,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:30,165::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:30,166::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4618::DEBUG::2014-09-09 12:04:30,167::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:30,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089413 s, 11.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:31,193::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:31,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:31,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:31,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:31,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:31,194::__init__::225::IOProcess::(_processLogs) (9908) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:31,194::__init__::225::IOProcess::(_processLogs) (9908) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:31,194::__init__::225::IOProcess::(_processLogs) (9908) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:31,194::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:04:31,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:04:31,201::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108641 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:31,202::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:31,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:31,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:31,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:31,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:31,202::__init__::225::IOProcess::(_processLogs) (9909) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:31,203::__init__::225::IOProcess::(_processLogs) (9909) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:31,203::__init__::225::IOProcess::(_processLogs) (9909) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:31,203::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:04:32,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:32,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895422 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:33,174::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:33,175::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4619::DEBUG::2014-09-09 12:04:33,176::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:34,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:34,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899157 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:35,044::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:35,045::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4620::DEBUG::2014-09-09 12:04:35,045::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4620::DEBUG::2014-09-09 12:04:35,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`358651f3-d0fe-4dae-9e8f-2e15a6cd972d`::moving from state init -> state preparing >Thread-4620::INFO::2014-09-09 12:04:35,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4620::INFO::2014-09-09 12:04:35,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4620::DEBUG::2014-09-09 12:04:35,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`358651f3-d0fe-4dae-9e8f-2e15a6cd972d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4620::DEBUG::2014-09-09 12:04:35,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`358651f3-d0fe-4dae-9e8f-2e15a6cd972d`::moving from state preparing -> state finished >Thread-4620::DEBUG::2014-09-09 12:04:35,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4620::DEBUG::2014-09-09 12:04:35,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4620::DEBUG::2014-09-09 12:04:35,047::task::993::Storage.TaskManager.Task::(_decref) Task=`358651f3-d0fe-4dae-9e8f-2e15a6cd972d`::ref 0 aborting False >Thread-4620::DEBUG::2014-09-09 12:04:35,047::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4620::DEBUG::2014-09-09 12:04:35,047::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:35,663::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:35,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:35,663::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:35,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:35,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:35,663::__init__::225::IOProcess::(_processLogs) (9910) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:35,664::__init__::225::IOProcess::(_processLogs) (9910) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:35,665::__init__::225::IOProcess::(_processLogs) (9910) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:35,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:04:35,665::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:04:35,673::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00093202 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:35,673::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) (9911) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) (9911) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) (9911) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:35,674::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:36,180::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:36,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4621::DEBUG::2014-09-09 12:04:36,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`f43f1030-1891-466b-ac18-29dd56450e16`::moving from state init -> state preparing >Thread-4621::INFO::2014-09-09 12:04:36,182::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4621::INFO::2014-09-09 12:04:36,182::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108641', 'lastCheck': '5.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878071', 'lastCheck': '8.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00093202', 'lastCheck': '0.5', 'valid': True}} >Thread-4621::DEBUG::2014-09-09 12:04:36,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`f43f1030-1891-466b-ac18-29dd56450e16`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108641', 'lastCheck': '5.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878071', 'lastCheck': '8.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00093202', 'lastCheck': '0.5', 'valid': True}} >Thread-4621::DEBUG::2014-09-09 12:04:36,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`f43f1030-1891-466b-ac18-29dd56450e16`::moving from state preparing -> state finished >Thread-4621::DEBUG::2014-09-09 12:04:36,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4621::DEBUG::2014-09-09 12:04:36,183::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4621::DEBUG::2014-09-09 12:04:36,183::task::993::Storage.TaskManager.Task::(_decref) Task=`f43f1030-1891-466b-ac18-29dd56450e16`::ref 0 aborting False >Thread-4621::DEBUG::2014-09-09 12:04:36,183::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:36,190::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:36,190::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4622::DEBUG::2014-09-09 12:04:36,191::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:36,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:36,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894884 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:37,310::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4623::DEBUG::2014-09-09 12:04:37,311::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:04:37,311::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4623::DEBUG::2014-09-09 12:04:37,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`a07aa313-70b2-4ebd-9e54-c1beb6e7b210`::moving from state init -> state preparing >Thread-4623::INFO::2014-09-09 12:04:37,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4623::DEBUG::2014-09-09 12:04:37,312::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fb03893a-2a02-4032-b4d3-01a8b13a2b87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4623::DEBUG::2014-09-09 12:04:37,312::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4623::DEBUG::2014-09-09 12:04:37,313::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4623::DEBUG::2014-09-09 12:04:37,313::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fb03893a-2a02-4032-b4d3-01a8b13a2b87`::Granted request >Thread-4623::DEBUG::2014-09-09 12:04:37,313::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a07aa313-70b2-4ebd-9e54-c1beb6e7b210`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4623::DEBUG::2014-09-09 12:04:37,313::task::993::Storage.TaskManager.Task::(_decref) Task=`a07aa313-70b2-4ebd-9e54-c1beb6e7b210`::ref 1 aborting False >Thread-4623::INFO::2014-09-09 12:04:37,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283065188352', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4623::DEBUG::2014-09-09 12:04:37,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`a07aa313-70b2-4ebd-9e54-c1beb6e7b210`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283065188352', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4623::DEBUG::2014-09-09 12:04:37,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`a07aa313-70b2-4ebd-9e54-c1beb6e7b210`::moving from state preparing -> state finished >Thread-4623::DEBUG::2014-09-09 12:04:37,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4623::DEBUG::2014-09-09 12:04:37,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4623::DEBUG::2014-09-09 12:04:37,315::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4623::DEBUG::2014-09-09 12:04:37,315::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4623::DEBUG::2014-09-09 12:04:37,315::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4623::DEBUG::2014-09-09 12:04:37,315::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4623::DEBUG::2014-09-09 12:04:37,316::task::993::Storage.TaskManager.Task::(_decref) Task=`a07aa313-70b2-4ebd-9e54-c1beb6e7b210`::ref 0 aborting False >Thread-4623::DEBUG::2014-09-09 12:04:37,316::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283065188352', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4623::DEBUG::2014-09-09 12:04:37,316::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) (9912) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:38,118::__init__::225::IOProcess::(_processLogs) (9912) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:38,119::__init__::225::IOProcess::(_processLogs) (9912) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:38,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:04:38,119::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:04:38,127::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000995655 s, 550 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:38,127::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:38,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) (9913) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) (9913) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) (9913) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:38,128::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) (9914) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) (9914) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:38,129::__init__::225::IOProcess::(_processLogs) (9914) Building response >Thread-19::DEBUG::2014-09-09 12:04:38,130::__init__::225::IOProcess::(_processLogs) (9914) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:38,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:38,130::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:38,130::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:04:38,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:38,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) (9915) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) (9915) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) (9915) Building response >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) (9915) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:38,131::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) (9916) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) (9916) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) (9916) Building response >Thread-19::DEBUG::2014-09-09 12:04:38,132::__init__::225::IOProcess::(_processLogs) (9916) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:38,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:38,133::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:04:38,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:38,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894576 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:04:40,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:40,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898298 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:40,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:40,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4624::DEBUG::2014-09-09 12:04:40,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:04:41,204::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:41,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:41,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:41,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:41,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:41,205::__init__::225::IOProcess::(_processLogs) (9917) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:41,205::__init__::225::IOProcess::(_processLogs) (9917) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:41,206::__init__::225::IOProcess::(_processLogs) (9917) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:41,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:04:41,206::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:04:41,214::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117696 s, 954 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:41,214::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:41,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:41,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:41,214::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:41,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:41,215::__init__::225::IOProcess::(_processLogs) (9918) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:41,215::__init__::225::IOProcess::(_processLogs) (9918) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:41,215::__init__::225::IOProcess::(_processLogs) (9918) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:41,215::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:04:42,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:42,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895826 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:43,833::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:43,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4625::DEBUG::2014-09-09 12:04:43,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:44,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:44,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894834 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:45,675::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) (9919) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) (9919) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:45,676::__init__::225::IOProcess::(_processLogs) (9919) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:45,677::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:04:45,677::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:04:45,684::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910378 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) (9920) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) (9920) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:45,685::__init__::225::IOProcess::(_processLogs) (9920) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:45,686::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:46,841::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:46,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4626::DEBUG::2014-09-09 12:04:46,843::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:46,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:47,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895932 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:48,132::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:48,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:48,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:48,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:48,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:48,133::__init__::225::IOProcess::(_processLogs) (9921) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:48,133::__init__::225::IOProcess::(_processLogs) (9921) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:48,134::__init__::225::IOProcess::(_processLogs) (9921) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:48,134::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:04:48,135::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:04:48,142::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00105076 s, 522 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) (9922) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:48,143::__init__::225::IOProcess::(_processLogs) (9922) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:48,144::__init__::225::IOProcess::(_processLogs) (9922) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:48,144::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:04:48,144::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) (9923) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) (9923) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:48,145::__init__::225::IOProcess::(_processLogs) (9923) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) (9924) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:48,146::__init__::225::IOProcess::(_processLogs) (9924) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:48,147::__init__::225::IOProcess::(_processLogs) (9924) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:48,147::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:48,147::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:04:48,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:48,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) (9925) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) (9925) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) (9925) Building response >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) (9925) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:48,148::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:04:49,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:49,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895855 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:49,822::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:49,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4627::DEBUG::2014-09-09 12:04:49,824::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4627::DEBUG::2014-09-09 12:04:49,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`7bbcce7a-bfa6-4f2d-acae-78ccb44952bb`::moving from state init -> state preparing >Thread-4627::INFO::2014-09-09 12:04:49,828::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4627::INFO::2014-09-09 12:04:49,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4627::DEBUG::2014-09-09 12:04:49,831::task::1191::Storage.TaskManager.Task::(prepare) Task=`7bbcce7a-bfa6-4f2d-acae-78ccb44952bb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4627::DEBUG::2014-09-09 12:04:49,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`7bbcce7a-bfa6-4f2d-acae-78ccb44952bb`::moving from state preparing -> state finished >Thread-4627::DEBUG::2014-09-09 12:04:49,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4627::DEBUG::2014-09-09 12:04:49,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4627::DEBUG::2014-09-09 12:04:49,833::task::993::Storage.TaskManager.Task::(_decref) Task=`7bbcce7a-bfa6-4f2d-acae-78ccb44952bb`::ref 0 aborting False >Thread-4627::DEBUG::2014-09-09 12:04:49,834::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4627::DEBUG::2014-09-09 12:04:49,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:49,849::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:49,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4628::DEBUG::2014-09-09 12:04:49,853::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:49,887::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:49,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4629::DEBUG::2014-09-09 12:04:49,888::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4629::DEBUG::2014-09-09 12:04:49,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6b0f831-8ee8-450b-85a8-d10b616dad22`::moving from state init -> state preparing >Thread-4629::INFO::2014-09-09 12:04:49,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4629::DEBUG::2014-09-09 12:04:49,894::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bcdec2af-b2ac-41cc-a65b-33ff01b7f7ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4629::DEBUG::2014-09-09 12:04:49,895::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4629::DEBUG::2014-09-09 12:04:49,896::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4629::DEBUG::2014-09-09 12:04:49,896::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`bcdec2af-b2ac-41cc-a65b-33ff01b7f7ef`::Granted request >Thread-4629::DEBUG::2014-09-09 12:04:49,897::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d6b0f831-8ee8-450b-85a8-d10b616dad22`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4629::DEBUG::2014-09-09 12:04:49,898::task::993::Storage.TaskManager.Task::(_decref) Task=`d6b0f831-8ee8-450b-85a8-d10b616dad22`::ref 1 aborting False >Thread-4629::INFO::2014-09-09 12:04:49,905::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282881687552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4629::DEBUG::2014-09-09 12:04:49,905::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6b0f831-8ee8-450b-85a8-d10b616dad22`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282881687552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4629::DEBUG::2014-09-09 12:04:49,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6b0f831-8ee8-450b-85a8-d10b616dad22`::moving from state preparing -> state finished >Thread-4629::DEBUG::2014-09-09 12:04:49,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4629::DEBUG::2014-09-09 12:04:49,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4629::DEBUG::2014-09-09 12:04:49,907::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4629::DEBUG::2014-09-09 12:04:49,908::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4629::DEBUG::2014-09-09 12:04:49,908::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4629::DEBUG::2014-09-09 12:04:49,909::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4629::DEBUG::2014-09-09 12:04:49,909::task::993::Storage.TaskManager.Task::(_decref) Task=`d6b0f831-8ee8-450b-85a8-d10b616dad22`::ref 0 aborting False >Thread-4629::DEBUG::2014-09-09 12:04:49,910::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '282881687552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283576893440', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4629::DEBUG::2014-09-09 12:04:49,911::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:51,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:51,216::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:51,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:51,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:51,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:51,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:51,217::__init__::225::IOProcess::(_processLogs) (9926) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:51,217::__init__::225::IOProcess::(_processLogs) (9926) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:51,263::__init__::225::IOProcess::(_processLogs) (9926) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:51,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:04:51,265::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:51,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0961868 s, 10.6 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:04:51,272::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00102678 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:51,274::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:04:51,274::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:51,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:51,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:51,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:51,277::__init__::225::IOProcess::(_processLogs) (9927) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:51,277::__init__::225::IOProcess::(_processLogs) (9927) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:51,278::__init__::225::IOProcess::(_processLogs) (9927) Building response >Thread-19::DEBUG::2014-09-09 12:04:51,278::__init__::225::IOProcess::(_processLogs) (9927) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:51,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:51,279::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:52,860::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:52,860::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4630::DEBUG::2014-09-09 12:04:52,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f9caf56-0c65-4d48-9640-41d0eb110e01`::moving from state init -> state preparing >Thread-4630::INFO::2014-09-09 12:04:52,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4630::INFO::2014-09-09 12:04:52,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102678', 'lastCheck': '1.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105076', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910378', 'lastCheck': '7.2', 'valid': True}} >Thread-4630::DEBUG::2014-09-09 12:04:52,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f9caf56-0c65-4d48-9640-41d0eb110e01`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102678', 'lastCheck': '1.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105076', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910378', 'lastCheck': '7.2', 'valid': True}} >Thread-4630::DEBUG::2014-09-09 12:04:52,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f9caf56-0c65-4d48-9640-41d0eb110e01`::moving from state preparing -> state finished >Thread-4630::DEBUG::2014-09-09 12:04:52,862::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4630::DEBUG::2014-09-09 12:04:52,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4630::DEBUG::2014-09-09 12:04:52,862::task::993::Storage.TaskManager.Task::(_decref) Task=`2f9caf56-0c65-4d48-9640-41d0eb110e01`::ref 0 aborting False >Thread-4630::DEBUG::2014-09-09 12:04:52,863::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:52,869::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:52,869::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4631::DEBUG::2014-09-09 12:04:52,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:53,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:53,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894928 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:04:55,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:55,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895768 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:55,687::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:55,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:55,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:55,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:55,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:55,687::__init__::225::IOProcess::(_processLogs) (9928) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:55,688::__init__::225::IOProcess::(_processLogs) (9928) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:55,688::__init__::225::IOProcess::(_processLogs) (9928) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:55,688::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:04:55,689::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:04:55,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000857371 s, 414 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:55,696::__init__::225::IOProcess::(_processLogs) (9929) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:55,697::__init__::225::IOProcess::(_processLogs) (9929) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:55,697::__init__::225::IOProcess::(_processLogs) (9929) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:55,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:55,698::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:56,543::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:56,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4632::DEBUG::2014-09-09 12:04:56,545::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:57,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:04:57,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894845 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:58,148::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:58,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:58,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:58,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:58,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:58,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:58,149::__init__::225::IOProcess::(_processLogs) (9930) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:58,149::__init__::225::IOProcess::(_processLogs) (9930) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:58,150::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9930) Building response >Thread-19::DEBUG::2014-09-09 12:04:58,150::__init__::225::IOProcess::(_processLogs) (9930) Queuing response >Thread-24::DEBUG::2014-09-09 12:04:58,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:04:58,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:58,156::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:04:58,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000905091 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) (9931) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:04:58,160::__init__::225::IOProcess::(_processLogs) (9931) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:04:58,161::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9931) Building response >Thread-19::DEBUG::2014-09-09 12:04:58,161::__init__::225::IOProcess::(_processLogs) (9931) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:58,161::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:58,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) (9932) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) (9932) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) (9932) Building response >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) (9932) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:04:58,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) (9933) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) (9933) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) (9933) Building response >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) (9933) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:58,164::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:04:58,165::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:04:58,165::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:04:58,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:04:58,165::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:04:58,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) (9934) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) (9934) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) (9934) Building response >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) (9934) Queuing response >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:04:58,166::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:04:59,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:59,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:59,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4633::DEBUG::2014-09-09 12:04:59,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:04:59,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895461 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:04:59,964::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:04:59,965::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4634::DEBUG::2014-09-09 12:04:59,965::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4634::DEBUG::2014-09-09 12:04:59,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f7e8da3-8fe6-4348-961a-2c8b0b12c2ce`::moving from state init -> state preparing >Thread-4634::INFO::2014-09-09 12:04:59,966::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4634::INFO::2014-09-09 12:04:59,966::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4634::DEBUG::2014-09-09 12:04:59,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f7e8da3-8fe6-4348-961a-2c8b0b12c2ce`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4634::DEBUG::2014-09-09 12:04:59,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f7e8da3-8fe6-4348-961a-2c8b0b12c2ce`::moving from state preparing -> state finished >Thread-4634::DEBUG::2014-09-09 12:04:59,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4634::DEBUG::2014-09-09 12:04:59,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4634::DEBUG::2014-09-09 12:04:59,966::task::993::Storage.TaskManager.Task::(_decref) Task=`1f7e8da3-8fe6-4348-961a-2c8b0b12c2ce`::ref 0 aborting False >Thread-4634::DEBUG::2014-09-09 12:04:59,967::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4634::DEBUG::2014-09-09 12:04:59,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:00,421::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:00,422::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4635::DEBUG::2014-09-09 12:05:00,422::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4635::DEBUG::2014-09-09 12:05:00,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c8fd4bc-8e1f-4707-99db-d4c78d9cb3a0`::moving from state init -> state preparing >Thread-4635::INFO::2014-09-09 12:05:00,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4635::DEBUG::2014-09-09 12:05:00,424::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`da0c7fbf-6379-470b-ab5e-8a9d9fd377df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4635::DEBUG::2014-09-09 12:05:00,424::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4635::DEBUG::2014-09-09 12:05:00,424::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4635::DEBUG::2014-09-09 12:05:00,424::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`da0c7fbf-6379-470b-ab5e-8a9d9fd377df`::Granted request >Thread-4635::DEBUG::2014-09-09 12:05:00,424::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2c8fd4bc-8e1f-4707-99db-d4c78d9cb3a0`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4635::DEBUG::2014-09-09 12:05:00,424::task::993::Storage.TaskManager.Task::(_decref) Task=`2c8fd4bc-8e1f-4707-99db-d4c78d9cb3a0`::ref 1 aborting False >Thread-4635::INFO::2014-09-09 12:05:00,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283149074432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282917339136', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283024293888', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4635::DEBUG::2014-09-09 12:05:00,426::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c8fd4bc-8e1f-4707-99db-d4c78d9cb3a0`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283149074432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282917339136', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283024293888', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4635::DEBUG::2014-09-09 12:05:00,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c8fd4bc-8e1f-4707-99db-d4c78d9cb3a0`::moving from state preparing -> state finished >Thread-4635::DEBUG::2014-09-09 12:05:00,426::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4635::DEBUG::2014-09-09 12:05:00,426::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4635::DEBUG::2014-09-09 12:05:00,426::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4635::DEBUG::2014-09-09 12:05:00,426::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4635::DEBUG::2014-09-09 12:05:00,426::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4635::DEBUG::2014-09-09 12:05:00,427::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4635::DEBUG::2014-09-09 12:05:00,427::task::993::Storage.TaskManager.Task::(_decref) Task=`2c8fd4bc-8e1f-4707-99db-d4c78d9cb3a0`::ref 0 aborting False >Thread-4635::DEBUG::2014-09-09 12:05:00,427::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283149074432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '282917339136', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283024293888', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4635::DEBUG::2014-09-09 12:05:00,427::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:01,277::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:01,277::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:01,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:01,277::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:01,277::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:01,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:01,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:01,278::__init__::225::IOProcess::(_processLogs) (9935) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:01,278::__init__::225::IOProcess::(_processLogs) (9935) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:01,278::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9935) Building response >Thread-23::DEBUG::2014-09-09 12:05:01,279::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:05:01,279::__init__::225::IOProcess::(_processLogs) (9935) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:01,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:01,284::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:05:01,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104943 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:01,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:01,287::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:01,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:01,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:01,287::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:01,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:01,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:01,288::__init__::225::IOProcess::(_processLogs) (9936) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:01,288::__init__::225::IOProcess::(_processLogs) (9936) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:01,288::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9936) Building response >Thread-19::DEBUG::2014-09-09 12:05:01,288::__init__::225::IOProcess::(_processLogs) (9936) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:01,288::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:01,289::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:01,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:01,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895551 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:02,682::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:02,683::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4636::DEBUG::2014-09-09 12:05:02,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:03,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:03,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896273 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:05,690::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:05,691::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4637::DEBUG::2014-09-09 12:05:05,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) (9937) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:05,698::__init__::225::IOProcess::(_processLogs) (9937) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:05,699::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9937) Building response >Thread-3443::DEBUG::2014-09-09 12:05:05,699::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:05:05,699::__init__::225::IOProcess::(_processLogs) (9937) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:05,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:05,705::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:05:05,707::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000841732 s, 422 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) (9938) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) (9938) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:05,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9938) Building response >Thread-19::DEBUG::2014-09-09 12:05:05,709::__init__::225::IOProcess::(_processLogs) (9938) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:05,709::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:05,709::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:05,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:06,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895316 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:05:08,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:05:08,166::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:08,166::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:08,166::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:08,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:08,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:08,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:08,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:08,167::__init__::225::IOProcess::(_processLogs) (9939) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:08,167::__init__::225::IOProcess::(_processLogs) (9939) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:08,181::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(9939) Building response >Thread-19::DEBUG::2014-09-09 12:05:08,182::__init__::225::IOProcess::(_processLogs) (9939) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:08,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:08,183::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:05:08,184::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:08,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.097123 s, 10.5 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:05:08,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000870074 s, 630 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:08,193::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:08,193::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:08,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:08,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:08,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:08,196::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:08,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:08,197::__init__::225::IOProcess::(_processLogs) (9940) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:08,198::__init__::225::IOProcess::(_processLogs) (9940) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:08,198::__init__::225::IOProcess::(_processLogs) (9940) Building response >Thread-19::DEBUG::2014-09-09 12:05:08,198::__init__::225::IOProcess::(_processLogs) (9940) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:08,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:08,199::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:05:08,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:08,200::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:05:08,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:08,201::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:08,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:08,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:08,203::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:08,203::__init__::225::IOProcess::(_processLogs) (9941) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:08,204::__init__::225::IOProcess::(_processLogs) (9941) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:08,204::__init__::225::IOProcess::(_processLogs) (9941) Building response >Thread-19::DEBUG::2014-09-09 12:05:08,205::__init__::225::IOProcess::(_processLogs) (9941) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:08,205::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:08,206::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:08,206::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:08,207::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:05:08,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:08,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:08,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:08,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:08,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:08,209::__init__::225::IOProcess::(_processLogs) (9942) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:08,210::__init__::225::IOProcess::(_processLogs) (9942) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:08,210::__init__::225::IOProcess::(_processLogs) (9942) Building response >Thread-19::DEBUG::2014-09-09 12:05:08,210::__init__::225::IOProcess::(_processLogs) (9942) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:08,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:08,211::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:08,212::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:05:08,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:08,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:08,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:08,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:08,214::__init__::225::IOProcess::(_processLogs) (9943) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:08,214::__init__::225::IOProcess::(_processLogs) (9943) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:08,215::__init__::225::IOProcess::(_processLogs) (9943) Building response >Thread-19::DEBUG::2014-09-09 12:05:08,215::__init__::225::IOProcess::(_processLogs) (9943) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:08,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:08,216::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:08,699::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:08,700::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4638::DEBUG::2014-09-09 12:05:08,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`b476f865-a02e-48e4-b13a-1d8fa7274a09`::moving from state init -> state preparing >Thread-4638::INFO::2014-09-09 12:05:08,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4638::INFO::2014-09-09 12:05:08,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104943', 'lastCheck': '7.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000870074', 'lastCheck': '0.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000841732', 'lastCheck': '3.0', 'valid': True}} >Thread-4638::DEBUG::2014-09-09 12:05:08,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`b476f865-a02e-48e4-b13a-1d8fa7274a09`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104943', 'lastCheck': '7.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000870074', 'lastCheck': '0.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000841732', 'lastCheck': '3.0', 'valid': True}} >Thread-4638::DEBUG::2014-09-09 12:05:08,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`b476f865-a02e-48e4-b13a-1d8fa7274a09`::moving from state preparing -> state finished >Thread-4638::DEBUG::2014-09-09 12:05:08,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4638::DEBUG::2014-09-09 12:05:08,702::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4638::DEBUG::2014-09-09 12:05:08,702::task::993::Storage.TaskManager.Task::(_decref) Task=`b476f865-a02e-48e4-b13a-1d8fa7274a09`::ref 0 aborting False >Thread-4638::DEBUG::2014-09-09 12:05:08,703::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:08,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:08,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4639::DEBUG::2014-09-09 12:05:08,714::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:10,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:10,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896946 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:10,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:10,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4640::DEBUG::2014-09-09 12:05:10,987::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4640::DEBUG::2014-09-09 12:05:10,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c76d63c-b791-44e6-81a5-f6bcbafd4838`::moving from state init -> state preparing >Thread-4640::INFO::2014-09-09 12:05:10,988::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4640::INFO::2014-09-09 12:05:10,989::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4640::DEBUG::2014-09-09 12:05:10,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c76d63c-b791-44e6-81a5-f6bcbafd4838`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4640::DEBUG::2014-09-09 12:05:10,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c76d63c-b791-44e6-81a5-f6bcbafd4838`::moving from state preparing -> state finished >Thread-4640::DEBUG::2014-09-09 12:05:10,989::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4640::DEBUG::2014-09-09 12:05:10,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4640::DEBUG::2014-09-09 12:05:10,989::task::993::Storage.TaskManager.Task::(_decref) Task=`3c76d63c-b791-44e6-81a5-f6bcbafd4838`::ref 0 aborting False >Thread-4640::DEBUG::2014-09-09 12:05:10,989::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4640::DEBUG::2014-09-09 12:05:10,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:11,289::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:11,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:11,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:11,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:11,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:11,290::__init__::225::IOProcess::(_processLogs) (9944) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:11,290::__init__::225::IOProcess::(_processLogs) (9944) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:11,291::__init__::225::IOProcess::(_processLogs) (9944) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:11,291::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:05:11,292::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:05:11,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107287 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) (9945) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:11,300::__init__::225::IOProcess::(_processLogs) (9945) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:11,301::__init__::225::IOProcess::(_processLogs) (9945) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:11,301::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:12,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:12,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895086 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:13,264::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:13,265::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4641::DEBUG::2014-09-09 12:05:13,265::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4641::DEBUG::2014-09-09 12:05:13,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`2142a405-7ca6-40d6-b8af-f35dd4156812`::moving from state init -> state preparing >Thread-4641::INFO::2014-09-09 12:05:13,266::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4641::DEBUG::2014-09-09 12:05:13,266::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2825a232-a20f-46b5-a65d-1013e6963c72`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4641::DEBUG::2014-09-09 12:05:13,266::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4641::DEBUG::2014-09-09 12:05:13,266::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4641::DEBUG::2014-09-09 12:05:13,266::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2825a232-a20f-46b5-a65d-1013e6963c72`::Granted request >Thread-4641::DEBUG::2014-09-09 12:05:13,267::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2142a405-7ca6-40d6-b8af-f35dd4156812`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4641::DEBUG::2014-09-09 12:05:13,267::task::993::Storage.TaskManager.Task::(_decref) Task=`2142a405-7ca6-40d6-b8af-f35dd4156812`::ref 1 aborting False >Thread-4641::INFO::2014-09-09 12:05:13,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283626176512', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283743617024', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283766685696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4641::DEBUG::2014-09-09 12:05:13,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`2142a405-7ca6-40d6-b8af-f35dd4156812`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283626176512', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283743617024', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283766685696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4641::DEBUG::2014-09-09 12:05:13,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`2142a405-7ca6-40d6-b8af-f35dd4156812`::moving from state preparing -> state finished >Thread-4641::DEBUG::2014-09-09 12:05:13,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4641::DEBUG::2014-09-09 12:05:13,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4641::DEBUG::2014-09-09 12:05:13,269::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4641::DEBUG::2014-09-09 12:05:13,269::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4641::DEBUG::2014-09-09 12:05:13,269::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4641::DEBUG::2014-09-09 12:05:13,269::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4641::DEBUG::2014-09-09 12:05:13,269::task::993::Storage.TaskManager.Task::(_decref) Task=`2142a405-7ca6-40d6-b8af-f35dd4156812`::ref 0 aborting False >Thread-4641::DEBUG::2014-09-09 12:05:13,269::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283626176512', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283743617024', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283766685696', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4641::DEBUG::2014-09-09 12:05:13,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:14,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:14,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895708 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:15,710::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:15,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:15,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:15,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:15,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:15,712::__init__::225::IOProcess::(_processLogs) (9946) Finding callback 'statvfs'... >Thread-3443::DEBUG::2014-09-09 12:05:15,712::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:05:15,712::__init__::225::IOProcess::(_processLogs) (9946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:15,717::__init__::225::IOProcess::(_processLogs) (9946) Building response >Thread-19::DEBUG::2014-09-09 12:05:15,717::__init__::225::IOProcess::(_processLogs) (9946) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:15,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:15,718::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:05:15,825::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.106102 s, 3.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:15,825::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:15,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:15,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:15,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:15,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:15,826::__init__::225::IOProcess::(_processLogs) (9947) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:15,826::__init__::225::IOProcess::(_processLogs) (9947) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:15,826::__init__::225::IOProcess::(_processLogs) (9947) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:15,826::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:05:16,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:16,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896879 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:17,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:17,213::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4642::DEBUG::2014-09-09 12:05:17,214::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:18,214::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:18,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:18,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:18,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:18,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:18,215::__init__::225::IOProcess::(_processLogs) (9948) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:18,215::__init__::225::IOProcess::(_processLogs) (9948) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:18,216::__init__::225::IOProcess::(_processLogs) (9948) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:18,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:05:18,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:18,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:18,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896734 s, 11.4 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:05:18,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.575591 s, 1.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) (9949) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) (9949) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:18,801::__init__::225::IOProcess::(_processLogs) (9949) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:18,802::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:18,802::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:05:18,802::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:18,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) (9950) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) (9950) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) (9950) Building response >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) (9950) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:18,803::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) (9951) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) (9951) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:18,804::__init__::225::IOProcess::(_processLogs) (9951) Building response >Thread-19::DEBUG::2014-09-09 12:05:18,805::__init__::225::IOProcess::(_processLogs) (9951) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:18,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:18,805::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:18,805::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:05:18,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:18,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) (9952) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) (9952) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) (9952) Building response >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) (9952) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:18,806::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:20,221::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:20,223::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4643::DEBUG::2014-09-09 12:05:20,226::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:20,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:20,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896026 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:21,302::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:21,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:21,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:21,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:21,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:21,303::__init__::225::IOProcess::(_processLogs) (9953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:21,303::__init__::225::IOProcess::(_processLogs) (9953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:21,303::__init__::225::IOProcess::(_processLogs) (9953) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:21,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:05:21,303::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:05:21,404::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0945289 s, 11.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:21,404::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:21,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:21,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:21,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:21,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:21,405::__init__::225::IOProcess::(_processLogs) (9954) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:21,405::__init__::225::IOProcess::(_processLogs) (9954) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:21,405::__init__::225::IOProcess::(_processLogs) (9954) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:21,405::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:05:22,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:22,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896892 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:23,234::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:23,234::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4644::DEBUG::2014-09-09 12:05:23,235::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:24,524::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4645::DEBUG::2014-09-09 12:05:24,524::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:05:24,524::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4645::DEBUG::2014-09-09 12:05:24,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d72f162-46b5-47c4-bcf1-a27a8b5868a1`::moving from state init -> state preparing >Thread-4645::INFO::2014-09-09 12:05:24,525::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4645::INFO::2014-09-09 12:05:24,526::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4645::DEBUG::2014-09-09 12:05:24,526::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d72f162-46b5-47c4-bcf1-a27a8b5868a1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4645::DEBUG::2014-09-09 12:05:24,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d72f162-46b5-47c4-bcf1-a27a8b5868a1`::moving from state preparing -> state finished >Thread-4645::DEBUG::2014-09-09 12:05:24,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4645::DEBUG::2014-09-09 12:05:24,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4645::DEBUG::2014-09-09 12:05:24,526::task::993::Storage.TaskManager.Task::(_decref) Task=`1d72f162-46b5-47c4-bcf1-a27a8b5868a1`::ref 0 aborting False >Thread-4645::DEBUG::2014-09-09 12:05:24,526::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4645::DEBUG::2014-09-09 12:05:24,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:24,620::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4646::DEBUG::2014-09-09 12:05:24,620::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:05:24,620::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4646::DEBUG::2014-09-09 12:05:24,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cc3f405-0340-420d-af9d-9f1e64287329`::moving from state init -> state preparing >Thread-4646::INFO::2014-09-09 12:05:24,621::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4646::DEBUG::2014-09-09 12:05:24,621::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8a52f37d-d843-4b4b-a2da-4742fc5f1f9a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4646::DEBUG::2014-09-09 12:05:24,622::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4646::DEBUG::2014-09-09 12:05:24,622::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4646::DEBUG::2014-09-09 12:05:24,622::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8a52f37d-d843-4b4b-a2da-4742fc5f1f9a`::Granted request >Thread-4646::DEBUG::2014-09-09 12:05:24,622::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8cc3f405-0340-420d-af9d-9f1e64287329`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4646::DEBUG::2014-09-09 12:05:24,622::task::993::Storage.TaskManager.Task::(_decref) Task=`8cc3f405-0340-420d-af9d-9f1e64287329`::ref 1 aborting False >Thread-4646::INFO::2014-09-09 12:05:24,624::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4646::DEBUG::2014-09-09 12:05:24,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`8cc3f405-0340-420d-af9d-9f1e64287329`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4646::DEBUG::2014-09-09 12:05:24,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`8cc3f405-0340-420d-af9d-9f1e64287329`::moving from state preparing -> state finished >Thread-4646::DEBUG::2014-09-09 12:05:24,624::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4646::DEBUG::2014-09-09 12:05:24,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4646::DEBUG::2014-09-09 12:05:24,624::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4646::DEBUG::2014-09-09 12:05:24,624::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4646::DEBUG::2014-09-09 12:05:24,624::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4646::DEBUG::2014-09-09 12:05:24,624::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4646::DEBUG::2014-09-09 12:05:24,625::task::993::Storage.TaskManager.Task::(_decref) Task=`8cc3f405-0340-420d-af9d-9f1e64287329`::ref 0 aborting False >Thread-4646::DEBUG::2014-09-09 12:05:24,625::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4646::DEBUG::2014-09-09 12:05:24,625::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:24,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:25,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897503 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:25,827::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:25,827::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:25,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:25,827::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:25,827::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:25,828::__init__::225::IOProcess::(_processLogs) (9955) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:25,828::__init__::225::IOProcess::(_processLogs) (9955) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:25,828::__init__::225::IOProcess::(_processLogs) (9955) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:25,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:05:25,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:05:25,835::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000959443 s, 370 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) (9956) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:25,836::__init__::225::IOProcess::(_processLogs) (9956) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:25,837::__init__::225::IOProcess::(_processLogs) (9956) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:25,837::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:26,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:26,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4647::DEBUG::2014-09-09 12:05:26,244::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:27,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:27,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089648 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:28,806::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:28,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:28,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:28,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:28,807::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:28,807::__init__::225::IOProcess::(_processLogs) (9957) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:28,807::__init__::225::IOProcess::(_processLogs) (9957) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:28,807::__init__::225::IOProcess::(_processLogs) (9957) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:28,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:05:28,808::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:05:28,815::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100236 s, 547 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:28,816::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:28,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:28,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:28,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:28,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:28,816::__init__::225::IOProcess::(_processLogs) (9958) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:28,817::__init__::225::IOProcess::(_processLogs) (9958) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:28,817::__init__::225::IOProcess::(_processLogs) (9958) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:28,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:28,817::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) (9959) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:28,818::__init__::225::IOProcess::(_processLogs) (9959) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) (9959) Building response >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) (9959) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:05:28,819::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) (9960) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) (9960) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) (9960) Building response >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) (9960) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:28,820::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:28,821::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:05:28,821::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:28,821::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:28,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:28,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:28,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:28,822::__init__::225::IOProcess::(_processLogs) (9961) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:28,822::__init__::225::IOProcess::(_processLogs) (9961) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:28,822::__init__::225::IOProcess::(_processLogs) (9961) Building response >Thread-19::DEBUG::2014-09-09 12:05:28,822::__init__::225::IOProcess::(_processLogs) (9961) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:28,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:28,822::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:05:29,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:29,255::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:29,257::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4648::DEBUG::2014-09-09 12:05:29,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7f2d156-5b59-458e-89d4-95a998e60a68`::moving from state init -> state preparing >Thread-4648::INFO::2014-09-09 12:05:29,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4648::INFO::2014-09-09 12:05:29,262::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0945289', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100236', 'lastCheck': '0.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000959443', 'lastCheck': '3.4', 'valid': True}} >Thread-4648::DEBUG::2014-09-09 12:05:29,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7f2d156-5b59-458e-89d4-95a998e60a68`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0945289', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100236', 'lastCheck': '0.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000959443', 'lastCheck': '3.4', 'valid': True}} >Thread-4648::DEBUG::2014-09-09 12:05:29,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7f2d156-5b59-458e-89d4-95a998e60a68`::moving from state preparing -> state finished >Thread-4648::DEBUG::2014-09-09 12:05:29,263::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4648::DEBUG::2014-09-09 12:05:29,264::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4648::DEBUG::2014-09-09 12:05:29,264::task::993::Storage.TaskManager.Task::(_decref) Task=`a7f2d156-5b59-458e-89d4-95a998e60a68`::ref 0 aborting False >Dummy-97::DEBUG::2014-09-09 12:05:29,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0983166 s, 10.4 MB/s\n'; <rc> = 0 >Thread-4648::DEBUG::2014-09-09 12:05:29,268::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:29,275::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:29,277::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4649::DEBUG::2014-09-09 12:05:29,279::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:31,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:31,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895439 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:31,406::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:31,406::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:31,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:31,406::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:31,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) (9962) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) (9962) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) DEBUG|(9962) Building response >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) (9962) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:31,407::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:05:31,408::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:05:31,415::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104756 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:31,415::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:31,415::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:31,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:31,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) (9963) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) (9963) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) DEBUG|(9963) Building response >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) (9963) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:31,416::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:31,417::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:33,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:33,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.188439 s, 5.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:34,885::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4650::DEBUG::2014-09-09 12:05:34,886::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:05:34,886::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4650::DEBUG::2014-09-09 12:05:34,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`52472aca-30f1-4efa-97ae-27c257de818b`::moving from state init -> state preparing >Thread-4650::INFO::2014-09-09 12:05:34,887::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4650::INFO::2014-09-09 12:05:34,887::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4650::DEBUG::2014-09-09 12:05:34,887::task::1191::Storage.TaskManager.Task::(prepare) Task=`52472aca-30f1-4efa-97ae-27c257de818b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4650::DEBUG::2014-09-09 12:05:34,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`52472aca-30f1-4efa-97ae-27c257de818b`::moving from state preparing -> state finished >Thread-4650::DEBUG::2014-09-09 12:05:34,887::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4650::DEBUG::2014-09-09 12:05:34,887::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4650::DEBUG::2014-09-09 12:05:34,888::task::993::Storage.TaskManager.Task::(_decref) Task=`52472aca-30f1-4efa-97ae-27c257de818b`::ref 0 aborting False >Thread-4650::DEBUG::2014-09-09 12:05:34,888::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4650::DEBUG::2014-09-09 12:05:34,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:35,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:35,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894438 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) (9964) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:35,838::__init__::225::IOProcess::(_processLogs) (9964) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:35,840::__init__::225::IOProcess::(_processLogs) DEBUG|(9964) Building response >Thread-19::DEBUG::2014-09-09 12:05:35,840::__init__::225::IOProcess::(_processLogs) (9964) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:35,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:35,840::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:05:35,841::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:05:35,848::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000857955 s, 414 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:35,849::__init__::225::IOProcess::(_processLogs) (9965) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:35,850::__init__::225::IOProcess::(_processLogs) (9965) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:35,850::__init__::225::IOProcess::(_processLogs) DEBUG|(9965) Building response >Thread-19::DEBUG::2014-09-09 12:05:35,850::__init__::225::IOProcess::(_processLogs) (9965) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:35,850::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:35,851::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:37,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:37,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895709 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:38,727::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:38,728::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4651::DEBUG::2014-09-09 12:05:38,728::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4651::DEBUG::2014-09-09 12:05:38,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`d56741dc-4796-4cbf-b064-563291a1100c`::moving from state init -> state preparing >Thread-4651::INFO::2014-09-09 12:05:38,729::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4651::DEBUG::2014-09-09 12:05:38,729::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`71d49cd1-35c7-42b7-b480-59b5ccbd8b00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4651::DEBUG::2014-09-09 12:05:38,729::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4651::DEBUG::2014-09-09 12:05:38,730::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4651::DEBUG::2014-09-09 12:05:38,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`71d49cd1-35c7-42b7-b480-59b5ccbd8b00`::Granted request >Thread-4651::DEBUG::2014-09-09 12:05:38,730::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d56741dc-4796-4cbf-b064-563291a1100c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4651::DEBUG::2014-09-09 12:05:38,730::task::993::Storage.TaskManager.Task::(_decref) Task=`d56741dc-4796-4cbf-b064-563291a1100c`::ref 1 aborting False >Thread-4651::INFO::2014-09-09 12:05:38,732::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4651::DEBUG::2014-09-09 12:05:38,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`d56741dc-4796-4cbf-b064-563291a1100c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4651::DEBUG::2014-09-09 12:05:38,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`d56741dc-4796-4cbf-b064-563291a1100c`::moving from state preparing -> state finished >Thread-4651::DEBUG::2014-09-09 12:05:38,732::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4651::DEBUG::2014-09-09 12:05:38,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4651::DEBUG::2014-09-09 12:05:38,732::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4651::DEBUG::2014-09-09 12:05:38,732::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4651::DEBUG::2014-09-09 12:05:38,732::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4651::DEBUG::2014-09-09 12:05:38,732::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4651::DEBUG::2014-09-09 12:05:38,732::task::993::Storage.TaskManager.Task::(_decref) Task=`d56741dc-4796-4cbf-b064-563291a1100c`::ref 0 aborting False >Thread-4651::DEBUG::2014-09-09 12:05:38,733::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4651::DEBUG::2014-09-09 12:05:38,733::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) (9966) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) (9966) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) DEBUG|(9966) Building response >Thread-19::DEBUG::2014-09-09 12:05:38,822::__init__::225::IOProcess::(_processLogs) (9966) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:38,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:38,823::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:05:38,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:05:38,831::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000927987 s, 591 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:38,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:38,831::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:38,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) (9967) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) (9967) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) DEBUG|(9967) Building response >Thread-19::DEBUG::2014-09-09 12:05:38,832::__init__::225::IOProcess::(_processLogs) (9967) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:38,833::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:38,833::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:05:38,833::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:38,833::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:05:38,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) (9968) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) (9968) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) (9968) Building response >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) (9968) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:38,834::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:38,835::__init__::225::IOProcess::(_processLogs) (9969) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) (9969) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) (9969) Building response >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) (9969) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:38,836::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) (9970) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) (9970) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) (9970) Building response >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) (9970) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:38,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:38,838::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:39,531::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:39,532::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4652::DEBUG::2014-09-09 12:05:39,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:39,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:39,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894969 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) (9971) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:41,418::__init__::225::IOProcess::(_processLogs) (9971) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:41,419::__init__::225::IOProcess::(_processLogs) DEBUG|(9971) Building response >Thread-19::DEBUG::2014-09-09 12:05:41,419::__init__::225::IOProcess::(_processLogs) (9971) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:41,419::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:41,420::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:05:41,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:05:41,428::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105531 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) (9972) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:41,429::__init__::225::IOProcess::(_processLogs) (9972) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:41,430::__init__::225::IOProcess::(_processLogs) DEBUG|(9972) Building response >Thread-19::DEBUG::2014-09-09 12:05:41,430::__init__::225::IOProcess::(_processLogs) (9972) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:41,430::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:41,430::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:41,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:41,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896689 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:42,538::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:42,539::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4653::DEBUG::2014-09-09 12:05:42,540::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:44,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:44,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897805 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:45,545::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:45,546::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4654::DEBUG::2014-09-09 12:05:45,547::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:45,851::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:45,851::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:45,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) (9973) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) (9973) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:45,852::__init__::225::IOProcess::(_processLogs) DEBUG|(9973) Building response >Thread-3443::DEBUG::2014-09-09 12:05:45,853::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:05:45,853::__init__::225::IOProcess::(_processLogs) (9973) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:45,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:45,858::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:05:45,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000753517 s, 471 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:45,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:45,860::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:45,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:45,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:45,861::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:45,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:45,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:45,861::__init__::225::IOProcess::(_processLogs) (9974) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:45,861::__init__::225::IOProcess::(_processLogs) (9974) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:45,861::__init__::225::IOProcess::(_processLogs) DEBUG|(9974) Building response >Thread-19::DEBUG::2014-09-09 12:05:45,862::__init__::225::IOProcess::(_processLogs) (9974) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:45,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:45,862::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:46,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:46,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08981 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:05:48,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:48,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895883 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:48,555::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:48,556::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4655::DEBUG::2014-09-09 12:05:48,557::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:48,837::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:48,837::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) (9975) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) (9975) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) DEBUG|(9975) Building response >Thread-19::DEBUG::2014-09-09 12:05:48,838::__init__::225::IOProcess::(_processLogs) (9975) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:48,839::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:05:48,839::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:05:48,839::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:05:48,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101347 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) (9976) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) (9976) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:48,848::__init__::225::IOProcess::(_processLogs) DEBUG|(9976) Building response >Thread-19::DEBUG::2014-09-09 12:05:48,849::__init__::225::IOProcess::(_processLogs) (9976) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:48,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:48,849::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) (9977) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) (9977) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:48,850::__init__::225::IOProcess::(_processLogs) DEBUG|(9977) Building response >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) (9977) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:48,851::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) (9978) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) (9978) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) DEBUG|(9978) Building response >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) (9978) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:48,852::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:48,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:48,853::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:05:48,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:48,853::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:48,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) (9979) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) (9979) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) (9979) Building response >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) (9979) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:48,854::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:05:50,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:50,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089562 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) (9980) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) (9980) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:51,431::__init__::225::IOProcess::(_processLogs) DEBUG|(9980) Building response >Thread-19::DEBUG::2014-09-09 12:05:51,432::__init__::225::IOProcess::(_processLogs) (9980) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:51,432::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:51,432::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:05:51,432::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:05:51,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106176 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:51,440::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:51,440::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:05:51,440::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) (9981) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) (9981) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) DEBUG|(9981) Building response >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) (9981) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:51,441::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:51,442::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:51,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:51,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4656::DEBUG::2014-09-09 12:05:51,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`39e062bd-9b5b-4cb8-b81b-5da1b72ca79c`::moving from state init -> state preparing >Thread-4656::INFO::2014-09-09 12:05:51,568::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4656::INFO::2014-09-09 12:05:51,568::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106176', 'lastCheck': '0.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101347', 'lastCheck': '2.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000753517', 'lastCheck': '5.7', 'valid': True}} >Thread-4656::DEBUG::2014-09-09 12:05:51,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`39e062bd-9b5b-4cb8-b81b-5da1b72ca79c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106176', 'lastCheck': '0.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101347', 'lastCheck': '2.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000753517', 'lastCheck': '5.7', 'valid': True}} >Thread-4656::DEBUG::2014-09-09 12:05:51,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`39e062bd-9b5b-4cb8-b81b-5da1b72ca79c`::moving from state preparing -> state finished >Thread-4656::DEBUG::2014-09-09 12:05:51,569::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4656::DEBUG::2014-09-09 12:05:51,569::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4656::DEBUG::2014-09-09 12:05:51,569::task::993::Storage.TaskManager.Task::(_decref) Task=`39e062bd-9b5b-4cb8-b81b-5da1b72ca79c`::ref 0 aborting False >Thread-4656::DEBUG::2014-09-09 12:05:51,570::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:51,578::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:51,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4657::DEBUG::2014-09-09 12:05:51,580::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:52,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:52,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895989 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:05:54,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:54,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895749 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:55,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:55,266::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4658::DEBUG::2014-09-09 12:05:55,267::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:05:55,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) (9982) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) (9982) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:55,863::__init__::225::IOProcess::(_processLogs) DEBUG|(9982) Building response >Thread-19::DEBUG::2014-09-09 12:05:55,864::__init__::225::IOProcess::(_processLogs) (9982) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:55,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:55,864::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 244 >Thread-3443::DEBUG::2014-09-09 12:05:55,864::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:05:55,871::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000847529 s, 419 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:55,871::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:55,871::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:05:55,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) (9983) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) (9983) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:55,872::__init__::225::IOProcess::(_processLogs) DEBUG|(9983) Building response >Thread-19::DEBUG::2014-09-09 12:05:55,873::__init__::225::IOProcess::(_processLogs) (9983) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:55,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:55,873::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:05:56,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:56,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895147 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:57,869::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:57,870::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4659::DEBUG::2014-09-09 12:05:57,870::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4659::DEBUG::2014-09-09 12:05:57,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`c460601a-2c36-4237-bd3b-6e89b8bdb6b0`::moving from state init -> state preparing >Thread-4659::INFO::2014-09-09 12:05:57,871::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4659::INFO::2014-09-09 12:05:57,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4659::DEBUG::2014-09-09 12:05:57,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`c460601a-2c36-4237-bd3b-6e89b8bdb6b0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4659::DEBUG::2014-09-09 12:05:57,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`c460601a-2c36-4237-bd3b-6e89b8bdb6b0`::moving from state preparing -> state finished >Thread-4659::DEBUG::2014-09-09 12:05:57,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4659::DEBUG::2014-09-09 12:05:57,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4659::DEBUG::2014-09-09 12:05:57,872::task::993::Storage.TaskManager.Task::(_decref) Task=`c460601a-2c36-4237-bd3b-6e89b8bdb6b0`::ref 0 aborting False >Thread-4659::DEBUG::2014-09-09 12:05:57,872::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4659::DEBUG::2014-09-09 12:05:57,872::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:57,935::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:57,935::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4660::DEBUG::2014-09-09 12:05:57,935::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4660::DEBUG::2014-09-09 12:05:57,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`48cb331b-419c-4544-a95e-e58b64ad501e`::moving from state init -> state preparing >Thread-4660::INFO::2014-09-09 12:05:57,936::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4660::DEBUG::2014-09-09 12:05:57,936::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`307500fd-136d-4377-995d-e8c24efbc35f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4660::DEBUG::2014-09-09 12:05:57,936::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4660::DEBUG::2014-09-09 12:05:57,936::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4660::DEBUG::2014-09-09 12:05:57,937::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`307500fd-136d-4377-995d-e8c24efbc35f`::Granted request >Thread-4660::DEBUG::2014-09-09 12:05:57,938::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`48cb331b-419c-4544-a95e-e58b64ad501e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4660::DEBUG::2014-09-09 12:05:57,938::task::993::Storage.TaskManager.Task::(_decref) Task=`48cb331b-419c-4544-a95e-e58b64ad501e`::ref 1 aborting False >Thread-4660::INFO::2014-09-09 12:05:57,939::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4660::DEBUG::2014-09-09 12:05:57,939::task::1191::Storage.TaskManager.Task::(prepare) Task=`48cb331b-419c-4544-a95e-e58b64ad501e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4660::DEBUG::2014-09-09 12:05:57,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`48cb331b-419c-4544-a95e-e58b64ad501e`::moving from state preparing -> state finished >Thread-4660::DEBUG::2014-09-09 12:05:57,940::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4660::DEBUG::2014-09-09 12:05:57,940::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4660::DEBUG::2014-09-09 12:05:57,940::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4660::DEBUG::2014-09-09 12:05:57,940::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4660::DEBUG::2014-09-09 12:05:57,940::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4660::DEBUG::2014-09-09 12:05:57,940::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4660::DEBUG::2014-09-09 12:05:57,940::task::993::Storage.TaskManager.Task::(_decref) Task=`48cb331b-419c-4544-a95e-e58b64ad501e`::ref 0 aborting False >Thread-4660::DEBUG::2014-09-09 12:05:57,940::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4660::DEBUG::2014-09-09 12:05:57,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:05:58,275::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:05:58,276::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4661::DEBUG::2014-09-09 12:05:58,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:05:58,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:05:58,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895182 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:58,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:58,854::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:58,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:58,854::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:58,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:58,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:58,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:58,855::__init__::225::IOProcess::(_processLogs) (9984) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:58,855::__init__::225::IOProcess::(_processLogs) (9984) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:58,855::__init__::225::IOProcess::(_processLogs) DEBUG|(9984) Building response >Thread-19::DEBUG::2014-09-09 12:05:58,855::__init__::225::IOProcess::(_processLogs) (9984) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:58,855::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:58,856::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-24::DEBUG::2014-09-09 12:05:58,856::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:05:58,863::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000911745 s, 601 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:05:58,864::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:58,864::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:05:58,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:58,864::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:58,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) (9985) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) (9985) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) DEBUG|(9985) Building response >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) (9985) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:58,865::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:05:58,866::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-19::DEBUG::2014-09-09 12:05:58,866::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:58,866::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:05:58,866::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) (9986) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) (9986) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) (9986) Building response >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) (9986) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:58,867::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) (9987) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:58,868::__init__::225::IOProcess::(_processLogs) (9987) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) (9987) Building response >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) (9987) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:05:58,869::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) (9988) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) (9988) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) (9988) Building response >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) (9988) Queuing response >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:05:58,870::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:06:00,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:00,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896945 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:01,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:01,287::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4662::DEBUG::2014-09-09 12:06:01,288::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:06:01,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) (9989) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:01,443::__init__::225::IOProcess::(_processLogs) (9989) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:01,444::__init__::225::IOProcess::(_processLogs) (9989) Queuing response >Thread-23::DEBUG::2014-09-09 12:06:01,444::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:06:01,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:01,449::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Thread-23::DEBUG::2014-09-09 12:06:01,452::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104689 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:01,452::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:06:01,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:01,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:01,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:01,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:01,453::__init__::225::IOProcess::(_processLogs) (9990) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:01,453::__init__::225::IOProcess::(_processLogs) (9990) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:01,453::__init__::225::IOProcess::(_processLogs) (9990) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:01,453::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:06:02,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:03,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089617 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:04,298::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:04,299::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4663::DEBUG::2014-09-09 12:06:04,300::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:05,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:05,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089624 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:05,873::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) (9991) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) (9991) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:05,874::__init__::225::IOProcess::(_processLogs) (9991) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:05,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:06:05,875::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:06:05,882::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000910296 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) (9992) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) (9992) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:05,883::__init__::225::IOProcess::(_processLogs) (9992) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:05,884::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:06:07,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:07,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895758 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:07,307::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:07,308::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4664::DEBUG::2014-09-09 12:06:07,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`aed5bcfa-c71c-4fbc-accf-9f2832191ce0`::moving from state init -> state preparing >Thread-4664::INFO::2014-09-09 12:06:07,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4664::INFO::2014-09-09 12:06:07,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104689', 'lastCheck': '5.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911745', 'lastCheck': '8.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910296', 'lastCheck': '1.4', 'valid': True}} >Thread-4664::DEBUG::2014-09-09 12:06:07,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`aed5bcfa-c71c-4fbc-accf-9f2832191ce0`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104689', 'lastCheck': '5.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000911745', 'lastCheck': '8.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910296', 'lastCheck': '1.4', 'valid': True}} >Thread-4664::DEBUG::2014-09-09 12:06:07,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`aed5bcfa-c71c-4fbc-accf-9f2832191ce0`::moving from state preparing -> state finished >Thread-4664::DEBUG::2014-09-09 12:06:07,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4664::DEBUG::2014-09-09 12:06:07,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4664::DEBUG::2014-09-09 12:06:07,310::task::993::Storage.TaskManager.Task::(_decref) Task=`aed5bcfa-c71c-4fbc-accf-9f2832191ce0`::ref 0 aborting False >Thread-4664::DEBUG::2014-09-09 12:06:07,311::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:07,316::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:07,317::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4665::DEBUG::2014-09-09 12:06:07,318::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:08,226::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:08,227::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4666::DEBUG::2014-09-09 12:06:08,227::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4666::DEBUG::2014-09-09 12:06:08,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccdd4097-8455-4535-9a92-e7db40170613`::moving from state init -> state preparing >Thread-4666::INFO::2014-09-09 12:06:08,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4666::INFO::2014-09-09 12:06:08,228::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4666::DEBUG::2014-09-09 12:06:08,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`ccdd4097-8455-4535-9a92-e7db40170613`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4666::DEBUG::2014-09-09 12:06:08,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccdd4097-8455-4535-9a92-e7db40170613`::moving from state preparing -> state finished >Thread-4666::DEBUG::2014-09-09 12:06:08,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4666::DEBUG::2014-09-09 12:06:08,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4666::DEBUG::2014-09-09 12:06:08,229::task::993::Storage.TaskManager.Task::(_decref) Task=`ccdd4097-8455-4535-9a92-e7db40170613`::ref 0 aborting False >Thread-4666::DEBUG::2014-09-09 12:06:08,229::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4666::DEBUG::2014-09-09 12:06:08,229::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:08,515::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4667::DEBUG::2014-09-09 12:06:08,516::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:06:08,516::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4667::DEBUG::2014-09-09 12:06:08,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`63131207-8d55-4a4f-88f8-8d8de898d197`::moving from state init -> state preparing >Thread-4667::INFO::2014-09-09 12:06:08,517::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4667::DEBUG::2014-09-09 12:06:08,517::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`780dbe0b-54f5-4ef1-910b-d8a9c3622b2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4667::DEBUG::2014-09-09 12:06:08,517::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4667::DEBUG::2014-09-09 12:06:08,518::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4667::DEBUG::2014-09-09 12:06:08,518::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`780dbe0b-54f5-4ef1-910b-d8a9c3622b2a`::Granted request >Thread-4667::DEBUG::2014-09-09 12:06:08,518::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`63131207-8d55-4a4f-88f8-8d8de898d197`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4667::DEBUG::2014-09-09 12:06:08,518::task::993::Storage.TaskManager.Task::(_decref) Task=`63131207-8d55-4a4f-88f8-8d8de898d197`::ref 1 aborting False >Thread-4667::INFO::2014-09-09 12:06:08,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4667::DEBUG::2014-09-09 12:06:08,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`63131207-8d55-4a4f-88f8-8d8de898d197`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4667::DEBUG::2014-09-09 12:06:08,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`63131207-8d55-4a4f-88f8-8d8de898d197`::moving from state preparing -> state finished >Thread-4667::DEBUG::2014-09-09 12:06:08,520::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4667::DEBUG::2014-09-09 12:06:08,520::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4667::DEBUG::2014-09-09 12:06:08,520::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4667::DEBUG::2014-09-09 12:06:08,520::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4667::DEBUG::2014-09-09 12:06:08,520::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4667::DEBUG::2014-09-09 12:06:08,520::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4667::DEBUG::2014-09-09 12:06:08,520::task::993::Storage.TaskManager.Task::(_decref) Task=`63131207-8d55-4a4f-88f8-8d8de898d197`::ref 0 aborting False >Thread-4667::DEBUG::2014-09-09 12:06:08,521::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4667::DEBUG::2014-09-09 12:06:08,521::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) (9993) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:08,870::__init__::225::IOProcess::(_processLogs) (9993) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:08,871::__init__::225::IOProcess::(_processLogs) (9993) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:08,871::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:06:08,871::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:06:08,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00094634 s, 579 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:08,879::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:08,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:08,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:08,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:08,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:08,880::__init__::225::IOProcess::(_processLogs) (9994) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:08,880::__init__::225::IOProcess::(_processLogs) (9994) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:08,880::__init__::225::IOProcess::(_processLogs) (9994) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:08,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) Message size is 165 >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) (9995) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) (9995) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) (9995) Building response >Thread-19::DEBUG::2014-09-09 12:06:08,881::__init__::225::IOProcess::(_processLogs) (9995) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:08,882::__init__::225::IOProcess::(_processLogs) (9996) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) (9996) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) (9996) Building response >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) (9996) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:08,883::__init__::225::IOProcess::(_processLogs) Message size is 171 >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) (9997) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) (9997) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) DEBUG|(9997) Building response >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) (9997) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:08,884::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:08,885::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Dummy-97::DEBUG::2014-09-09 12:06:09,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:09,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895057 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:10,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:10,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4668::DEBUG::2014-09-09 12:06:10,983::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:11,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) (9998) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:11,455::__init__::225::IOProcess::(_processLogs) (9998) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:11,460::__init__::225::IOProcess::(_processLogs) (9998) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:11,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:06:11,461::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:06:11,462::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:06:11,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0971133 s, 10.5 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:06:11,470::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104482 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:11,471::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:11,472::__init__::225::IOProcess::(_processLogs) Message size is 147 >Thread-19::DEBUG::2014-09-09 12:06:11,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:11,473::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:11,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:11,473::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:11,474::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:11,475::__init__::225::IOProcess::(_processLogs) (9999) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:11,476::__init__::225::IOProcess::(_processLogs) (9999) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:11,476::__init__::225::IOProcess::(_processLogs) (9999) Building response >Thread-19::DEBUG::2014-09-09 12:06:11,476::__init__::225::IOProcess::(_processLogs) (9999) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:11,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:11,477::__init__::225::IOProcess::(_processLogs) Sending response sized 244 >Dummy-97::DEBUG::2014-09-09 12:06:13,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:13,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896024 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:13,991::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:13,992::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4669::DEBUG::2014-09-09 12:06:13,993::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:15,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:15,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895572 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) (10000) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:15,885::__init__::225::IOProcess::(_processLogs) (10000) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:15,886::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10000) Building response >Thread-19::DEBUG::2014-09-09 12:06:15,886::__init__::225::IOProcess::(_processLogs) (10000) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:15,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:15,886::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:06:15,887::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:06:15,894::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00102372 s, 347 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) (10001) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:15,895::__init__::225::IOProcess::(_processLogs) (10001) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:15,896::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10001) Building response >Thread-19::DEBUG::2014-09-09 12:06:15,896::__init__::225::IOProcess::(_processLogs) (10001) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:15,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:15,897::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:17,002::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:17,003::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4670::DEBUG::2014-09-09 12:06:17,004::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:17,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:17,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899335 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:18,885::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) (10002) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:18,886::__init__::225::IOProcess::(_processLogs) (10002) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:18,887::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10002) Building response >Thread-19::DEBUG::2014-09-09 12:06:18,887::__init__::225::IOProcess::(_processLogs) (10002) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:18,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:18,887::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:06:18,888::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:06:18,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00110287 s, 497 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:18,898::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:18,898::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:18,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:18,898::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:18,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:18,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:18,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:18,899::__init__::225::IOProcess::(_processLogs) (10003) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:18,899::__init__::225::IOProcess::(_processLogs) (10003) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:18,899::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10003) Building response >Thread-19::DEBUG::2014-09-09 12:06:18,899::__init__::225::IOProcess::(_processLogs) (10003) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:18,899::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:18,900::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:06:18,900::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:18,900::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:06:18,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) (10004) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) (10004) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10004) Building response >Thread-19::DEBUG::2014-09-09 12:06:18,901::__init__::225::IOProcess::(_processLogs) (10004) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:18,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:18,902::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:18,902::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:18,902::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:06:18,902::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:18,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) (10005) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) (10005) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) (10005) Building response >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) (10005) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:06:18,903::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:18,904::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:18,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:18,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:18,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:18,904::__init__::225::IOProcess::(_processLogs) (10006) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:18,904::__init__::225::IOProcess::(_processLogs) (10006) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:18,905::__init__::225::IOProcess::(_processLogs) (10006) Building response >Thread-19::DEBUG::2014-09-09 12:06:18,905::__init__::225::IOProcess::(_processLogs) (10006) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:18,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:18,905::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:19,001::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:19,002::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4671::DEBUG::2014-09-09 12:06:19,002::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4671::DEBUG::2014-09-09 12:06:19,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3971896-f18c-4122-993b-a1361b6d577b`::moving from state init -> state preparing >Thread-4671::INFO::2014-09-09 12:06:19,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4671::INFO::2014-09-09 12:06:19,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4671::DEBUG::2014-09-09 12:06:19,003::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3971896-f18c-4122-993b-a1361b6d577b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4671::DEBUG::2014-09-09 12:06:19,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3971896-f18c-4122-993b-a1361b6d577b`::moving from state preparing -> state finished >Thread-4671::DEBUG::2014-09-09 12:06:19,003::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4671::DEBUG::2014-09-09 12:06:19,003::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4671::DEBUG::2014-09-09 12:06:19,003::task::993::Storage.TaskManager.Task::(_decref) Task=`f3971896-f18c-4122-993b-a1361b6d577b`::ref 0 aborting False >Thread-4671::DEBUG::2014-09-09 12:06:19,004::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4671::DEBUG::2014-09-09 12:06:19,004::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:19,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:19,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0936542 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:20,009::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:20,011::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4672::DEBUG::2014-09-09 12:06:20,013::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) (10007) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:21,476::__init__::225::IOProcess::(_processLogs) (10007) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:21,477::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10007) Building response >Thread-23::DEBUG::2014-09-09 12:06:21,477::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:06:21,477::__init__::225::IOProcess::(_processLogs) (10007) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:21,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:21,483::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:06:21,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104804 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:21,485::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:21,485::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:21,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:21,485::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:21,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) (10008) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) (10008) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10008) Building response >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) (10008) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:21,486::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:21,487::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:06:21,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:22,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896014 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:23,021::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:23,022::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4673::DEBUG::2014-09-09 12:06:23,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb91302-a69f-4ab2-bb70-8b6e929bcb42`::moving from state init -> state preparing >Thread-4673::INFO::2014-09-09 12:06:23,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4673::INFO::2014-09-09 12:06:23,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104804', 'lastCheck': '1.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110287', 'lastCheck': '4.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102372', 'lastCheck': '7.1', 'valid': True}} >Thread-4673::DEBUG::2014-09-09 12:06:23,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`afb91302-a69f-4ab2-bb70-8b6e929bcb42`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104804', 'lastCheck': '1.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110287', 'lastCheck': '4.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102372', 'lastCheck': '7.1', 'valid': True}} >Thread-4673::DEBUG::2014-09-09 12:06:23,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb91302-a69f-4ab2-bb70-8b6e929bcb42`::moving from state preparing -> state finished >Thread-4673::DEBUG::2014-09-09 12:06:23,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4673::DEBUG::2014-09-09 12:06:23,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4673::DEBUG::2014-09-09 12:06:23,024::task::993::Storage.TaskManager.Task::(_decref) Task=`afb91302-a69f-4ab2-bb70-8b6e929bcb42`::ref 0 aborting False >Thread-4673::DEBUG::2014-09-09 12:06:23,025::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:23,035::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:23,035::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4674::DEBUG::2014-09-09 12:06:23,036::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:23,715::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:23,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4675::DEBUG::2014-09-09 12:06:23,716::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4675::DEBUG::2014-09-09 12:06:23,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`641be7b7-3eda-4c04-93e4-ca397cd075d9`::moving from state init -> state preparing >Thread-4675::INFO::2014-09-09 12:06:23,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4675::DEBUG::2014-09-09 12:06:23,717::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`75f2b4e0-a53f-403d-96fa-6985cdfc4572`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4675::DEBUG::2014-09-09 12:06:23,717::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4675::DEBUG::2014-09-09 12:06:23,717::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4675::DEBUG::2014-09-09 12:06:23,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`75f2b4e0-a53f-403d-96fa-6985cdfc4572`::Granted request >Thread-4675::DEBUG::2014-09-09 12:06:23,718::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`641be7b7-3eda-4c04-93e4-ca397cd075d9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4675::DEBUG::2014-09-09 12:06:23,718::task::993::Storage.TaskManager.Task::(_decref) Task=`641be7b7-3eda-4c04-93e4-ca397cd075d9`::ref 1 aborting False >Thread-4675::INFO::2014-09-09 12:06:23,719::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4675::DEBUG::2014-09-09 12:06:23,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`641be7b7-3eda-4c04-93e4-ca397cd075d9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4675::DEBUG::2014-09-09 12:06:23,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`641be7b7-3eda-4c04-93e4-ca397cd075d9`::moving from state preparing -> state finished >Thread-4675::DEBUG::2014-09-09 12:06:23,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4675::DEBUG::2014-09-09 12:06:23,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4675::DEBUG::2014-09-09 12:06:23,720::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4675::DEBUG::2014-09-09 12:06:23,720::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4675::DEBUG::2014-09-09 12:06:23,720::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4675::DEBUG::2014-09-09 12:06:23,720::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4675::DEBUG::2014-09-09 12:06:23,720::task::993::Storage.TaskManager.Task::(_decref) Task=`641be7b7-3eda-4c04-93e4-ca397cd075d9`::ref 0 aborting False >Thread-4675::DEBUG::2014-09-09 12:06:23,720::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4675::DEBUG::2014-09-09 12:06:23,721::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:24,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:24,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898256 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:25,897::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:25,897::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:25,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:25,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:25,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:25,897::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) (10009) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) (10009) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10009) Building response >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) (10009) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:25,898::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:06:25,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:06:25,905::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000954572 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:25,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:25,907::__init__::225::IOProcess::(_processLogs) (10010) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:25,907::__init__::225::IOProcess::(_processLogs) (10010) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:25,907::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10010) Building response >Thread-19::DEBUG::2014-09-09 12:06:25,907::__init__::225::IOProcess::(_processLogs) (10010) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:25,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:25,907::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:06:26,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:26,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895387 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:27,235::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:27,236::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4676::DEBUG::2014-09-09 12:06:27,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:28,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:28,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895462 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) (10011) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) (10011) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:28,905::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10011) Building response >Thread-19::DEBUG::2014-09-09 12:06:28,906::__init__::225::IOProcess::(_processLogs) (10011) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:28,906::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:28,906::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:06:28,906::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:06:28,914::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000928826 s, 590 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:28,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:28,916::__init__::225::IOProcess::(_processLogs) (10012) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:28,916::__init__::225::IOProcess::(_processLogs) (10012) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:28,916::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10012) Building response >Thread-19::DEBUG::2014-09-09 12:06:28,916::__init__::225::IOProcess::(_processLogs) (10012) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:28,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:28,916::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:06:28,917::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:28,917::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:06:28,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:28,917::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) (10013) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) (10013) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) (10013) Building response >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) (10013) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:28,918::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:28,919::__init__::225::IOProcess::(_processLogs) (10014) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) (10014) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) (10014) Building response >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) (10014) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:06:28,920::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) (10015) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) (10015) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) (10015) Building response >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) (10015) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:28,921::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:30,244::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:30,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4677::DEBUG::2014-09-09 12:06:30,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:30,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:30,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089575 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:31,487::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) (10016) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) (10016) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:31,488::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10016) Building response >Thread-19::DEBUG::2014-09-09 12:06:31,489::__init__::225::IOProcess::(_processLogs) (10016) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:31,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:31,489::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:06:31,489::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:06:31,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111536 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:31,497::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:31,497::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:31,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:31,497::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) (10017) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) (10017) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10017) Building response >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) (10017) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:31,498::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:31,499::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:06:32,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:32,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896384 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:33,253::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:33,253::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4678::DEBUG::2014-09-09 12:06:33,254::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:34,272::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4679::DEBUG::2014-09-09 12:06:34,272::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:06:34,272::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4679::DEBUG::2014-09-09 12:06:34,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`b46fdeb0-a9aa-4c72-b008-0cd9e4caf193`::moving from state init -> state preparing >Thread-4679::INFO::2014-09-09 12:06:34,274::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4679::INFO::2014-09-09 12:06:34,274::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4679::DEBUG::2014-09-09 12:06:34,274::task::1191::Storage.TaskManager.Task::(prepare) Task=`b46fdeb0-a9aa-4c72-b008-0cd9e4caf193`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4679::DEBUG::2014-09-09 12:06:34,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`b46fdeb0-a9aa-4c72-b008-0cd9e4caf193`::moving from state preparing -> state finished >Thread-4679::DEBUG::2014-09-09 12:06:34,274::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4679::DEBUG::2014-09-09 12:06:34,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4679::DEBUG::2014-09-09 12:06:34,274::task::993::Storage.TaskManager.Task::(_decref) Task=`b46fdeb0-a9aa-4c72-b008-0cd9e4caf193`::ref 0 aborting False >Thread-4679::DEBUG::2014-09-09 12:06:34,274::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4679::DEBUG::2014-09-09 12:06:34,274::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:34,320::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:34,321::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4680::DEBUG::2014-09-09 12:06:34,321::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4680::DEBUG::2014-09-09 12:06:34,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`8940aa24-61c5-4ea0-830b-2243d40a7b97`::moving from state init -> state preparing >Thread-4680::INFO::2014-09-09 12:06:34,322::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4680::DEBUG::2014-09-09 12:06:34,322::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`544eff3a-1864-48db-9eee-938843ffdb4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4680::DEBUG::2014-09-09 12:06:34,322::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4680::DEBUG::2014-09-09 12:06:34,322::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4680::DEBUG::2014-09-09 12:06:34,322::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`544eff3a-1864-48db-9eee-938843ffdb4a`::Granted request >Thread-4680::DEBUG::2014-09-09 12:06:34,323::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8940aa24-61c5-4ea0-830b-2243d40a7b97`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4680::DEBUG::2014-09-09 12:06:34,323::task::993::Storage.TaskManager.Task::(_decref) Task=`8940aa24-61c5-4ea0-830b-2243d40a7b97`::ref 1 aborting False >Thread-4680::INFO::2014-09-09 12:06:34,324::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4680::DEBUG::2014-09-09 12:06:34,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`8940aa24-61c5-4ea0-830b-2243d40a7b97`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4680::DEBUG::2014-09-09 12:06:34,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`8940aa24-61c5-4ea0-830b-2243d40a7b97`::moving from state preparing -> state finished >Thread-4680::DEBUG::2014-09-09 12:06:34,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4680::DEBUG::2014-09-09 12:06:34,325::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4680::DEBUG::2014-09-09 12:06:34,325::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4680::DEBUG::2014-09-09 12:06:34,325::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4680::DEBUG::2014-09-09 12:06:34,325::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4680::DEBUG::2014-09-09 12:06:34,325::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4680::DEBUG::2014-09-09 12:06:34,325::task::993::Storage.TaskManager.Task::(_decref) Task=`8940aa24-61c5-4ea0-830b-2243d40a7b97`::ref 0 aborting False >Thread-4680::DEBUG::2014-09-09 12:06:34,325::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4680::DEBUG::2014-09-09 12:06:34,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:34,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:34,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894563 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:35,908::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) (10018) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:35,909::__init__::225::IOProcess::(_processLogs) (10018) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:35,911::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10018) Building response >Thread-19::DEBUG::2014-09-09 12:06:35,911::__init__::225::IOProcess::(_processLogs) (10018) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:35,911::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:35,911::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:06:35,912::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:06:35,919::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000866924 s, 409 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:35,919::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) (10019) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) (10019) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:35,920::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10019) Building response >Thread-19::DEBUG::2014-09-09 12:06:35,921::__init__::225::IOProcess::(_processLogs) (10019) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:35,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:35,921::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:36,259::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:36,260::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4681::DEBUG::2014-09-09 12:06:36,261::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:36,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:36,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895277 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:06:38,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:38,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089491 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:38,921::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:38,921::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:38,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) (10020) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) (10020) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:38,922::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10020) Building response >Thread-19::DEBUG::2014-09-09 12:06:38,923::__init__::225::IOProcess::(_processLogs) (10020) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:38,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:38,923::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:06:38,923::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:06:38,931::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000971684 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:38,931::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) (10021) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) (10021) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10021) Building response >Thread-19::DEBUG::2014-09-09 12:06:38,932::__init__::225::IOProcess::(_processLogs) (10021) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:38,933::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:38,933::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:06:38,933::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:38,933::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:06:38,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) (10022) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) (10022) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:38,934::__init__::225::IOProcess::(_processLogs) (10022) Building response >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) (10022) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:38,935::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) (10023) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) (10023) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) (10023) Building response >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) (10023) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:06:38,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:38,937::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:38,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:38,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:38,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:38,937::__init__::225::IOProcess::(_processLogs) (10024) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:38,937::__init__::225::IOProcess::(_processLogs) (10024) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:38,938::__init__::225::IOProcess::(_processLogs) (10024) Building response >Thread-19::DEBUG::2014-09-09 12:06:38,938::__init__::225::IOProcess::(_processLogs) (10024) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:38,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:38,938::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:39,266::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:39,267::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4682::DEBUG::2014-09-09 12:06:39,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b61558d-b22b-4505-ac81-fccb430fb34a`::moving from state init -> state preparing >Thread-4682::INFO::2014-09-09 12:06:39,268::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4682::INFO::2014-09-09 12:06:39,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111536', 'lastCheck': '7.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971684', 'lastCheck': '0.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000866924', 'lastCheck': '3.3', 'valid': True}} >Thread-4682::DEBUG::2014-09-09 12:06:39,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b61558d-b22b-4505-ac81-fccb430fb34a`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111536', 'lastCheck': '7.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971684', 'lastCheck': '0.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000866924', 'lastCheck': '3.3', 'valid': True}} >Thread-4682::DEBUG::2014-09-09 12:06:39,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b61558d-b22b-4505-ac81-fccb430fb34a`::moving from state preparing -> state finished >Thread-4682::DEBUG::2014-09-09 12:06:39,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4682::DEBUG::2014-09-09 12:06:39,268::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4682::DEBUG::2014-09-09 12:06:39,268::task::993::Storage.TaskManager.Task::(_decref) Task=`8b61558d-b22b-4505-ac81-fccb430fb34a`::ref 0 aborting False >Thread-4682::DEBUG::2014-09-09 12:06:39,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:39,276::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:39,276::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4683::DEBUG::2014-09-09 12:06:39,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:40,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:40,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895167 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) (10025) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:41,500::__init__::225::IOProcess::(_processLogs) (10025) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:41,501::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10025) Building response >Thread-19::DEBUG::2014-09-09 12:06:41,501::__init__::225::IOProcess::(_processLogs) (10025) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:41,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:41,502::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:06:41,502::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:06:41,510::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010588 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:41,510::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:41,510::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) (10026) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) (10026) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10026) Building response >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) (10026) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:41,511::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:41,512::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:42,829::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:42,830::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4684::DEBUG::2014-09-09 12:06:42,831::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:43,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:43,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0904164 s, 11.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:44,582::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:44,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4685::DEBUG::2014-09-09 12:06:44,583::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4685::DEBUG::2014-09-09 12:06:44,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6500ca5-b748-4dd7-a9cd-973a81ac6d69`::moving from state init -> state preparing >Thread-4685::INFO::2014-09-09 12:06:44,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4685::INFO::2014-09-09 12:06:44,584::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4685::DEBUG::2014-09-09 12:06:44,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6500ca5-b748-4dd7-a9cd-973a81ac6d69`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4685::DEBUG::2014-09-09 12:06:44,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6500ca5-b748-4dd7-a9cd-973a81ac6d69`::moving from state preparing -> state finished >Thread-4685::DEBUG::2014-09-09 12:06:44,584::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4685::DEBUG::2014-09-09 12:06:44,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4685::DEBUG::2014-09-09 12:06:44,585::task::993::Storage.TaskManager.Task::(_decref) Task=`e6500ca5-b748-4dd7-a9cd-973a81ac6d69`::ref 0 aborting False >Thread-4685::DEBUG::2014-09-09 12:06:44,585::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4685::DEBUG::2014-09-09 12:06:44,585::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:44,680::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4686::DEBUG::2014-09-09 12:06:44,680::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:06:44,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4686::DEBUG::2014-09-09 12:06:44,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`e20b3f94-448e-4ac9-8c78-7cb5fd00dee3`::moving from state init -> state preparing >Thread-4686::INFO::2014-09-09 12:06:44,681::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4686::DEBUG::2014-09-09 12:06:44,682::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1927d007-cf16-4c5d-8d77-f19fdfa41c97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4686::DEBUG::2014-09-09 12:06:44,682::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4686::DEBUG::2014-09-09 12:06:44,682::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4686::DEBUG::2014-09-09 12:06:44,682::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1927d007-cf16-4c5d-8d77-f19fdfa41c97`::Granted request >Thread-4686::DEBUG::2014-09-09 12:06:44,682::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e20b3f94-448e-4ac9-8c78-7cb5fd00dee3`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4686::DEBUG::2014-09-09 12:06:44,682::task::993::Storage.TaskManager.Task::(_decref) Task=`e20b3f94-448e-4ac9-8c78-7cb5fd00dee3`::ref 1 aborting False >Thread-4686::INFO::2014-09-09 12:06:44,684::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4686::DEBUG::2014-09-09 12:06:44,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`e20b3f94-448e-4ac9-8c78-7cb5fd00dee3`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4686::DEBUG::2014-09-09 12:06:44,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`e20b3f94-448e-4ac9-8c78-7cb5fd00dee3`::moving from state preparing -> state finished >Thread-4686::DEBUG::2014-09-09 12:06:44,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4686::DEBUG::2014-09-09 12:06:44,684::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4686::DEBUG::2014-09-09 12:06:44,684::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4686::DEBUG::2014-09-09 12:06:44,684::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4686::DEBUG::2014-09-09 12:06:44,684::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4686::DEBUG::2014-09-09 12:06:44,685::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4686::DEBUG::2014-09-09 12:06:44,685::task::993::Storage.TaskManager.Task::(_decref) Task=`e20b3f94-448e-4ac9-8c78-7cb5fd00dee3`::ref 0 aborting False >Thread-4686::DEBUG::2014-09-09 12:06:44,685::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283544387584', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4686::DEBUG::2014-09-09 12:06:44,685::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:45,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:45,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897427 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:45,838::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:45,839::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4687::DEBUG::2014-09-09 12:06:45,840::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) (10027) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) (10027) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:45,922::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10027) Building response >Thread-19::DEBUG::2014-09-09 12:06:45,923::__init__::225::IOProcess::(_processLogs) (10027) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:45,923::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:45,923::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:06:45,923::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:06:45,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000890472 s, 399 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:45,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:45,932::__init__::225::IOProcess::(_processLogs) (10028) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:45,932::__init__::225::IOProcess::(_processLogs) (10028) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:45,932::__init__::225::IOProcess::(_processLogs) (10028) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:45,932::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:06:47,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:47,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895121 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:48,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:48,849::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4688::DEBUG::2014-09-09 12:06:48,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:06:48,937::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) (10029) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) (10029) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:48,938::__init__::225::IOProcess::(_processLogs) (10029) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:48,939::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:06:48,939::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:06:48,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00096419 s, 568 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:48,947::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:48,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:48,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:48,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:48,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:48,948::__init__::225::IOProcess::(_processLogs) (10030) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:48,948::__init__::225::IOProcess::(_processLogs) (10030) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:48,948::__init__::225::IOProcess::(_processLogs) (10030) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:48,948::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) (10031) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:48,949::__init__::225::IOProcess::(_processLogs) (10031) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:48,950::__init__::225::IOProcess::(_processLogs) (10031) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:48,950::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:48,950::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:06:48,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:48,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:48,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:48,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:48,951::__init__::225::IOProcess::(_processLogs) (10032) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:48,951::__init__::225::IOProcess::(_processLogs) (10032) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:48,951::__init__::225::IOProcess::(_processLogs) (10032) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:48,951::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:48,952::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:06:48,952::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:48,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:48,952::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:48,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:48,953::__init__::225::IOProcess::(_processLogs) (10033) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:48,953::__init__::225::IOProcess::(_processLogs) (10033) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:48,953::__init__::225::IOProcess::(_processLogs) (10033) Building response >Thread-19::DEBUG::2014-09-09 12:06:48,953::__init__::225::IOProcess::(_processLogs) (10033) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:48,953::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:48,953::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:06:49,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:49,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0935642 s, 10.9 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:06:51,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:06:51,513::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:51,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:51,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:51,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:51,513::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:51,514::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:51,514::__init__::225::IOProcess::(_processLogs) (10034) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:51,514::__init__::225::IOProcess::(_processLogs) (10034) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:51,588::__init__::225::IOProcess::(_processLogs) (10034) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:51,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:06:51,590::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:51,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0967084 s, 10.6 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:06:51,598::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010335 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:51,599::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:06:51,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:51,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:51,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:51,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:51,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:51,602::__init__::225::IOProcess::(_processLogs) (10035) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:51,603::__init__::225::IOProcess::(_processLogs) (10035) Building response >Thread-19::DEBUG::2014-09-09 12:06:51,604::__init__::225::IOProcess::(_processLogs) (10035) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:51,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:51,605::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:51,858::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:51,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4689::DEBUG::2014-09-09 12:06:51,859::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:53,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:53,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896516 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:54,865::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:54,866::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4690::DEBUG::2014-09-09 12:06:54,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`598ed66d-7dc5-45c4-a011-151064debf36`::moving from state init -> state preparing >Thread-4690::INFO::2014-09-09 12:06:54,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4690::INFO::2014-09-09 12:06:54,868::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010335', 'lastCheck': '3.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096419', 'lastCheck': '5.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000890472', 'lastCheck': '8.9', 'valid': True}} >Thread-4690::DEBUG::2014-09-09 12:06:54,868::task::1191::Storage.TaskManager.Task::(prepare) Task=`598ed66d-7dc5-45c4-a011-151064debf36`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010335', 'lastCheck': '3.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096419', 'lastCheck': '5.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000890472', 'lastCheck': '8.9', 'valid': True}} >Thread-4690::DEBUG::2014-09-09 12:06:54,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`598ed66d-7dc5-45c4-a011-151064debf36`::moving from state preparing -> state finished >Thread-4690::DEBUG::2014-09-09 12:06:54,868::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4690::DEBUG::2014-09-09 12:06:54,868::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4690::DEBUG::2014-09-09 12:06:54,868::task::993::Storage.TaskManager.Task::(_decref) Task=`598ed66d-7dc5-45c4-a011-151064debf36`::ref 0 aborting False >Thread-4690::DEBUG::2014-09-09 12:06:54,869::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:54,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:54,878::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4691::DEBUG::2014-09-09 12:06:54,879::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:54,881::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:54,882::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4692::DEBUG::2014-09-09 12:06:54,882::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4692::DEBUG::2014-09-09 12:06:54,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf92e63d-0d03-4018-bf0e-421ed86f369b`::moving from state init -> state preparing >Thread-4692::INFO::2014-09-09 12:06:54,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4692::INFO::2014-09-09 12:06:54,883::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4692::DEBUG::2014-09-09 12:06:54,883::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf92e63d-0d03-4018-bf0e-421ed86f369b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4692::DEBUG::2014-09-09 12:06:54,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf92e63d-0d03-4018-bf0e-421ed86f369b`::moving from state preparing -> state finished >Thread-4692::DEBUG::2014-09-09 12:06:54,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4692::DEBUG::2014-09-09 12:06:54,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4692::DEBUG::2014-09-09 12:06:54,883::task::993::Storage.TaskManager.Task::(_decref) Task=`bf92e63d-0d03-4018-bf0e-421ed86f369b`::ref 0 aborting False >Thread-4692::DEBUG::2014-09-09 12:06:54,884::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4692::DEBUG::2014-09-09 12:06:54,884::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:06:55,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:55,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08982 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) (10036) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:55,933::__init__::225::IOProcess::(_processLogs) (10036) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:55,934::__init__::225::IOProcess::(_processLogs) (10036) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:55,934::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:06:55,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:06:55,941::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00089676 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) (10037) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) (10037) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:55,942::__init__::225::IOProcess::(_processLogs) DEBUG|(10037) Building response >Thread-19::DEBUG::2014-09-09 12:06:55,943::__init__::225::IOProcess::(_processLogs) (10037) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:55,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:55,943::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:06:57,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:06:57,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894471 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:06:58,014::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:06:58,015::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4693::DEBUG::2014-09-09 12:06:58,015::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4693::DEBUG::2014-09-09 12:06:58,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`b302e5a1-b248-4cbc-a859-cb44418feabf`::moving from state init -> state preparing >Thread-4693::INFO::2014-09-09 12:06:58,016::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4693::DEBUG::2014-09-09 12:06:58,016::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`548e7aab-36fd-411a-a03b-64eb4bdaf0b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4693::DEBUG::2014-09-09 12:06:58,016::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4693::DEBUG::2014-09-09 12:06:58,017::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4693::DEBUG::2014-09-09 12:06:58,017::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`548e7aab-36fd-411a-a03b-64eb4bdaf0b2`::Granted request >Thread-4693::DEBUG::2014-09-09 12:06:58,017::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b302e5a1-b248-4cbc-a859-cb44418feabf`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4693::DEBUG::2014-09-09 12:06:58,017::task::993::Storage.TaskManager.Task::(_decref) Task=`b302e5a1-b248-4cbc-a859-cb44418feabf`::ref 1 aborting False >Thread-4693::INFO::2014-09-09 12:06:58,019::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4693::DEBUG::2014-09-09 12:06:58,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`b302e5a1-b248-4cbc-a859-cb44418feabf`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4693::DEBUG::2014-09-09 12:06:58,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`b302e5a1-b248-4cbc-a859-cb44418feabf`::moving from state preparing -> state finished >Thread-4693::DEBUG::2014-09-09 12:06:58,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4693::DEBUG::2014-09-09 12:06:58,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4693::DEBUG::2014-09-09 12:06:58,019::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4693::DEBUG::2014-09-09 12:06:58,019::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4693::DEBUG::2014-09-09 12:06:58,019::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4693::DEBUG::2014-09-09 12:06:58,019::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4693::DEBUG::2014-09-09 12:06:58,020::task::993::Storage.TaskManager.Task::(_decref) Task=`b302e5a1-b248-4cbc-a859-cb44418feabf`::ref 0 aborting False >Thread-4693::DEBUG::2014-09-09 12:06:58,020::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4693::DEBUG::2014-09-09 12:06:58,020::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) (10038) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:58,953::__init__::225::IOProcess::(_processLogs) (10038) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:58,954::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10038) Building response >Thread-19::DEBUG::2014-09-09 12:06:58,954::__init__::225::IOProcess::(_processLogs) (10038) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:58,954::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:58,954::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:06:58,954::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:06:58,963::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000915635 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:06:58,963::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:58,963::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) (10039) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) (10039) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10039) Building response >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) (10039) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:58,964::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:06:58,965::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:06:58,965::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:58,965::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) (10040) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) (10040) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) (10040) Building response >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) (10040) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:58,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:58,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) (10041) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) (10041) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) (10041) Building response >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) (10041) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:06:58,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) (10042) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) (10042) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) (10042) Building response >Thread-19::DEBUG::2014-09-09 12:06:58,969::__init__::225::IOProcess::(_processLogs) (10042) Queuing response >Thread-19::DEBUG::2014-09-09 12:06:58,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:06:58,970::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:06:59,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:00,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0893857 s, 11.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:01,283::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:01,283::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4694::DEBUG::2014-09-09 12:07:01,284::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:01,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:01,605::__init__::225::IOProcess::(_processLogs) (10043) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:01,605::__init__::225::IOProcess::(_processLogs) (10043) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:01,605::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10043) Building response >Thread-23::DEBUG::2014-09-09 12:07:01,605::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:01,606::__init__::225::IOProcess::(_processLogs) (10043) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:01,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:01,611::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:07:01,613::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113103 s, 993 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:01,614::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:01,614::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:01,614::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:01,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:01,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:01,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:01,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:01,615::__init__::225::IOProcess::(_processLogs) (10044) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:01,615::__init__::225::IOProcess::(_processLogs) (10044) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:01,615::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10044) Building response >Thread-19::DEBUG::2014-09-09 12:07:01,615::__init__::225::IOProcess::(_processLogs) (10044) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:01,615::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:01,616::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:02,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:02,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895782 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:07:04,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:04,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896234 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:04,290::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:04,290::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4695::DEBUG::2014-09-09 12:07:04,291::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:07:05,944::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:05,944::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:05,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:05,944::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:05,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:05,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:05,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:05,945::__init__::225::IOProcess::(_processLogs) (10045) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:05,945::__init__::225::IOProcess::(_processLogs) (10045) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:05,945::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10045) Building response >Thread-19::DEBUG::2014-09-09 12:07:05,946::__init__::225::IOProcess::(_processLogs) (10045) Queuing response >Thread-3443::DEBUG::2014-09-09 12:07:05,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:05,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:05,951::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:07:05,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000807722 s, 440 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) (10046) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:05,954::__init__::225::IOProcess::(_processLogs) (10046) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:05,955::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10046) Building response >Thread-19::DEBUG::2014-09-09 12:07:05,955::__init__::225::IOProcess::(_processLogs) (10046) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:05,955::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:05,955::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:06,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:06,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895221 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:07,297::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:07,297::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4696::DEBUG::2014-09-09 12:07:07,298::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:08,282::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:08,283::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4697::DEBUG::2014-09-09 12:07:08,283::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4697::DEBUG::2014-09-09 12:07:08,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`b525a579-2af4-492b-ab5d-ccb764146531`::moving from state init -> state preparing >Thread-4697::INFO::2014-09-09 12:07:08,284::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4697::INFO::2014-09-09 12:07:08,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4697::DEBUG::2014-09-09 12:07:08,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`b525a579-2af4-492b-ab5d-ccb764146531`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4697::DEBUG::2014-09-09 12:07:08,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`b525a579-2af4-492b-ab5d-ccb764146531`::moving from state preparing -> state finished >Thread-4697::DEBUG::2014-09-09 12:07:08,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4697::DEBUG::2014-09-09 12:07:08,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4697::DEBUG::2014-09-09 12:07:08,284::task::993::Storage.TaskManager.Task::(_decref) Task=`b525a579-2af4-492b-ab5d-ccb764146531`::ref 0 aborting False >Thread-4697::DEBUG::2014-09-09 12:07:08,285::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4697::DEBUG::2014-09-09 12:07:08,285::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:08,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:08,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895875 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:08,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:08,584::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4698::DEBUG::2014-09-09 12:07:08,584::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4698::DEBUG::2014-09-09 12:07:08,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`aaeb3d76-b998-4c60-a54b-412cf35aa6df`::moving from state init -> state preparing >Thread-4698::INFO::2014-09-09 12:07:08,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4698::DEBUG::2014-09-09 12:07:08,587::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a4d97d6b-433e-4c22-9611-ad8189472a37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4698::DEBUG::2014-09-09 12:07:08,587::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4698::DEBUG::2014-09-09 12:07:08,587::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4698::DEBUG::2014-09-09 12:07:08,587::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a4d97d6b-433e-4c22-9611-ad8189472a37`::Granted request >Thread-4698::DEBUG::2014-09-09 12:07:08,587::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aaeb3d76-b998-4c60-a54b-412cf35aa6df`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4698::DEBUG::2014-09-09 12:07:08,587::task::993::Storage.TaskManager.Task::(_decref) Task=`aaeb3d76-b998-4c60-a54b-412cf35aa6df`::ref 1 aborting False >Thread-4698::INFO::2014-09-09 12:07:08,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4698::DEBUG::2014-09-09 12:07:08,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`aaeb3d76-b998-4c60-a54b-412cf35aa6df`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4698::DEBUG::2014-09-09 12:07:08,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`aaeb3d76-b998-4c60-a54b-412cf35aa6df`::moving from state preparing -> state finished >Thread-4698::DEBUG::2014-09-09 12:07:08,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4698::DEBUG::2014-09-09 12:07:08,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4698::DEBUG::2014-09-09 12:07:08,589::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4698::DEBUG::2014-09-09 12:07:08,590::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4698::DEBUG::2014-09-09 12:07:08,590::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4698::DEBUG::2014-09-09 12:07:08,590::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4698::DEBUG::2014-09-09 12:07:08,590::task::993::Storage.TaskManager.Task::(_decref) Task=`aaeb3d76-b998-4c60-a54b-412cf35aa6df`::ref 0 aborting False >Thread-4698::DEBUG::2014-09-09 12:07:08,590::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4698::DEBUG::2014-09-09 12:07:08,590::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:07:08,969::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) (10047) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) (10047) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:08,970::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10047) Building response >Thread-19::DEBUG::2014-09-09 12:07:08,971::__init__::225::IOProcess::(_processLogs) (10047) Queuing response >Thread-24::DEBUG::2014-09-09 12:07:08,971::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:08,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:08,977::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:07:08,979::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000895266 s, 612 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:08,979::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:08,979::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) (10048) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) (10048) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10048) Building response >Thread-19::DEBUG::2014-09-09 12:07:08,980::__init__::225::IOProcess::(_processLogs) (10048) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:08,981::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:08,981::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:07:08,981::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:08,981::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:07:08,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) (10049) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) (10049) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) (10049) Building response >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) (10049) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:08,982::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:08,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) (10050) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) (10050) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) (10050) Building response >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) (10050) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:08,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) (10051) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) (10051) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10051) Building response >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) (10051) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:08,985::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:08,986::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:10,304::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:10,304::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4699::DEBUG::2014-09-09 12:07:10,305::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:10,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:10,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894875 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:11,616::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:11,617::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:11,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:11,617::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:11,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:11,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:11,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:11,618::__init__::225::IOProcess::(_processLogs) (10052) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:11,618::__init__::225::IOProcess::(_processLogs) (10052) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:11,618::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10052) Building response >Thread-19::DEBUG::2014-09-09 12:07:11,618::__init__::225::IOProcess::(_processLogs) (10052) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:11,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:11,619::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:07:11,619::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:07:11,627::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110123 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:11,627::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:11,627::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) (10053) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) (10053) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10053) Building response >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) (10053) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:11,628::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:11,629::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:12,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:12,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896742 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:13,309::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:13,310::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4700::DEBUG::2014-09-09 12:07:13,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5b5a9db-97ac-4f9f-b42c-81f320218f90`::moving from state init -> state preparing >Thread-4700::INFO::2014-09-09 12:07:13,311::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4700::INFO::2014-09-09 12:07:13,311::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110123', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895266', 'lastCheck': '4.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000807722', 'lastCheck': '7.4', 'valid': True}} >Thread-4700::DEBUG::2014-09-09 12:07:13,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5b5a9db-97ac-4f9f-b42c-81f320218f90`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110123', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895266', 'lastCheck': '4.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000807722', 'lastCheck': '7.4', 'valid': True}} >Thread-4700::DEBUG::2014-09-09 12:07:13,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5b5a9db-97ac-4f9f-b42c-81f320218f90`::moving from state preparing -> state finished >Thread-4700::DEBUG::2014-09-09 12:07:13,311::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4700::DEBUG::2014-09-09 12:07:13,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4700::DEBUG::2014-09-09 12:07:13,311::task::993::Storage.TaskManager.Task::(_decref) Task=`c5b5a9db-97ac-4f9f-b42c-81f320218f90`::ref 0 aborting False >Thread-4700::DEBUG::2014-09-09 12:07:13,312::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:13,319::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:13,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4701::DEBUG::2014-09-09 12:07:13,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:14,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:14,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897094 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) (10054) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:15,956::__init__::225::IOProcess::(_processLogs) (10054) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:15,957::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10054) Building response >Thread-19::DEBUG::2014-09-09 12:07:15,957::__init__::225::IOProcess::(_processLogs) (10054) Queuing response >Thread-3443::DEBUG::2014-09-09 12:07:15,957::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:15,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:15,963::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:07:15,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000853605 s, 416 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) (10055) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) (10055) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:15,966::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10055) Building response >Thread-19::DEBUG::2014-09-09 12:07:15,967::__init__::225::IOProcess::(_processLogs) (10055) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:15,967::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:15,967::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:16,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:16,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895679 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:17,155::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:17,156::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4702::DEBUG::2014-09-09 12:07:17,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:18,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:18,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899249 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:18,986::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:18,986::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:18,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:18,986::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:18,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:18,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:18,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:18,987::__init__::225::IOProcess::(_processLogs) (10056) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:18,987::__init__::225::IOProcess::(_processLogs) (10056) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:18,988::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10056) Building response >Thread-19::DEBUG::2014-09-09 12:07:18,988::__init__::225::IOProcess::(_processLogs) (10056) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:18,988::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:18,989::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:07:18,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:07:18,998::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000943999 s, 581 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) (10057) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:18,999::__init__::225::IOProcess::(_processLogs) (10057) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:19,000::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10057) Building response >Thread-19::DEBUG::2014-09-09 12:07:19,000::__init__::225::IOProcess::(_processLogs) (10057) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:19,000::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:19,000::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:19,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) (10058) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) (10058) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) (10058) Building response >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) (10058) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:07:19,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) (10059) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) (10059) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) (10059) Building response >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) (10059) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:19,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:19,004::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:19,004::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:19,004::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:07:19,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:19,004::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:19,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) (10060) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) (10060) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) (10060) Building response >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) (10060) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:19,005::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:20,163::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:20,165::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4703::DEBUG::2014-09-09 12:07:20,167::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:20,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:21,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897184 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) (10061) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:21,630::__init__::225::IOProcess::(_processLogs) (10061) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:21,631::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10061) Building response >Thread-23::DEBUG::2014-09-09 12:07:21,631::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:21,631::__init__::225::IOProcess::(_processLogs) (10061) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:21,637::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:21,637::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:07:21,638::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103207 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:21,639::__init__::225::IOProcess::(_processLogs) (10062) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:21,640::__init__::225::IOProcess::(_processLogs) (10062) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:21,640::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10062) Building response >Thread-19::DEBUG::2014-09-09 12:07:21,640::__init__::225::IOProcess::(_processLogs) (10062) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:21,640::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:21,641::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:21,821::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:21,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4704::DEBUG::2014-09-09 12:07:21,823::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4704::DEBUG::2014-09-09 12:07:21,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff03cabe-37cf-413f-9229-2704f540af2d`::moving from state init -> state preparing >Thread-4704::INFO::2014-09-09 12:07:21,824::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4704::INFO::2014-09-09 12:07:21,824::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4704::DEBUG::2014-09-09 12:07:21,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff03cabe-37cf-413f-9229-2704f540af2d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4704::DEBUG::2014-09-09 12:07:21,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff03cabe-37cf-413f-9229-2704f540af2d`::moving from state preparing -> state finished >Thread-4704::DEBUG::2014-09-09 12:07:21,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4704::DEBUG::2014-09-09 12:07:21,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4704::DEBUG::2014-09-09 12:07:21,824::task::993::Storage.TaskManager.Task::(_decref) Task=`ff03cabe-37cf-413f-9229-2704f540af2d`::ref 0 aborting False >Thread-4704::DEBUG::2014-09-09 12:07:21,825::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4704::DEBUG::2014-09-09 12:07:21,825::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:22,003::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:22,003::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4705::DEBUG::2014-09-09 12:07:22,004::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4705::DEBUG::2014-09-09 12:07:22,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`d163f7e6-f28e-4aa4-8a9a-005a53c3ecc3`::moving from state init -> state preparing >Thread-4705::INFO::2014-09-09 12:07:22,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4705::DEBUG::2014-09-09 12:07:22,005::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`58904e5e-abf2-435c-9674-193295cab6c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4705::DEBUG::2014-09-09 12:07:22,005::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4705::DEBUG::2014-09-09 12:07:22,005::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4705::DEBUG::2014-09-09 12:07:22,005::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`58904e5e-abf2-435c-9674-193295cab6c3`::Granted request >Thread-4705::DEBUG::2014-09-09 12:07:22,005::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d163f7e6-f28e-4aa4-8a9a-005a53c3ecc3`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4705::DEBUG::2014-09-09 12:07:22,005::task::993::Storage.TaskManager.Task::(_decref) Task=`d163f7e6-f28e-4aa4-8a9a-005a53c3ecc3`::ref 1 aborting False >Thread-4705::INFO::2014-09-09 12:07:22,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4705::DEBUG::2014-09-09 12:07:22,007::task::1191::Storage.TaskManager.Task::(prepare) Task=`d163f7e6-f28e-4aa4-8a9a-005a53c3ecc3`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4705::DEBUG::2014-09-09 12:07:22,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`d163f7e6-f28e-4aa4-8a9a-005a53c3ecc3`::moving from state preparing -> state finished >Thread-4705::DEBUG::2014-09-09 12:07:22,007::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4705::DEBUG::2014-09-09 12:07:22,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4705::DEBUG::2014-09-09 12:07:22,007::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4705::DEBUG::2014-09-09 12:07:22,007::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4705::DEBUG::2014-09-09 12:07:22,008::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4705::DEBUG::2014-09-09 12:07:22,008::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4705::DEBUG::2014-09-09 12:07:22,008::task::993::Storage.TaskManager.Task::(_decref) Task=`d163f7e6-f28e-4aa4-8a9a-005a53c3ecc3`::ref 0 aborting False >Thread-4705::DEBUG::2014-09-09 12:07:22,008::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4705::DEBUG::2014-09-09 12:07:22,008::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:23,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:23,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894502 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:23,173::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:23,175::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4706::DEBUG::2014-09-09 12:07:23,177::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:25,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:25,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895825 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:25,968::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:25,968::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:25,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:25,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:25,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:25,969::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:25,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:25,969::__init__::225::IOProcess::(_processLogs) (10063) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:25,969::__init__::225::IOProcess::(_processLogs) (10063) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:25,969::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10063) Building response >Thread-3443::DEBUG::2014-09-09 12:07:25,970::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:25,970::__init__::225::IOProcess::(_processLogs) (10063) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:25,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:25,975::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:07:25,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000920311 s, 386 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:25,977::__init__::225::IOProcess::(_processLogs) (10064) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:25,978::__init__::225::IOProcess::(_processLogs) (10064) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:25,978::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10064) Building response >Thread-19::DEBUG::2014-09-09 12:07:25,978::__init__::225::IOProcess::(_processLogs) (10064) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:25,978::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:25,979::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:26,184::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:26,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4707::DEBUG::2014-09-09 12:07:26,186::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:27,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:27,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896448 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:29,005::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:29,005::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:29,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:29,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:29,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) (10065) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) (10065) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10065) Building response >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) (10065) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:29,006::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:07:29,006::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:07:29,014::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104751 s, 523 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:29,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:29,016::__init__::225::IOProcess::(_processLogs) (10066) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:29,016::__init__::225::IOProcess::(_processLogs) (10066) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:29,016::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10066) Building response >Thread-19::DEBUG::2014-09-09 12:07:29,016::__init__::225::IOProcess::(_processLogs) (10066) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:29,016::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:29,017::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:07:29,017::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:29,017::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:07:29,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:29,017::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:29,017::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) (10067) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) (10067) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) (10067) Building response >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) (10067) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:29,018::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) (10068) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) (10068) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) (10068) Building response >Thread-19::DEBUG::2014-09-09 12:07:29,019::__init__::225::IOProcess::(_processLogs) (10068) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:29,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:29,020::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:29,020::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:29,020::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:07:29,020::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:29,020::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) (10069) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) (10069) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) (10069) Building response >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) (10069) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:29,021::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:29,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:29,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4708::DEBUG::2014-09-09 12:07:29,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b6e54c2-a2b8-4b39-b0be-cd20800dee44`::moving from state init -> state preparing >Thread-4708::INFO::2014-09-09 12:07:29,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4708::INFO::2014-09-09 12:07:29,193::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103207', 'lastCheck': '7.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104751', 'lastCheck': '0.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920311', 'lastCheck': '3.2', 'valid': True}} >Thread-4708::DEBUG::2014-09-09 12:07:29,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b6e54c2-a2b8-4b39-b0be-cd20800dee44`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103207', 'lastCheck': '7.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104751', 'lastCheck': '0.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000920311', 'lastCheck': '3.2', 'valid': True}} >Thread-4708::DEBUG::2014-09-09 12:07:29,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b6e54c2-a2b8-4b39-b0be-cd20800dee44`::moving from state preparing -> state finished >Thread-4708::DEBUG::2014-09-09 12:07:29,194::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4708::DEBUG::2014-09-09 12:07:29,194::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4708::DEBUG::2014-09-09 12:07:29,194::task::993::Storage.TaskManager.Task::(_decref) Task=`9b6e54c2-a2b8-4b39-b0be-cd20800dee44`::ref 0 aborting False >Thread-4708::DEBUG::2014-09-09 12:07:29,195::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:29,200::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:29,201::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4709::DEBUG::2014-09-09 12:07:29,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:29,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:29,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894959 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:07:31,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:31,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895051 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:31,641::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:31,641::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:31,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:31,641::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:31,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) (10070) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) (10070) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|(10070) Building response >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) (10070) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:31,642::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:07:31,643::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:07:31,650::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010709 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:31,650::__init__::225::IOProcess::(_processLogs) Sending response sized 245DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) (10071) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) (10071) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10071) Building response >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) (10071) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:31,651::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:31,652::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:32,342::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:32,342::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4710::DEBUG::2014-09-09 12:07:32,343::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4710::DEBUG::2014-09-09 12:07:32,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a63e34a-b3a2-4257-9bc7-f664cc9264e9`::moving from state init -> state preparing >Thread-4710::INFO::2014-09-09 12:07:32,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4710::INFO::2014-09-09 12:07:32,344::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4710::DEBUG::2014-09-09 12:07:32,344::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a63e34a-b3a2-4257-9bc7-f664cc9264e9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4710::DEBUG::2014-09-09 12:07:32,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a63e34a-b3a2-4257-9bc7-f664cc9264e9`::moving from state preparing -> state finished >Thread-4710::DEBUG::2014-09-09 12:07:32,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4710::DEBUG::2014-09-09 12:07:32,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4710::DEBUG::2014-09-09 12:07:32,344::task::993::Storage.TaskManager.Task::(_decref) Task=`5a63e34a-b3a2-4257-9bc7-f664cc9264e9`::ref 0 aborting False >Thread-4710::DEBUG::2014-09-09 12:07:32,344::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4710::DEBUG::2014-09-09 12:07:32,344::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:32,475::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:32,475::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4711::DEBUG::2014-09-09 12:07:32,476::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4711::DEBUG::2014-09-09 12:07:32,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`d28ef493-dea6-4972-b7c4-a7459a170de8`::moving from state init -> state preparing >Thread-4711::INFO::2014-09-09 12:07:32,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4711::DEBUG::2014-09-09 12:07:32,477::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`250b3044-2207-48c0-9464-9d596bde6e38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4711::DEBUG::2014-09-09 12:07:32,477::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4711::DEBUG::2014-09-09 12:07:32,477::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4711::DEBUG::2014-09-09 12:07:32,477::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`250b3044-2207-48c0-9464-9d596bde6e38`::Granted request >Thread-4711::DEBUG::2014-09-09 12:07:32,477::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d28ef493-dea6-4972-b7c4-a7459a170de8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4711::DEBUG::2014-09-09 12:07:32,477::task::993::Storage.TaskManager.Task::(_decref) Task=`d28ef493-dea6-4972-b7c4-a7459a170de8`::ref 1 aborting False >Thread-4711::INFO::2014-09-09 12:07:32,479::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4711::DEBUG::2014-09-09 12:07:32,479::task::1191::Storage.TaskManager.Task::(prepare) Task=`d28ef493-dea6-4972-b7c4-a7459a170de8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4711::DEBUG::2014-09-09 12:07:32,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`d28ef493-dea6-4972-b7c4-a7459a170de8`::moving from state preparing -> state finished >Thread-4711::DEBUG::2014-09-09 12:07:32,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4711::DEBUG::2014-09-09 12:07:32,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4711::DEBUG::2014-09-09 12:07:32,479::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4711::DEBUG::2014-09-09 12:07:32,479::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4711::DEBUG::2014-09-09 12:07:32,479::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4711::DEBUG::2014-09-09 12:07:32,480::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4711::DEBUG::2014-09-09 12:07:32,480::task::993::Storage.TaskManager.Task::(_decref) Task=`d28ef493-dea6-4972-b7c4-a7459a170de8`::ref 0 aborting False >Thread-4711::DEBUG::2014-09-09 12:07:32,480::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4711::DEBUG::2014-09-09 12:07:32,480::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:33,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:33,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895497 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:33,862::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:33,863::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4712::DEBUG::2014-09-09 12:07:33,864::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:35,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:35,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894866 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:35,979::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:35,979::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) (10072) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:35,980::__init__::225::IOProcess::(_processLogs) (10072) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:35,982::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10072) Building response >Thread-19::DEBUG::2014-09-09 12:07:35,982::__init__::225::IOProcess::(_processLogs) (10072) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:35,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:35,982::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:07:35,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:07:35,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000882281 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) (10073) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) (10073) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:35,991::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10073) Building response >Thread-19::DEBUG::2014-09-09 12:07:35,992::__init__::225::IOProcess::(_processLogs) (10073) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:35,992::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:35,993::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:36,869::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:36,869::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4713::DEBUG::2014-09-09 12:07:36,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:37,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:37,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894821 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:39,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:39,022::__init__::225::IOProcess::(_processLogs) (10074) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:39,022::__init__::225::IOProcess::(_processLogs) (10074) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:39,022::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10074) Building response >Thread-24::DEBUG::2014-09-09 12:07:39,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:39,023::__init__::225::IOProcess::(_processLogs) (10074) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:39,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:39,028::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:07:39,030::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000899561 s, 609 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) (10075) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:39,031::__init__::225::IOProcess::(_processLogs) (10075) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:39,032::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10075) Building response >Thread-19::DEBUG::2014-09-09 12:07:39,032::__init__::225::IOProcess::(_processLogs) (10075) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:39,032::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:39,032::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:39,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) (10076) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) (10076) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) (10076) Building response >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) (10076) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:39,034::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) (10077) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) (10077) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) (10077) Building response >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) (10077) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:39,035::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:39,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:39,037::__init__::225::IOProcess::(_processLogs) (10078) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:39,037::__init__::225::IOProcess::(_processLogs) (10078) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:39,037::__init__::225::IOProcess::(_processLogs) (10078) Building response >Thread-19::DEBUG::2014-09-09 12:07:39,037::__init__::225::IOProcess::(_processLogs) (10078) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:39,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:39,037::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:39,875::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:39,876::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4714::DEBUG::2014-09-09 12:07:39,877::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:39,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:40,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895445 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:41,653::__init__::225::IOProcess::(_processLogs) (10079) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:41,654::__init__::225::IOProcess::(_processLogs) (10079) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:41,654::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10079) Building response >Thread-19::DEBUG::2014-09-09 12:07:41,654::__init__::225::IOProcess::(_processLogs) (10079) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:41,654::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:07:41,655::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:41,655::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:07:41,663::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104359 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:41,663::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:41,663::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) (10080) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) (10080) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:41,664::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10080) Building response >Thread-19::DEBUG::2014-09-09 12:07:41,665::__init__::225::IOProcess::(_processLogs) (10080) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:41,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:41,665::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:42,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:42,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894964 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:42,568::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:42,569::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4715::DEBUG::2014-09-09 12:07:42,569::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4715::DEBUG::2014-09-09 12:07:42,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e502a3c-0de2-4768-a4b8-23d845d6e34a`::moving from state init -> state preparing >Thread-4715::INFO::2014-09-09 12:07:42,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4715::INFO::2014-09-09 12:07:42,570::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4715::DEBUG::2014-09-09 12:07:42,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e502a3c-0de2-4768-a4b8-23d845d6e34a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4715::DEBUG::2014-09-09 12:07:42,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e502a3c-0de2-4768-a4b8-23d845d6e34a`::moving from state preparing -> state finished >Thread-4715::DEBUG::2014-09-09 12:07:42,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4715::DEBUG::2014-09-09 12:07:42,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4715::DEBUG::2014-09-09 12:07:42,570::task::993::Storage.TaskManager.Task::(_decref) Task=`9e502a3c-0de2-4768-a4b8-23d845d6e34a`::ref 0 aborting False >Thread-4715::DEBUG::2014-09-09 12:07:42,571::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4715::DEBUG::2014-09-09 12:07:42,571::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:42,601::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:42,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4716::DEBUG::2014-09-09 12:07:42,602::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4716::DEBUG::2014-09-09 12:07:42,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`52a28c59-d3f5-4d7c-8f9e-87df52e3df9e`::moving from state init -> state preparing >Thread-4716::INFO::2014-09-09 12:07:42,603::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4716::DEBUG::2014-09-09 12:07:42,603::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`455f028d-74be-4575-b023-5db703bd7400`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4716::DEBUG::2014-09-09 12:07:42,603::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4716::DEBUG::2014-09-09 12:07:42,603::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4716::DEBUG::2014-09-09 12:07:42,604::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`455f028d-74be-4575-b023-5db703bd7400`::Granted request >Thread-4716::DEBUG::2014-09-09 12:07:42,604::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`52a28c59-d3f5-4d7c-8f9e-87df52e3df9e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4716::DEBUG::2014-09-09 12:07:42,604::task::993::Storage.TaskManager.Task::(_decref) Task=`52a28c59-d3f5-4d7c-8f9e-87df52e3df9e`::ref 1 aborting False >Thread-4716::INFO::2014-09-09 12:07:42,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4716::DEBUG::2014-09-09 12:07:42,606::task::1191::Storage.TaskManager.Task::(prepare) Task=`52a28c59-d3f5-4d7c-8f9e-87df52e3df9e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4716::DEBUG::2014-09-09 12:07:42,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`52a28c59-d3f5-4d7c-8f9e-87df52e3df9e`::moving from state preparing -> state finished >Thread-4716::DEBUG::2014-09-09 12:07:42,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4716::DEBUG::2014-09-09 12:07:42,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4716::DEBUG::2014-09-09 12:07:42,606::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4716::DEBUG::2014-09-09 12:07:42,606::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4716::DEBUG::2014-09-09 12:07:42,606::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4716::DEBUG::2014-09-09 12:07:42,606::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4716::DEBUG::2014-09-09 12:07:42,606::task::993::Storage.TaskManager.Task::(_decref) Task=`52a28c59-d3f5-4d7c-8f9e-87df52e3df9e`::ref 0 aborting False >Thread-4716::DEBUG::2014-09-09 12:07:42,607::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4716::DEBUG::2014-09-09 12:07:42,607::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:42,882::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:42,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4717::DEBUG::2014-09-09 12:07:42,884::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:44,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:44,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895193 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:45,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:45,889::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4718::DEBUG::2014-09-09 12:07:45,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`d154c9b2-8ede-48b0-844c-633e0e929427`::moving from state init -> state preparing >Thread-4718::INFO::2014-09-09 12:07:45,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4718::INFO::2014-09-09 12:07:45,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104359', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000899561', 'lastCheck': '6.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882281', 'lastCheck': '9.9', 'valid': True}} >Thread-4718::DEBUG::2014-09-09 12:07:45,890::task::1191::Storage.TaskManager.Task::(prepare) Task=`d154c9b2-8ede-48b0-844c-633e0e929427`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104359', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000899561', 'lastCheck': '6.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882281', 'lastCheck': '9.9', 'valid': True}} >Thread-4718::DEBUG::2014-09-09 12:07:45,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`d154c9b2-8ede-48b0-844c-633e0e929427`::moving from state preparing -> state finished >Thread-4718::DEBUG::2014-09-09 12:07:45,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4718::DEBUG::2014-09-09 12:07:45,891::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4718::DEBUG::2014-09-09 12:07:45,891::task::993::Storage.TaskManager.Task::(_decref) Task=`d154c9b2-8ede-48b0-844c-633e0e929427`::ref 0 aborting False >Thread-4718::DEBUG::2014-09-09 12:07:45,892::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:45,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:45,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4719::DEBUG::2014-09-09 12:07:45,899::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:07:45,993::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:45,993::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:45,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:45,993::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:45,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:45,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:45,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:45,994::__init__::225::IOProcess::(_processLogs) (10081) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:45,994::__init__::225::IOProcess::(_processLogs) (10081) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:45,994::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10081) Building response >Thread-19::DEBUG::2014-09-09 12:07:45,995::__init__::225::IOProcess::(_processLogs) (10081) Queuing response >Thread-3443::DEBUG::2014-09-09 12:07:45,995::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:45,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:46,000::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:07:46,002::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000873236 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:46,002::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:46,002::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:46,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:46,002::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:46,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:46,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:46,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:46,003::__init__::225::IOProcess::(_processLogs) (10082) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:46,003::__init__::225::IOProcess::(_processLogs) (10082) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:46,003::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10082) Building response >Thread-19::DEBUG::2014-09-09 12:07:46,004::__init__::225::IOProcess::(_processLogs) (10082) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:46,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:46,004::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:46,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:46,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896053 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:07:48,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:48,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894784 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:49,014::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:49,015::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4720::DEBUG::2014-09-09 12:07:49,016::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:49,037::__init__::225::IOProcess::(_processLogs) (10083) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:49,038::__init__::225::IOProcess::(_processLogs) (10083) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:49,038::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10083) Building response >Thread-19::DEBUG::2014-09-09 12:07:49,038::__init__::225::IOProcess::(_processLogs) (10083) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:49,039::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:07:49,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:49,040::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:07:49,047::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000617513 s, 887 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:49,047::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) (10084) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) (10084) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10084) Building response >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) (10084) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:49,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:49,049::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:07:49,049::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:49,049::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) (10085) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) (10085) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10085) Building response >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) (10085) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:49,050::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:49,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) (10086) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) (10086) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10086) Building response >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) (10086) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:49,052::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:49,053::__init__::225::IOProcess::(_processLogs) (10087) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:49,054::__init__::225::IOProcess::(_processLogs) (10087) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:49,054::__init__::225::IOProcess::(_processLogs) (10087) Building response >Thread-19::DEBUG::2014-09-09 12:07:49,054::__init__::225::IOProcess::(_processLogs) (10087) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:49,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:49,054::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:07:50,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:50,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894842 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) (10088) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) (10088) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:51,666::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10088) Building response >Thread-19::DEBUG::2014-09-09 12:07:51,667::__init__::225::IOProcess::(_processLogs) (10088) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:51,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:51,667::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:07:51,667::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:07:51,674::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106336 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) (10089) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:51,675::__init__::225::IOProcess::(_processLogs) (10089) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:51,676::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10089) Building response >Thread-19::DEBUG::2014-09-09 12:07:51,676::__init__::225::IOProcess::(_processLogs) (10089) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:51,676::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:51,677::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:52,021::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:52,022::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4721::DEBUG::2014-09-09 12:07:52,023::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:52,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:52,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895619 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:52,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:52,645::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4722::DEBUG::2014-09-09 12:07:52,645::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4722::DEBUG::2014-09-09 12:07:52,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`7797272a-4778-4162-86f7-7adbfdb1c8b3`::moving from state init -> state preparing >Thread-4722::INFO::2014-09-09 12:07:52,646::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4722::INFO::2014-09-09 12:07:52,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4722::DEBUG::2014-09-09 12:07:52,647::task::1191::Storage.TaskManager.Task::(prepare) Task=`7797272a-4778-4162-86f7-7adbfdb1c8b3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4722::DEBUG::2014-09-09 12:07:52,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`7797272a-4778-4162-86f7-7adbfdb1c8b3`::moving from state preparing -> state finished >Thread-4722::DEBUG::2014-09-09 12:07:52,647::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4722::DEBUG::2014-09-09 12:07:52,647::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4722::DEBUG::2014-09-09 12:07:52,647::task::993::Storage.TaskManager.Task::(_decref) Task=`7797272a-4778-4162-86f7-7adbfdb1c8b3`::ref 0 aborting False >Thread-4722::DEBUG::2014-09-09 12:07:52,647::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4722::DEBUG::2014-09-09 12:07:52,647::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:52,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:52,686::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4723::DEBUG::2014-09-09 12:07:52,686::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4723::DEBUG::2014-09-09 12:07:52,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea490333-07ca-4dee-8cb7-cd9215ed1cf5`::moving from state init -> state preparing >Thread-4723::INFO::2014-09-09 12:07:52,687::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4723::DEBUG::2014-09-09 12:07:52,688::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7e5b0a77-3ea7-45c3-9e55-f1e1d0d0bd2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4723::DEBUG::2014-09-09 12:07:52,688::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4723::DEBUG::2014-09-09 12:07:52,688::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4723::DEBUG::2014-09-09 12:07:52,688::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`7e5b0a77-3ea7-45c3-9e55-f1e1d0d0bd2c`::Granted request >Thread-4723::DEBUG::2014-09-09 12:07:52,688::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ea490333-07ca-4dee-8cb7-cd9215ed1cf5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4723::DEBUG::2014-09-09 12:07:52,688::task::993::Storage.TaskManager.Task::(_decref) Task=`ea490333-07ca-4dee-8cb7-cd9215ed1cf5`::ref 1 aborting False >Thread-4723::INFO::2014-09-09 12:07:52,690::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4723::DEBUG::2014-09-09 12:07:52,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea490333-07ca-4dee-8cb7-cd9215ed1cf5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4723::DEBUG::2014-09-09 12:07:52,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea490333-07ca-4dee-8cb7-cd9215ed1cf5`::moving from state preparing -> state finished >Thread-4723::DEBUG::2014-09-09 12:07:52,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4723::DEBUG::2014-09-09 12:07:52,690::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4723::DEBUG::2014-09-09 12:07:52,690::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4723::DEBUG::2014-09-09 12:07:52,690::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4723::DEBUG::2014-09-09 12:07:52,690::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4723::DEBUG::2014-09-09 12:07:52,690::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4723::DEBUG::2014-09-09 12:07:52,691::task::993::Storage.TaskManager.Task::(_decref) Task=`ea490333-07ca-4dee-8cb7-cd9215ed1cf5`::ref 0 aborting False >Thread-4723::DEBUG::2014-09-09 12:07:52,691::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4723::DEBUG::2014-09-09 12:07:52,691::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:54,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:54,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895293 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:55,025::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:55,026::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4724::DEBUG::2014-09-09 12:07:55,027::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:07:56,004::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:56,004::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) (10090) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) (10090) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:56,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10090) Building response >Thread-19::DEBUG::2014-09-09 12:07:56,006::__init__::225::IOProcess::(_processLogs) (10090) Queuing response >Thread-3443::DEBUG::2014-09-09 12:07:56,006::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:07:56,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:56,011::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:07:56,013::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000880524 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:56,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:56,013::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:07:56,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:56,013::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:56,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:56,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:56,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:56,014::__init__::225::IOProcess::(_processLogs) (10091) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:56,014::__init__::225::IOProcess::(_processLogs) (10091) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:56,014::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10091) Building response >Thread-19::DEBUG::2014-09-09 12:07:56,015::__init__::225::IOProcess::(_processLogs) (10091) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:56,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:56,015::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:07:56,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:56,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895545 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:07:58,033::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:07:58,034::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4725::DEBUG::2014-09-09 12:07:58,035::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:07:58,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:07:58,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896023 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) (10092) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:59,054::__init__::225::IOProcess::(_processLogs) (10092) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:59,055::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10092) Building response >Thread-19::DEBUG::2014-09-09 12:07:59,055::__init__::225::IOProcess::(_processLogs) (10092) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:59,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:59,055::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:07:59,056::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:07:59,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00096797 s, 566 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:07:59,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) (10093) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) (10093) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10093) Building response >Thread-19::DEBUG::2014-09-09 12:07:59,065::__init__::225::IOProcess::(_processLogs) (10093) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:59,066::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:07:59,066::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:07:59,066::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:59,066::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) (10094) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:59,067::__init__::225::IOProcess::(_processLogs) (10094) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) (10094) Building response >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) (10094) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:59,068::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) (10095) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) (10095) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) (10095) Building response >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) (10095) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:07:59,069::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) (10096) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) (10096) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:07:59,070::__init__::225::IOProcess::(_processLogs) (10096) Building response >Thread-19::DEBUG::2014-09-09 12:07:59,071::__init__::225::IOProcess::(_processLogs) (10096) Queuing response >Thread-19::DEBUG::2014-09-09 12:07:59,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:07:59,071::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:08:00,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:01,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:01,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4726::DEBUG::2014-09-09 12:08:01,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f101f4-34b0-4960-b705-92777a44ef92`::moving from state init -> state preparing >Thread-4726::INFO::2014-09-09 12:08:01,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4726::INFO::2014-09-09 12:08:01,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106336', 'lastCheck': '9.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096797', 'lastCheck': '2.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000880524', 'lastCheck': '5.0', 'valid': True}} >Thread-4726::DEBUG::2014-09-09 12:08:01,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`58f101f4-34b0-4960-b705-92777a44ef92`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106336', 'lastCheck': '9.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096797', 'lastCheck': '2.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000880524', 'lastCheck': '5.0', 'valid': True}} >Thread-4726::DEBUG::2014-09-09 12:08:01,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f101f4-34b0-4960-b705-92777a44ef92`::moving from state preparing -> state finished >Thread-4726::DEBUG::2014-09-09 12:08:01,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4726::DEBUG::2014-09-09 12:08:01,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4726::DEBUG::2014-09-09 12:08:01,051::task::993::Storage.TaskManager.Task::(_decref) Task=`58f101f4-34b0-4960-b705-92777a44ef92`::ref 0 aborting False >Thread-4726::DEBUG::2014-09-09 12:08:01,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:01,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0923196 s, 11.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:01,059::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:01,060::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4727::DEBUG::2014-09-09 12:08:01,062::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:08:01,677::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:01,677::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:01,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:01,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:01,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:01,677::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) (10097) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) (10097) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10097) Building response >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) (10097) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:01,678::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:08:01,679::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:08:01,687::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114305 s, 982 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:01,687::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:01,687::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:01,687::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:01,687::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:01,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) (10098) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) (10098) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10098) Building response >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) (10098) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:01,688::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:08:01,689::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:02,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4728::DEBUG::2014-09-09 12:08:02,732::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:08:02,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4728::DEBUG::2014-09-09 12:08:02,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fa189f2-4e68-4714-b093-568dd43dd27b`::moving from state init -> state preparing >Thread-4728::INFO::2014-09-09 12:08:02,733::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4728::INFO::2014-09-09 12:08:02,733::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4728::DEBUG::2014-09-09 12:08:02,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fa189f2-4e68-4714-b093-568dd43dd27b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4728::DEBUG::2014-09-09 12:08:02,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fa189f2-4e68-4714-b093-568dd43dd27b`::moving from state preparing -> state finished >Thread-4728::DEBUG::2014-09-09 12:08:02,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4728::DEBUG::2014-09-09 12:08:02,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4728::DEBUG::2014-09-09 12:08:02,733::task::993::Storage.TaskManager.Task::(_decref) Task=`7fa189f2-4e68-4714-b093-568dd43dd27b`::ref 0 aborting False >Thread-4728::DEBUG::2014-09-09 12:08:02,734::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4728::DEBUG::2014-09-09 12:08:02,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:02,770::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:02,771::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4729::DEBUG::2014-09-09 12:08:02,771::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4729::DEBUG::2014-09-09 12:08:02,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aa67078-5c71-4a96-b1f7-315c1868ffdf`::moving from state init -> state preparing >Thread-4729::INFO::2014-09-09 12:08:02,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4729::DEBUG::2014-09-09 12:08:02,772::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fc12a56d-bc04-4178-a3ff-cd245bb11efb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4729::DEBUG::2014-09-09 12:08:02,772::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4729::DEBUG::2014-09-09 12:08:02,772::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4729::DEBUG::2014-09-09 12:08:02,772::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fc12a56d-bc04-4178-a3ff-cd245bb11efb`::Granted request >Thread-4729::DEBUG::2014-09-09 12:08:02,772::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0aa67078-5c71-4a96-b1f7-315c1868ffdf`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4729::DEBUG::2014-09-09 12:08:02,772::task::993::Storage.TaskManager.Task::(_decref) Task=`0aa67078-5c71-4a96-b1f7-315c1868ffdf`::ref 1 aborting False >Thread-4729::INFO::2014-09-09 12:08:02,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4729::DEBUG::2014-09-09 12:08:02,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`0aa67078-5c71-4a96-b1f7-315c1868ffdf`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4729::DEBUG::2014-09-09 12:08:02,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aa67078-5c71-4a96-b1f7-315c1868ffdf`::moving from state preparing -> state finished >Thread-4729::DEBUG::2014-09-09 12:08:02,774::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4729::DEBUG::2014-09-09 12:08:02,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4729::DEBUG::2014-09-09 12:08:02,774::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4729::DEBUG::2014-09-09 12:08:02,775::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4729::DEBUG::2014-09-09 12:08:02,775::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4729::DEBUG::2014-09-09 12:08:02,775::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4729::DEBUG::2014-09-09 12:08:02,775::task::993::Storage.TaskManager.Task::(_decref) Task=`0aa67078-5c71-4a96-b1f7-315c1868ffdf`::ref 0 aborting False >Thread-4729::DEBUG::2014-09-09 12:08:02,775::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4729::DEBUG::2014-09-09 12:08:02,775::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:03,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:03,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895445 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:04,177::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:04,177::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4730::DEBUG::2014-09-09 12:08:04,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:05,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:05,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896645 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:06,015::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:06,016::__init__::225::IOProcess::(_processLogs) (10099) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:06,017::__init__::225::IOProcess::(_processLogs) (10099) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:06,017::__init__::225::IOProcess::(_processLogs) (10099) Building response >Thread-19::DEBUG::2014-09-09 12:08:06,017::__init__::225::IOProcess::(_processLogs) (10099) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:06,017::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:08:06,018::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:08:06,018::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:08:06,025::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00096398 s, 368 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) (10100) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) (10100) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:06,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10100) Building response >Thread-19::DEBUG::2014-09-09 12:08:06,027::__init__::225::IOProcess::(_processLogs) (10100) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:06,027::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:08:06,027::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:07,186::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:07,187::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4731::DEBUG::2014-09-09 12:08:07,188::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:07,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:07,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899419 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:09,070::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) (10101) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) (10101) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10101) Building response >Thread-19::DEBUG::2014-09-09 12:08:09,071::__init__::225::IOProcess::(_processLogs) (10101) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:09,072::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:08:09,072::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:08:09,072::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:08:09,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000955086 s, 574 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) (10102) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:09,081::__init__::225::IOProcess::(_processLogs) (10102) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:09,082::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10102) Building response >Thread-19::DEBUG::2014-09-09 12:08:09,082::__init__::225::IOProcess::(_processLogs) (10102) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:09,082::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:09,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) (10103) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) (10103) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) (10103) Building response >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) (10103) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:09,084::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) (10104) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) (10104) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) (10104) Building response >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) (10104) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:09,085::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) (10105) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:09,086::__init__::225::IOProcess::(_processLogs) (10105) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:09,087::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10105) Building response >Thread-19::DEBUG::2014-09-09 12:08:09,087::__init__::225::IOProcess::(_processLogs) (10105) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:09,087::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:08:09,087::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:08:09,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:09,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896368 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:10,195::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:10,196::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4732::DEBUG::2014-09-09 12:08:10,197::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:11,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:11,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895053 s, 11.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:08:11,689::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:08:11,691::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,691::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:08:11,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) (10106) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) (10106) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:11,692::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10106) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) (10106) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) (10107) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) (10107) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Message size is 128 >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) (10108) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:11,694::__init__::225::IOProcess::(_processLogs) (10108) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:11,695::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10107) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,695::__init__::225::IOProcess::(_processLogs) (10107) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:11,695::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:08:11,695::__init__::225::IOProcess::(_processLogs) (10108) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,696::__init__::225::IOProcess::(_processLogs) (10108) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:11,697::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-23::DEBUG::2014-09-09 12:08:11,699::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:08:11,699::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,699::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 12:08:11,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,699::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,700::__init__::225::IOProcess::(_processLogs) (10109) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:08:11,700::__init__::225::IOProcess::(_processLogs) (10109) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:08:11,747::__init__::225::IOProcess::(_processLogs) DEBUG|(10109) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,747::__init__::225::IOProcess::(_processLogs) (10109) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,747::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:08:11,747::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:08:11,748::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:11,748::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,748::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 12:08:11,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,749::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,749::__init__::225::IOProcess::(_processLogs) (10110) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:08:11,749::__init__::225::IOProcess::(_processLogs) (10110) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:08:11,751::__init__::225::IOProcess::(_processLogs) DEBUG|(10110) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,751::__init__::225::IOProcess::(_processLogs) (10110) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,751::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:08:11,751::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 12:08:11,752::__init__::225::IOProcess::(_processLogs) Sending response sized 1555 >Thread-19::DEBUG::2014-09-09 12:08:11,753::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,753::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 12:08:11,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) (10111) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) (10111) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) (10111) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,754::__init__::225::IOProcess::(_processLogs) (10111) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,756::__init__::225::IOProcess::(_processLogs) (10112) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:11,756::__init__::225::IOProcess::(_processLogs) (10112) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:11,756::__init__::225::IOProcess::(_processLogs) DEBUG|(10112) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,756::__init__::225::IOProcess::(_processLogs) (10112) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,757::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:08:11,757::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:08:11,757::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-23::INFO::2014-09-09 12:08:11,757::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 12:08:11,758::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:08:11,758::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,758::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:11,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) (10113) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) (10113) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) DEBUG|(10113) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,759::__init__::225::IOProcess::(_processLogs) (10113) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,760::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:08:11,760::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:08:11,760::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:08:11,768::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110777 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:11,768::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:11,768::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) (10114) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) (10114) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) DEBUG|(10114) Building response >Thread-19::DEBUG::2014-09-09 12:08:11,769::__init__::225::IOProcess::(_processLogs) (10114) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:11,770::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:08:11,770::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:12,815::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:12,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4736::DEBUG::2014-09-09 12:08:12,815::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4736::DEBUG::2014-09-09 12:08:12,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`6259a87e-d1d2-4ddc-9747-cb8d47733539`::moving from state init -> state preparing >Thread-4736::INFO::2014-09-09 12:08:12,817::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4736::INFO::2014-09-09 12:08:12,817::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4736::DEBUG::2014-09-09 12:08:12,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`6259a87e-d1d2-4ddc-9747-cb8d47733539`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4736::DEBUG::2014-09-09 12:08:12,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`6259a87e-d1d2-4ddc-9747-cb8d47733539`::moving from state preparing -> state finished >Thread-4736::DEBUG::2014-09-09 12:08:12,817::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4736::DEBUG::2014-09-09 12:08:12,817::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4736::DEBUG::2014-09-09 12:08:12,817::task::993::Storage.TaskManager.Task::(_decref) Task=`6259a87e-d1d2-4ddc-9747-cb8d47733539`::ref 0 aborting False >Thread-4736::DEBUG::2014-09-09 12:08:12,818::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4736::DEBUG::2014-09-09 12:08:12,818::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:12,854::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:12,855::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4737::DEBUG::2014-09-09 12:08:12,855::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4737::DEBUG::2014-09-09 12:08:12,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`1787c306-54ca-471c-b251-0103a7084156`::moving from state init -> state preparing >Thread-4737::INFO::2014-09-09 12:08:12,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4737::DEBUG::2014-09-09 12:08:12,856::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8bec5944-c7fc-4754-802b-4c67186ceb5a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4737::DEBUG::2014-09-09 12:08:12,856::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4737::DEBUG::2014-09-09 12:08:12,856::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4737::DEBUG::2014-09-09 12:08:12,856::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8bec5944-c7fc-4754-802b-4c67186ceb5a`::Granted request >Thread-4737::DEBUG::2014-09-09 12:08:12,856::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1787c306-54ca-471c-b251-0103a7084156`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4737::DEBUG::2014-09-09 12:08:12,857::task::993::Storage.TaskManager.Task::(_decref) Task=`1787c306-54ca-471c-b251-0103a7084156`::ref 1 aborting False >Thread-4737::INFO::2014-09-09 12:08:12,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4737::DEBUG::2014-09-09 12:08:12,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`1787c306-54ca-471c-b251-0103a7084156`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4737::DEBUG::2014-09-09 12:08:12,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`1787c306-54ca-471c-b251-0103a7084156`::moving from state preparing -> state finished >Thread-4737::DEBUG::2014-09-09 12:08:12,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4737::DEBUG::2014-09-09 12:08:12,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4737::DEBUG::2014-09-09 12:08:12,859::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4737::DEBUG::2014-09-09 12:08:12,859::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4737::DEBUG::2014-09-09 12:08:12,859::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4737::DEBUG::2014-09-09 12:08:12,859::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4737::DEBUG::2014-09-09 12:08:12,859::task::993::Storage.TaskManager.Task::(_decref) Task=`1787c306-54ca-471c-b251-0103a7084156`::ref 0 aborting False >Thread-4737::DEBUG::2014-09-09 12:08:12,859::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4737::DEBUG::2014-09-09 12:08:12,859::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:13,204::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:13,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4738::DEBUG::2014-09-09 12:08:13,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:13,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:13,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896036 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:08:15,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:15,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895436 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:16,028::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) (10115) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:16,029::__init__::225::IOProcess::(_processLogs) (10115) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:16,030::__init__::225::IOProcess::(_processLogs) DEBUG|(10115) Building response >Thread-3443::DEBUG::2014-09-09 12:08:16,030::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:08:16,030::__init__::225::IOProcess::(_processLogs) (10115) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:16,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:16,035::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:08:16,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000712421 s, 498 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:16,038::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:16,038::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:16,038::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:16,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:16,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:16,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) (10116) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) (10116) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) DEBUG|(10116) Building response >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) (10116) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:16,039::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:16,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:16,211::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4739::DEBUG::2014-09-09 12:08:16,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`379f4eff-80f2-4de1-8733-ac4543741fac`::moving from state init -> state preparing >Thread-4739::INFO::2014-09-09 12:08:16,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4739::INFO::2014-09-09 12:08:16,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110777', 'lastCheck': '4.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955086', 'lastCheck': '7.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712421', 'lastCheck': '0.2', 'valid': True}} >Thread-4739::DEBUG::2014-09-09 12:08:16,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`379f4eff-80f2-4de1-8733-ac4543741fac`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110777', 'lastCheck': '4.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000955086', 'lastCheck': '7.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712421', 'lastCheck': '0.2', 'valid': True}} >Thread-4739::DEBUG::2014-09-09 12:08:16,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`379f4eff-80f2-4de1-8733-ac4543741fac`::moving from state preparing -> state finished >Thread-4739::DEBUG::2014-09-09 12:08:16,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4739::DEBUG::2014-09-09 12:08:16,213::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4739::DEBUG::2014-09-09 12:08:16,213::task::993::Storage.TaskManager.Task::(_decref) Task=`379f4eff-80f2-4de1-8733-ac4543741fac`::ref 0 aborting False >Thread-4739::DEBUG::2014-09-09 12:08:16,214::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:16,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:16,223::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4740::DEBUG::2014-09-09 12:08:16,223::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:17,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:17,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895566 s, 11.4 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:08:19,087::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:08:19,089::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) (10117) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:19,090::__init__::225::IOProcess::(_processLogs) (10117) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:19,091::__init__::225::IOProcess::(_processLogs) DEBUG|(10117) Building response >Thread-19::DEBUG::2014-09-09 12:08:19,091::__init__::225::IOProcess::(_processLogs) (10117) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:19,091::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) (10118) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) (10118) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:19,092::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) (10119) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) (10119) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:19,093::__init__::225::IOProcess::(_processLogs) (10119) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:19,094::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:08:19,094::__init__::225::IOProcess::(_processLogs) (10118) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:19,095::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-24::DEBUG::2014-09-09 12:08:19,097::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:08:19,097::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 12:08:19,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,098::__init__::225::IOProcess::(_processLogs) (10120) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:08:19,098::__init__::225::IOProcess::(_processLogs) (10120) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:08:19,125::__init__::225::IOProcess::(_processLogs) (10120) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,125::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-24::DEBUG::2014-09-09 12:08:19,125::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:08:19,126::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 12:08:19,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,126::__init__::225::IOProcess::(_processLogs) (10121) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:08:19,127::__init__::225::IOProcess::(_processLogs) (10121) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:08:19,130::__init__::225::IOProcess::(_processLogs) (10121) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,130::__init__::225::IOProcess::(_processLogs) Sending response sized 787 >Thread-24::DEBUG::2014-09-09 12:08:19,130::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) (10122) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:19,131::__init__::225::IOProcess::(_processLogs) (10122) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:19,132::__init__::225::IOProcess::(_processLogs) (10122) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,132::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:19,132::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:08:19,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,133::__init__::225::IOProcess::(_processLogs) (10123) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:19,133::__init__::225::IOProcess::(_processLogs) (10123) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:19,134::__init__::225::IOProcess::(_processLogs) (10123) Queuing response >Thread-24::DEBUG::2014-09-09 12:08:19,134::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:08:19,134::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-24::INFO::2014-09-09 12:08:19,134::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-24::INFO::2014-09-09 12:08:19,135::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) (10124) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:19,135::__init__::225::IOProcess::(_processLogs) (10124) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:19,136::__init__::225::IOProcess::(_processLogs) (10124) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,136::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:08:19,137::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:08:19,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000922034 s, 594 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) (10125) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:19,145::__init__::225::IOProcess::(_processLogs) (10125) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:19,146::__init__::225::IOProcess::(_processLogs) (10125) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,146::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:08:19,146::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:08:19,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) (10126) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) (10126) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) (10126) Building response >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) (10126) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,148::__init__::225::IOProcess::(_processLogs) (10127) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) (10127) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) (10127) Building response >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) (10127) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:19,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) (10128) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) (10128) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) (10128) Building response >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) (10128) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:19,150::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:19,434::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:19,436::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4744::DEBUG::2014-09-09 12:08:19,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:19,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:20,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0939891 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:21,771::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:21,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:21,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:21,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:21,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:21,771::__init__::225::IOProcess::(_processLogs) (10129) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:21,772::__init__::225::IOProcess::(_processLogs) (10129) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:21,772::__init__::225::IOProcess::(_processLogs) (10129) Queuing response >Thread-23::DEBUG::2014-09-09 12:08:21,772::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:08:21,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:21,778::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:08:21,780::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111197 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:21,780::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:21,780::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:21,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:21,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:21,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:21,781::__init__::225::IOProcess::(_processLogs) (10130) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:21,781::__init__::225::IOProcess::(_processLogs) (10130) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:21,781::__init__::225::IOProcess::(_processLogs) (10130) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:21,781::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:08:22,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:22,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089542 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:22,447::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:22,448::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4745::DEBUG::2014-09-09 12:08:22,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:22,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:22,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4746::DEBUG::2014-09-09 12:08:22,898::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4746::DEBUG::2014-09-09 12:08:22,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e4e7451-fdd1-44b5-861d-1b07e961675e`::moving from state init -> state preparing >Thread-4746::INFO::2014-09-09 12:08:22,899::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4746::INFO::2014-09-09 12:08:22,899::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4746::DEBUG::2014-09-09 12:08:22,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e4e7451-fdd1-44b5-861d-1b07e961675e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4746::DEBUG::2014-09-09 12:08:22,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e4e7451-fdd1-44b5-861d-1b07e961675e`::moving from state preparing -> state finished >Thread-4746::DEBUG::2014-09-09 12:08:22,899::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4746::DEBUG::2014-09-09 12:08:22,899::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4746::DEBUG::2014-09-09 12:08:22,899::task::993::Storage.TaskManager.Task::(_decref) Task=`5e4e7451-fdd1-44b5-861d-1b07e961675e`::ref 0 aborting False >Thread-4746::DEBUG::2014-09-09 12:08:22,899::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4746::DEBUG::2014-09-09 12:08:22,900::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:22,938::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:22,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4747::DEBUG::2014-09-09 12:08:22,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4747::DEBUG::2014-09-09 12:08:22,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3654c19-49a4-409d-b341-9cdda5acc0ce`::moving from state init -> state preparing >Thread-4747::INFO::2014-09-09 12:08:22,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4747::DEBUG::2014-09-09 12:08:22,940::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0a164a77-7cc1-40b1-966c-98fc48d8ee94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4747::DEBUG::2014-09-09 12:08:22,940::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4747::DEBUG::2014-09-09 12:08:22,940::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4747::DEBUG::2014-09-09 12:08:22,940::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0a164a77-7cc1-40b1-966c-98fc48d8ee94`::Granted request >Thread-4747::DEBUG::2014-09-09 12:08:22,940::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f3654c19-49a4-409d-b341-9cdda5acc0ce`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4747::DEBUG::2014-09-09 12:08:22,940::task::993::Storage.TaskManager.Task::(_decref) Task=`f3654c19-49a4-409d-b341-9cdda5acc0ce`::ref 1 aborting False >Thread-4747::INFO::2014-09-09 12:08:22,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4747::DEBUG::2014-09-09 12:08:22,942::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3654c19-49a4-409d-b341-9cdda5acc0ce`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4747::DEBUG::2014-09-09 12:08:22,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3654c19-49a4-409d-b341-9cdda5acc0ce`::moving from state preparing -> state finished >Thread-4747::DEBUG::2014-09-09 12:08:22,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4747::DEBUG::2014-09-09 12:08:22,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4747::DEBUG::2014-09-09 12:08:22,942::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4747::DEBUG::2014-09-09 12:08:22,943::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4747::DEBUG::2014-09-09 12:08:22,943::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4747::DEBUG::2014-09-09 12:08:22,943::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4747::DEBUG::2014-09-09 12:08:22,943::task::993::Storage.TaskManager.Task::(_decref) Task=`f3654c19-49a4-409d-b341-9cdda5acc0ce`::ref 0 aborting False >Thread-4747::DEBUG::2014-09-09 12:08:22,943::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283543339008', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4747::DEBUG::2014-09-09 12:08:22,943::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:24,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:24,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896071 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:25,457::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:25,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4748::DEBUG::2014-09-09 12:08:25,459::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-3443::DEBUG::2014-09-09 12:08:26,040::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:08:26,042::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:08:26,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,042::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:26,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,043::__init__::225::IOProcess::(_processLogs) (10131) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:26,043::__init__::225::IOProcess::(_processLogs) (10131) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:26,043::__init__::225::IOProcess::(_processLogs) (10131) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:26,044::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:08:26,045::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:08:26,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,047::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:26,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-3443::DEBUG::2014-09-09 12:08:26,053::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:08:26,054::__init__::225::IOProcess::(_processLogs) (10132) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:26,055::__init__::225::IOProcess::(_processLogs) (10132) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:26,055::__init__::225::IOProcess::(_processLogs) (10132) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,057::__init__::225::IOProcess::(_processLogs) (10133) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:26,057::__init__::225::IOProcess::(_processLogs) (10133) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:26,057::__init__::225::IOProcess::(_processLogs) (10133) Building response >Thread-19::DEBUG::2014-09-09 12:08:26,057::__init__::225::IOProcess::(_processLogs) (10133) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) Message size is 159 >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) (10134) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:08:26,058::__init__::225::IOProcess::(_processLogs) (10134) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:08:26,135::__init__::225::IOProcess::(_processLogs) (10134) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,135::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-3443::DEBUG::2014-09-09 12:08:26,136::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:08:26,136::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 12:08:26,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,136::__init__::225::IOProcess::(_processLogs) (10135) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:08:26,137::__init__::225::IOProcess::(_processLogs) (10135) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:08:26,138::__init__::225::IOProcess::(_processLogs) (10135) Queuing response >Thread-3443::DEBUG::2014-09-09 12:08:26,139::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 12:08:26,139::__init__::225::IOProcess::(_processLogs) Sending response sized 531 >Thread-19::DEBUG::2014-09-09 12:08:26,140::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-19::DEBUG::2014-09-09 12:08:26,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:26,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,140::__init__::225::IOProcess::(_processLogs) (10136) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) (10136) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) (10136) Building response >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) (10136) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,141::__init__::225::IOProcess::(_processLogs) (10137) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:08:26,142::__init__::225::IOProcess::(_processLogs) (10137) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:08:26,148::__init__::225::IOProcess::(_processLogs) (10137) Queuing response >Thread-3443::DEBUG::2014-09-09 12:08:26,148::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:08:26,148::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-3443::INFO::2014-09-09 12:08:26,148::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-3443::INFO::2014-09-09 12:08:26,148::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) (10138) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) (10138) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:26,149::__init__::225::IOProcess::(_processLogs) (10138) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,150::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:08:26,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:08:26,157::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000771859 s, 460 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:26,157::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:26,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:26,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:26,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:26,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:26,158::__init__::225::IOProcess::(_processLogs) (10139) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:26,158::__init__::225::IOProcess::(_processLogs) (10139) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:26,158::__init__::225::IOProcess::(_processLogs) (10139) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:26,158::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:08:26,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:26,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896086 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:08:28,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:28,472::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:28,473::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4752::DEBUG::2014-09-09 12:08:28,474::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:28,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895711 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:29,150::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:29,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:29,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:29,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:29,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:29,151::__init__::225::IOProcess::(_processLogs) (10140) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:29,151::__init__::225::IOProcess::(_processLogs) (10140) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:29,151::__init__::225::IOProcess::(_processLogs) (10140) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:29,151::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:08:29,152::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:08:29,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101488 s, 540 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) (10141) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:29,160::__init__::225::IOProcess::(_processLogs) (10141) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:29,161::__init__::225::IOProcess::(_processLogs) (10141) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:29,161::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:08:29,161::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) (10142) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) (10142) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) (10142) Building response >Thread-19::DEBUG::2014-09-09 12:08:29,162::__init__::225::IOProcess::(_processLogs) (10142) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:29,163::__init__::225::IOProcess::(_processLogs) (10143) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) (10143) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) (10143) Building response >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) (10143) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:08:29,164::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) (10144) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) (10144) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) (10144) Building response >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) (10144) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:29,165::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:08:30,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:30,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896819 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:31,480::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:31,481::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4753::DEBUG::2014-09-09 12:08:31,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bc88b21-d4b8-4c22-a777-f8b1c69d926f`::moving from state init -> state preparing >Thread-4753::INFO::2014-09-09 12:08:31,482::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4753::INFO::2014-09-09 12:08:31,482::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111197', 'lastCheck': '9.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101488', 'lastCheck': '2.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000771859', 'lastCheck': '5.3', 'valid': True}} >Thread-4753::DEBUG::2014-09-09 12:08:31,482::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bc88b21-d4b8-4c22-a777-f8b1c69d926f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111197', 'lastCheck': '9.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101488', 'lastCheck': '2.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000771859', 'lastCheck': '5.3', 'valid': True}} >Thread-4753::DEBUG::2014-09-09 12:08:31,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bc88b21-d4b8-4c22-a777-f8b1c69d926f`::moving from state preparing -> state finished >Thread-4753::DEBUG::2014-09-09 12:08:31,482::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4753::DEBUG::2014-09-09 12:08:31,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4753::DEBUG::2014-09-09 12:08:31,483::task::993::Storage.TaskManager.Task::(_decref) Task=`5bc88b21-d4b8-4c22-a777-f8b1c69d926f`::ref 0 aborting False >Thread-4753::DEBUG::2014-09-09 12:08:31,483::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:31,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:31,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4754::DEBUG::2014-09-09 12:08:31,492::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:08:31,782::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:31,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) (10145) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) (10145) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) (10145) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:31,783::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:08:31,784::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:08:31,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113419 s, 990 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:31,791::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:31,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:31,791::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:31,791::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:31,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:31,792::__init__::225::IOProcess::(_processLogs) (10146) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:31,792::__init__::225::IOProcess::(_processLogs) (10146) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:31,792::__init__::225::IOProcess::(_processLogs) (10146) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:31,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:31,792::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:08:32,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:32,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895762 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:32,997::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4755::DEBUG::2014-09-09 12:08:32,998::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:08:32,998::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4755::DEBUG::2014-09-09 12:08:32,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`d65c2a04-527e-4c7c-83e4-f46b381216f2`::moving from state init -> state preparing >Thread-4755::INFO::2014-09-09 12:08:32,999::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4755::INFO::2014-09-09 12:08:33,000::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4755::DEBUG::2014-09-09 12:08:33,001::task::1191::Storage.TaskManager.Task::(prepare) Task=`d65c2a04-527e-4c7c-83e4-f46b381216f2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4755::DEBUG::2014-09-09 12:08:33,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`d65c2a04-527e-4c7c-83e4-f46b381216f2`::moving from state preparing -> state finished >Thread-4755::DEBUG::2014-09-09 12:08:33,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4755::DEBUG::2014-09-09 12:08:33,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4755::DEBUG::2014-09-09 12:08:33,001::task::993::Storage.TaskManager.Task::(_decref) Task=`d65c2a04-527e-4c7c-83e4-f46b381216f2`::ref 0 aborting False >Thread-4755::DEBUG::2014-09-09 12:08:33,001::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4755::DEBUG::2014-09-09 12:08:33,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:33,014::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:33,014::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4756::DEBUG::2014-09-09 12:08:33,014::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4756::DEBUG::2014-09-09 12:08:33,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`97b5a7e2-047b-4fc4-94c7-d877f90d245d`::moving from state init -> state preparing >Thread-4756::INFO::2014-09-09 12:08:33,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4756::DEBUG::2014-09-09 12:08:33,016::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a4baff29-84d7-450c-ad70-5725655a3454`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4756::DEBUG::2014-09-09 12:08:33,016::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4756::DEBUG::2014-09-09 12:08:33,016::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4756::DEBUG::2014-09-09 12:08:33,016::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a4baff29-84d7-450c-ad70-5725655a3454`::Granted request >Thread-4756::DEBUG::2014-09-09 12:08:33,016::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`97b5a7e2-047b-4fc4-94c7-d877f90d245d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4756::DEBUG::2014-09-09 12:08:33,016::task::993::Storage.TaskManager.Task::(_decref) Task=`97b5a7e2-047b-4fc4-94c7-d877f90d245d`::ref 1 aborting False >Thread-4756::INFO::2014-09-09 12:08:33,018::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4756::DEBUG::2014-09-09 12:08:33,018::task::1191::Storage.TaskManager.Task::(prepare) Task=`97b5a7e2-047b-4fc4-94c7-d877f90d245d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4756::DEBUG::2014-09-09 12:08:33,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`97b5a7e2-047b-4fc4-94c7-d877f90d245d`::moving from state preparing -> state finished >Thread-4756::DEBUG::2014-09-09 12:08:33,018::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4756::DEBUG::2014-09-09 12:08:33,018::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4756::DEBUG::2014-09-09 12:08:33,018::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4756::DEBUG::2014-09-09 12:08:33,019::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4756::DEBUG::2014-09-09 12:08:33,019::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4756::DEBUG::2014-09-09 12:08:33,019::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4756::DEBUG::2014-09-09 12:08:33,019::task::993::Storage.TaskManager.Task::(_decref) Task=`97b5a7e2-047b-4fc4-94c7-d877f90d245d`::ref 0 aborting False >Thread-4756::DEBUG::2014-09-09 12:08:33,019::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4756::DEBUG::2014-09-09 12:08:33,019::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:34,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:34,697::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4757::DEBUG::2014-09-09 12:08:34,698::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:34,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:34,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089493 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) (10147) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:36,160::__init__::225::IOProcess::(_processLogs) (10147) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:36,162::__init__::225::IOProcess::(_processLogs) (10147) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:36,162::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:08:36,162::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:08:36,169::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000765893 s, 464 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:36,170::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:36,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:36,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:36,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:36,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:36,170::__init__::225::IOProcess::(_processLogs) (10148) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:36,171::__init__::225::IOProcess::(_processLogs) (10148) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:36,171::__init__::225::IOProcess::(_processLogs) (10148) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:36,171::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:08:36,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:36,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894364 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:37,703::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:37,704::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4758::DEBUG::2014-09-09 12:08:37,705::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:38,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:39,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895031 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:39,165::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:39,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:39,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:39,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:39,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:39,165::__init__::225::IOProcess::(_processLogs) (10149) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:39,166::__init__::225::IOProcess::(_processLogs) (10149) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:39,166::__init__::225::IOProcess::(_processLogs) (10149) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:39,166::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:08:39,167::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:08:39,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000953687 s, 575 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) (10150) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) (10150) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:39,175::__init__::225::IOProcess::(_processLogs) (10150) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:39,176::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:08:39,176::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:08:39,176::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) (10151) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) (10151) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) (10151) Building response >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) (10151) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:39,177::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) (10152) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) (10152) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) (10152) Building response >Thread-19::DEBUG::2014-09-09 12:08:39,178::__init__::225::IOProcess::(_processLogs) (10152) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:39,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:39,179::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:39,179::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:08:39,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:39,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:39,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) (10153) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) (10153) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) (10153) Building response >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) (10153) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:39,180::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:40,709::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:40,710::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4759::DEBUG::2014-09-09 12:08:40,711::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:41,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:41,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895779 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:41,793::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:41,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:41,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:41,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:41,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:41,793::__init__::225::IOProcess::(_processLogs) (10154) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:41,794::__init__::225::IOProcess::(_processLogs) (10154) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:41,795::__init__::225::IOProcess::(_processLogs) (10154) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:41,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:08:41,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:08:41,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011864 s, 947 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:41,803::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) (10155) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) (10155) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:41,804::__init__::225::IOProcess::(_processLogs) (10155) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:41,805::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:43,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4760::DEBUG::2014-09-09 12:08:43,061::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:08:43,061::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4760::DEBUG::2014-09-09 12:08:43,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cd24b1c-c4f2-43d3-ba58-2cc5b36fc984`::moving from state init -> state preparing >Thread-4760::INFO::2014-09-09 12:08:43,062::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4760::INFO::2014-09-09 12:08:43,062::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4760::DEBUG::2014-09-09 12:08:43,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cd24b1c-c4f2-43d3-ba58-2cc5b36fc984`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4760::DEBUG::2014-09-09 12:08:43,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cd24b1c-c4f2-43d3-ba58-2cc5b36fc984`::moving from state preparing -> state finished >Thread-4760::DEBUG::2014-09-09 12:08:43,063::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4760::DEBUG::2014-09-09 12:08:43,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4760::DEBUG::2014-09-09 12:08:43,063::task::993::Storage.TaskManager.Task::(_decref) Task=`5cd24b1c-c4f2-43d3-ba58-2cc5b36fc984`::ref 0 aborting False >Thread-4760::DEBUG::2014-09-09 12:08:43,063::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4760::DEBUG::2014-09-09 12:08:43,063::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:43,090::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4761::DEBUG::2014-09-09 12:08:43,091::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:08:43,091::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4761::DEBUG::2014-09-09 12:08:43,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`ceb1aae1-478b-4146-9fbb-b2f5d62bb6dd`::moving from state init -> state preparing >Thread-4761::INFO::2014-09-09 12:08:43,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4761::DEBUG::2014-09-09 12:08:43,092::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fadd0477-ce1b-40d0-8e3b-6d23a04648bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4761::DEBUG::2014-09-09 12:08:43,092::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4761::DEBUG::2014-09-09 12:08:43,092::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4761::DEBUG::2014-09-09 12:08:43,092::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fadd0477-ce1b-40d0-8e3b-6d23a04648bb`::Granted request >Thread-4761::DEBUG::2014-09-09 12:08:43,092::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ceb1aae1-478b-4146-9fbb-b2f5d62bb6dd`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4761::DEBUG::2014-09-09 12:08:43,092::task::993::Storage.TaskManager.Task::(_decref) Task=`ceb1aae1-478b-4146-9fbb-b2f5d62bb6dd`::ref 1 aborting False >Thread-4761::INFO::2014-09-09 12:08:43,094::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4761::DEBUG::2014-09-09 12:08:43,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`ceb1aae1-478b-4146-9fbb-b2f5d62bb6dd`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4761::DEBUG::2014-09-09 12:08:43,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`ceb1aae1-478b-4146-9fbb-b2f5d62bb6dd`::moving from state preparing -> state finished >Thread-4761::DEBUG::2014-09-09 12:08:43,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4761::DEBUG::2014-09-09 12:08:43,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4761::DEBUG::2014-09-09 12:08:43,095::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4761::DEBUG::2014-09-09 12:08:43,095::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4761::DEBUG::2014-09-09 12:08:43,095::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4761::DEBUG::2014-09-09 12:08:43,095::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4761::DEBUG::2014-09-09 12:08:43,095::task::993::Storage.TaskManager.Task::(_decref) Task=`ceb1aae1-478b-4146-9fbb-b2f5d62bb6dd`::ref 0 aborting False >Thread-4761::DEBUG::2014-09-09 12:08:43,095::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4761::DEBUG::2014-09-09 12:08:43,095::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:43,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:43,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896359 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:43,718::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:43,719::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4762::DEBUG::2014-09-09 12:08:43,720::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:45,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:45,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896206 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:46,172::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:46,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:46,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:46,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:46,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:46,172::__init__::225::IOProcess::(_processLogs) (10156) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:46,173::__init__::225::IOProcess::(_processLogs) (10156) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:46,173::__init__::225::IOProcess::(_processLogs) (10156) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:46,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:08:46,173::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:08:46,180::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000989911 s, 359 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:46,180::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) (10157) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) (10157) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:46,181::__init__::225::IOProcess::(_processLogs) DEBUG|(10157) Building response >Thread-19::DEBUG::2014-09-09 12:08:46,182::__init__::225::IOProcess::(_processLogs) (10157) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:46,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:46,182::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:46,729::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:46,730::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4763::DEBUG::2014-09-09 12:08:46,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2880cf6-684a-41e6-a773-270ce7e61f6f`::moving from state init -> state preparing >Thread-4763::INFO::2014-09-09 12:08:46,731::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4763::INFO::2014-09-09 12:08:46,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011864', 'lastCheck': '4.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000953687', 'lastCheck': '7.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989911', 'lastCheck': '0.5', 'valid': True}} >Thread-4763::DEBUG::2014-09-09 12:08:46,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2880cf6-684a-41e6-a773-270ce7e61f6f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011864', 'lastCheck': '4.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000953687', 'lastCheck': '7.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989911', 'lastCheck': '0.5', 'valid': True}} >Thread-4763::DEBUG::2014-09-09 12:08:46,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2880cf6-684a-41e6-a773-270ce7e61f6f`::moving from state preparing -> state finished >Thread-4763::DEBUG::2014-09-09 12:08:46,732::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4763::DEBUG::2014-09-09 12:08:46,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4763::DEBUG::2014-09-09 12:08:46,732::task::993::Storage.TaskManager.Task::(_decref) Task=`c2880cf6-684a-41e6-a773-270ce7e61f6f`::ref 0 aborting False >Thread-4763::DEBUG::2014-09-09 12:08:46,733::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:46,741::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:46,742::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4764::DEBUG::2014-09-09 12:08:46,742::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:47,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:47,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896823 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:49,180::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:49,180::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:49,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:49,180::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:49,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:49,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:49,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:49,181::__init__::225::IOProcess::(_processLogs) (10158) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:49,181::__init__::225::IOProcess::(_processLogs) (10158) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:49,182::__init__::225::IOProcess::(_processLogs) DEBUG|(10158) Building response >Thread-19::DEBUG::2014-09-09 12:08:49,182::__init__::225::IOProcess::(_processLogs) (10158) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:49,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:49,182::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:08:49,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:08:49,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000986665 s, 555 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:49,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:49,192::__init__::225::IOProcess::(_processLogs) (10159) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:49,192::__init__::225::IOProcess::(_processLogs) (10159) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:49,192::__init__::225::IOProcess::(_processLogs) DEBUG|(10159) Building response >Thread-19::DEBUG::2014-09-09 12:08:49,192::__init__::225::IOProcess::(_processLogs) (10159) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:49,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) (10160) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:49,193::__init__::225::IOProcess::(_processLogs) (10160) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) DEBUG|(10160) Building response >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) (10160) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) (10160) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:49,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) (10160) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) (10161) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) (10161) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) (10160) Queuing responseDEBUG|(10161) Building response >Thread-19::DEBUG::2014-09-09 12:08:49,195::__init__::225::IOProcess::(_processLogs) (10161) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:49,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:49,196::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:49,196::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:08:49,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:49,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) (10162) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) (10162) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) (10162) Building response >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) (10162) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:49,197::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:08:49,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:49,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0935528 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:49,857::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:49,859::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4765::DEBUG::2014-09-09 12:08:49,862::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:51,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:51,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897578 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:51,805::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) (10163) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) (10163) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:51,806::__init__::225::IOProcess::(_processLogs) (10163) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:51,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:08:51,807::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:08:51,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00124274 s, 904 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) (10164) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:51,815::__init__::225::IOProcess::(_processLogs) (10164) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:51,816::__init__::225::IOProcess::(_processLogs) (10164) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:51,816::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:52,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:52,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4766::DEBUG::2014-09-09 12:08:52,875::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:53,134::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:53,134::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4767::DEBUG::2014-09-09 12:08:53,134::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4767::DEBUG::2014-09-09 12:08:53,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c6fc5c1-bf8c-4593-bee8-44426385d825`::moving from state init -> state preparing >Thread-4767::INFO::2014-09-09 12:08:53,135::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4767::INFO::2014-09-09 12:08:53,136::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4767::DEBUG::2014-09-09 12:08:53,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c6fc5c1-bf8c-4593-bee8-44426385d825`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4767::DEBUG::2014-09-09 12:08:53,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c6fc5c1-bf8c-4593-bee8-44426385d825`::moving from state preparing -> state finished >Thread-4767::DEBUG::2014-09-09 12:08:53,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4767::DEBUG::2014-09-09 12:08:53,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4767::DEBUG::2014-09-09 12:08:53,136::task::993::Storage.TaskManager.Task::(_decref) Task=`6c6fc5c1-bf8c-4593-bee8-44426385d825`::ref 0 aborting False >Thread-4767::DEBUG::2014-09-09 12:08:53,136::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4767::DEBUG::2014-09-09 12:08:53,136::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:53,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:53,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4768::DEBUG::2014-09-09 12:08:53,184::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4768::DEBUG::2014-09-09 12:08:53,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`edc3c7a9-5ed3-4bed-8686-90c21d6d9919`::moving from state init -> state preparing >Thread-4768::INFO::2014-09-09 12:08:53,184::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4768::DEBUG::2014-09-09 12:08:53,185::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`846cf2e2-5b00-4f68-9ed1-13816e0e552f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4768::DEBUG::2014-09-09 12:08:53,185::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4768::DEBUG::2014-09-09 12:08:53,185::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4768::DEBUG::2014-09-09 12:08:53,185::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`846cf2e2-5b00-4f68-9ed1-13816e0e552f`::Granted request >Thread-4768::DEBUG::2014-09-09 12:08:53,185::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`edc3c7a9-5ed3-4bed-8686-90c21d6d9919`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4768::DEBUG::2014-09-09 12:08:53,185::task::993::Storage.TaskManager.Task::(_decref) Task=`edc3c7a9-5ed3-4bed-8686-90c21d6d9919`::ref 1 aborting False >Thread-4768::INFO::2014-09-09 12:08:53,187::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4768::DEBUG::2014-09-09 12:08:53,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`edc3c7a9-5ed3-4bed-8686-90c21d6d9919`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4768::DEBUG::2014-09-09 12:08:53,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`edc3c7a9-5ed3-4bed-8686-90c21d6d9919`::moving from state preparing -> state finished >Thread-4768::DEBUG::2014-09-09 12:08:53,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4768::DEBUG::2014-09-09 12:08:53,187::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4768::DEBUG::2014-09-09 12:08:53,187::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4768::DEBUG::2014-09-09 12:08:53,188::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4768::DEBUG::2014-09-09 12:08:53,188::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4768::DEBUG::2014-09-09 12:08:53,188::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4768::DEBUG::2014-09-09 12:08:53,188::task::993::Storage.TaskManager.Task::(_decref) Task=`edc3c7a9-5ed3-4bed-8686-90c21d6d9919`::ref 0 aborting False >Thread-4768::DEBUG::2014-09-09 12:08:53,188::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4768::DEBUG::2014-09-09 12:08:53,188::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:53,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:53,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897764 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:08:55,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:55,892::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:55,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4769::DEBUG::2014-09-09 12:08:55,895::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:08:55,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896311 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:56,183::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:56,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:56,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:56,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:56,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:56,184::__init__::225::IOProcess::(_processLogs) (10165) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:56,184::__init__::225::IOProcess::(_processLogs) (10165) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:56,184::__init__::225::IOProcess::(_processLogs) (10165) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:56,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:08:56,184::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:08:56,191::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00102265 s, 347 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:56,191::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) (10166) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) (10166) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:56,192::__init__::225::IOProcess::(_processLogs) (10166) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:56,193::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:08:57,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:08:58,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895113 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:08:58,905::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:08:58,906::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4770::DEBUG::2014-09-09 12:08:58,907::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:08:59,197::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:59,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:59,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:59,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:59,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:59,197::__init__::225::IOProcess::(_processLogs) (10167) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:59,198::__init__::225::IOProcess::(_processLogs) (10167) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:59,198::__init__::225::IOProcess::(_processLogs) (10167) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:59,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:08:59,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:08:59,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00103242 s, 531 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:08:59,207::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:08:59,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:59,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:08:59,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:59,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:59,208::__init__::225::IOProcess::(_processLogs) (10168) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:08:59,208::__init__::225::IOProcess::(_processLogs) (10168) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:08:59,208::__init__::225::IOProcess::(_processLogs) (10168) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:59,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:59,209::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:08:59,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:59,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:59,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:59,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) (10169) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) (10169) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) (10169) Building response >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) (10169) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:59,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) (10170) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) (10170) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) (10170) Building response >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) (10170) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:08:59,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:08:59,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:08:59,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:08:59,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:08:59,212::__init__::225::IOProcess::(_processLogs) (10171) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:08:59,212::__init__::225::IOProcess::(_processLogs) (10171) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:08:59,212::__init__::225::IOProcess::(_processLogs) (10171) Building response >Thread-19::DEBUG::2014-09-09 12:08:59,213::__init__::225::IOProcess::(_processLogs) (10171) Queuing response >Thread-19::DEBUG::2014-09-09 12:08:59,213::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:08:59,213::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:09:00,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:00,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894426 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) (10172) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:01,817::__init__::225::IOProcess::(_processLogs) (10172) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:01,818::__init__::225::IOProcess::(_processLogs) (10172) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:01,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:09:01,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:09:01,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00120714 s, 930 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:01,827::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:01,827::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:01,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:01,828::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:01,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:01,828::__init__::225::IOProcess::(_processLogs) (10173) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:01,828::__init__::225::IOProcess::(_processLogs) (10173) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:01,828::__init__::225::IOProcess::(_processLogs) (10173) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:01,828::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:01,916::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:01,916::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4771::DEBUG::2014-09-09 12:09:01,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`0746f67d-15a9-4dc5-bd80-ac5311033b85`::moving from state init -> state preparing >Thread-4771::INFO::2014-09-09 12:09:01,918::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4771::INFO::2014-09-09 12:09:01,918::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120714', 'lastCheck': '0.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103242', 'lastCheck': '2.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102265', 'lastCheck': '5.7', 'valid': True}} >Thread-4771::DEBUG::2014-09-09 12:09:01,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`0746f67d-15a9-4dc5-bd80-ac5311033b85`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120714', 'lastCheck': '0.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103242', 'lastCheck': '2.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102265', 'lastCheck': '5.7', 'valid': True}} >Thread-4771::DEBUG::2014-09-09 12:09:01,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`0746f67d-15a9-4dc5-bd80-ac5311033b85`::moving from state preparing -> state finished >Thread-4771::DEBUG::2014-09-09 12:09:01,918::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4771::DEBUG::2014-09-09 12:09:01,918::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4771::DEBUG::2014-09-09 12:09:01,918::task::993::Storage.TaskManager.Task::(_decref) Task=`0746f67d-15a9-4dc5-bd80-ac5311033b85`::ref 0 aborting False >Thread-4771::DEBUG::2014-09-09 12:09:01,919::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:01,928::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:01,929::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4772::DEBUG::2014-09-09 12:09:01,929::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:02,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:02,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896696 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:03,228::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:03,228::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4773::DEBUG::2014-09-09 12:09:03,228::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4773::DEBUG::2014-09-09 12:09:03,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`25863208-0821-4a54-82cb-3228041859d9`::moving from state init -> state preparing >Thread-4773::INFO::2014-09-09 12:09:03,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4773::INFO::2014-09-09 12:09:03,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4773::DEBUG::2014-09-09 12:09:03,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`25863208-0821-4a54-82cb-3228041859d9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4773::DEBUG::2014-09-09 12:09:03,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`25863208-0821-4a54-82cb-3228041859d9`::moving from state preparing -> state finished >Thread-4773::DEBUG::2014-09-09 12:09:03,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4773::DEBUG::2014-09-09 12:09:03,230::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4773::DEBUG::2014-09-09 12:09:03,230::task::993::Storage.TaskManager.Task::(_decref) Task=`25863208-0821-4a54-82cb-3228041859d9`::ref 0 aborting False >Thread-4773::DEBUG::2014-09-09 12:09:03,230::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4773::DEBUG::2014-09-09 12:09:03,230::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:03,267::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:03,267::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4774::DEBUG::2014-09-09 12:09:03,267::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4774::DEBUG::2014-09-09 12:09:03,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`d95e235d-3b6c-4513-b4c7-10875bced0ad`::moving from state init -> state preparing >Thread-4774::INFO::2014-09-09 12:09:03,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4774::DEBUG::2014-09-09 12:09:03,268::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`addc918b-8e65-4f2f-9018-a581581768ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4774::DEBUG::2014-09-09 12:09:03,268::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4774::DEBUG::2014-09-09 12:09:03,269::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4774::DEBUG::2014-09-09 12:09:03,269::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`addc918b-8e65-4f2f-9018-a581581768ec`::Granted request >Thread-4774::DEBUG::2014-09-09 12:09:03,269::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d95e235d-3b6c-4513-b4c7-10875bced0ad`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4774::DEBUG::2014-09-09 12:09:03,269::task::993::Storage.TaskManager.Task::(_decref) Task=`d95e235d-3b6c-4513-b4c7-10875bced0ad`::ref 1 aborting False >Thread-4774::INFO::2014-09-09 12:09:03,271::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4774::DEBUG::2014-09-09 12:09:03,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`d95e235d-3b6c-4513-b4c7-10875bced0ad`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4774::DEBUG::2014-09-09 12:09:03,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`d95e235d-3b6c-4513-b4c7-10875bced0ad`::moving from state preparing -> state finished >Thread-4774::DEBUG::2014-09-09 12:09:03,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4774::DEBUG::2014-09-09 12:09:03,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4774::DEBUG::2014-09-09 12:09:03,271::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4774::DEBUG::2014-09-09 12:09:03,271::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4774::DEBUG::2014-09-09 12:09:03,271::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4774::DEBUG::2014-09-09 12:09:03,271::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4774::DEBUG::2014-09-09 12:09:03,271::task::993::Storage.TaskManager.Task::(_decref) Task=`d95e235d-3b6c-4513-b4c7-10875bced0ad`::ref 0 aborting False >Thread-4774::DEBUG::2014-09-09 12:09:03,272::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4774::DEBUG::2014-09-09 12:09:03,272::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:04,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:04,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089654 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:05,025::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:05,026::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4775::DEBUG::2014-09-09 12:09:05,027::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:06,193::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) (10174) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) (10174) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) (10174) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:06,194::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:09:06,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:09:06,202::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00092448 s, 384 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) (10175) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:06,203::__init__::225::IOProcess::(_processLogs) (10175) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:06,204::__init__::225::IOProcess::(_processLogs) (10175) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:06,204::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:09:06,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:06,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896283 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:08,035::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:08,035::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4776::DEBUG::2014-09-09 12:09:08,036::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:08,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:08,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895541 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) (10176) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) (10176) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:09,213::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:09:09,214::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:09:09,222::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000966339 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:09,222::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:09,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:09,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:09,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:09,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:09,223::__init__::225::IOProcess::(_processLogs) (10177) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:09,223::__init__::225::IOProcess::(_processLogs) (10177) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:09,223::__init__::225::IOProcess::(_processLogs) (10177) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:09,223::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:09:09,224::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:09:09,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:09,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) (10178) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) (10178) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) (10178) Building response >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) (10178) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:09:09,225::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) (10179) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) (10179) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) (10179) Building response >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) (10179) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:09,226::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) (10180) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) (10180) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:09,227::__init__::225::IOProcess::(_processLogs) (10180) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:09,228::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:09:10,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:10,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897929 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:11,045::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:11,045::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4777::DEBUG::2014-09-09 12:09:11,046::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:11,829::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:11,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:11,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:11,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:11,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:11,830::__init__::225::IOProcess::(_processLogs) (10181) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:11,830::__init__::225::IOProcess::(_processLogs) (10181) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:11,831::__init__::225::IOProcess::(_processLogs) (10181) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:11,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:09:11,832::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:09:11,840::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0013354 s, 841 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:11,840::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:11,840::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:11,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:11,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:11,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:11,841::__init__::225::IOProcess::(_processLogs) (10182) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:11,841::__init__::225::IOProcess::(_processLogs) (10182) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:11,841::__init__::225::IOProcess::(_processLogs) (10182) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:11,841::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:09:12,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:12,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896272 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:13,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4778::DEBUG::2014-09-09 12:09:13,311::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:09:13,311::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4778::DEBUG::2014-09-09 12:09:13,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc398e4-394b-417a-8096-36ecdabc14c6`::moving from state init -> state preparing >Thread-4778::INFO::2014-09-09 12:09:13,313::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4778::INFO::2014-09-09 12:09:13,313::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4778::DEBUG::2014-09-09 12:09:13,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fc398e4-394b-417a-8096-36ecdabc14c6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4778::DEBUG::2014-09-09 12:09:13,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc398e4-394b-417a-8096-36ecdabc14c6`::moving from state preparing -> state finished >Thread-4778::DEBUG::2014-09-09 12:09:13,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4778::DEBUG::2014-09-09 12:09:13,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4778::DEBUG::2014-09-09 12:09:13,313::task::993::Storage.TaskManager.Task::(_decref) Task=`8fc398e4-394b-417a-8096-36ecdabc14c6`::ref 0 aborting False >Thread-4778::DEBUG::2014-09-09 12:09:13,313::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4778::DEBUG::2014-09-09 12:09:13,313::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:13,367::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:13,368::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4779::DEBUG::2014-09-09 12:09:13,368::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4779::DEBUG::2014-09-09 12:09:13,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc0ea6b0-994e-4251-b87b-7bf9d92b2562`::moving from state init -> state preparing >Thread-4779::INFO::2014-09-09 12:09:13,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4779::DEBUG::2014-09-09 12:09:13,369::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8c8553ce-66ad-43e2-9795-360ef960e483`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4779::DEBUG::2014-09-09 12:09:13,369::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4779::DEBUG::2014-09-09 12:09:13,369::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4779::DEBUG::2014-09-09 12:09:13,369::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8c8553ce-66ad-43e2-9795-360ef960e483`::Granted request >Thread-4779::DEBUG::2014-09-09 12:09:13,370::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cc0ea6b0-994e-4251-b87b-7bf9d92b2562`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4779::DEBUG::2014-09-09 12:09:13,370::task::993::Storage.TaskManager.Task::(_decref) Task=`cc0ea6b0-994e-4251-b87b-7bf9d92b2562`::ref 1 aborting False >Thread-4779::INFO::2014-09-09 12:09:13,371::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4779::DEBUG::2014-09-09 12:09:13,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc0ea6b0-994e-4251-b87b-7bf9d92b2562`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4779::DEBUG::2014-09-09 12:09:13,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc0ea6b0-994e-4251-b87b-7bf9d92b2562`::moving from state preparing -> state finished >Thread-4779::DEBUG::2014-09-09 12:09:13,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4779::DEBUG::2014-09-09 12:09:13,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4779::DEBUG::2014-09-09 12:09:13,372::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4779::DEBUG::2014-09-09 12:09:13,372::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4779::DEBUG::2014-09-09 12:09:13,372::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4779::DEBUG::2014-09-09 12:09:13,372::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4779::DEBUG::2014-09-09 12:09:13,372::task::993::Storage.TaskManager.Task::(_decref) Task=`cc0ea6b0-994e-4251-b87b-7bf9d92b2562`::ref 0 aborting False >Thread-4779::DEBUG::2014-09-09 12:09:13,372::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4779::DEBUG::2014-09-09 12:09:13,372::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:14,056::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:14,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4780::DEBUG::2014-09-09 12:09:14,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:14,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:14,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897352 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:16,205::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:16,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:16,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:16,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:16,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:16,206::__init__::225::IOProcess::(_processLogs) (10183) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:16,206::__init__::225::IOProcess::(_processLogs) (10183) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:16,206::__init__::225::IOProcess::(_processLogs) (10183) Queuing response >Thread-3443::DEBUG::2014-09-09 12:09:16,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:16,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:16,212::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:09:16,214::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000876386 s, 405 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) (10184) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:16,215::__init__::225::IOProcess::(_processLogs) (10184) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:16,216::__init__::225::IOProcess::(_processLogs) (10184) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:16,216::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:09:16,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:16,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896827 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:17,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:17,066::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4781::DEBUG::2014-09-09 12:09:17,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`b118a38a-c47a-420f-b3f6-1163bc0480e6`::moving from state init -> state preparing >Thread-4781::INFO::2014-09-09 12:09:17,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4781::INFO::2014-09-09 12:09:17,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0013354', 'lastCheck': '5.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966339', 'lastCheck': '7.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000876386', 'lastCheck': '0.9', 'valid': True}} >Thread-4781::DEBUG::2014-09-09 12:09:17,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`b118a38a-c47a-420f-b3f6-1163bc0480e6`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0013354', 'lastCheck': '5.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966339', 'lastCheck': '7.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000876386', 'lastCheck': '0.9', 'valid': True}} >Thread-4781::DEBUG::2014-09-09 12:09:17,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`b118a38a-c47a-420f-b3f6-1163bc0480e6`::moving from state preparing -> state finished >Thread-4781::DEBUG::2014-09-09 12:09:17,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4781::DEBUG::2014-09-09 12:09:17,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4781::DEBUG::2014-09-09 12:09:17,068::task::993::Storage.TaskManager.Task::(_decref) Task=`b118a38a-c47a-420f-b3f6-1163bc0480e6`::ref 0 aborting False >Thread-4781::DEBUG::2014-09-09 12:09:17,068::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:17,078::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:17,079::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4782::DEBUG::2014-09-09 12:09:17,080::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:18,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:19,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899347 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) (10185) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:19,229::__init__::225::IOProcess::(_processLogs) (10185) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:19,230::__init__::225::IOProcess::(_processLogs) DEBUG|(10185) Building response >Thread-19::DEBUG::2014-09-09 12:09:19,230::__init__::225::IOProcess::(_processLogs) (10185) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:19,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:19,230::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:09:19,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:09:19,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000952292 s, 575 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) (10186) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:19,241::__init__::225::IOProcess::(_processLogs) (10186) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:19,242::__init__::225::IOProcess::(_processLogs) DEBUG|(10186) Building response >Thread-19::DEBUG::2014-09-09 12:09:19,242::__init__::225::IOProcess::(_processLogs) (10186) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:19,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:19,242::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:19,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) (10187) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) (10187) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) (10187) Building response >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) (10187) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:19,244::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) (10188) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) (10188) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) (10188) Building response >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) (10188) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:19,245::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:19,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:19,246::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:09:19,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:19,246::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:19,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:19,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) (10189) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) (10189) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) (10189) Building response >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) (10189) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:19,247::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:20,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:20,213::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4783::DEBUG::2014-09-09 12:09:20,215::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:21,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:21,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895812 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:21,842::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:21,842::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:21,842::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:21,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:21,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:21,843::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:21,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:21,843::__init__::225::IOProcess::(_processLogs) (10190) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:21,843::__init__::225::IOProcess::(_processLogs) (10190) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:21,843::__init__::225::IOProcess::(_processLogs) DEBUG|(10190) Building response >Thread-19::DEBUG::2014-09-09 12:09:21,844::__init__::225::IOProcess::(_processLogs) (10190) Queuing response >Thread-23::DEBUG::2014-09-09 12:09:21,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:21,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:21,849::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:09:21,851::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109165 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) (10191) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) (10191) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:21,852::__init__::225::IOProcess::(_processLogs) DEBUG|(10191) Building response >Thread-19::DEBUG::2014-09-09 12:09:21,853::__init__::225::IOProcess::(_processLogs) (10191) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:21,853::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:21,853::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:09:23,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:23,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:23,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4784::DEBUG::2014-09-09 12:09:23,234::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:23,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08942 s, 11.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:23,412::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4785::DEBUG::2014-09-09 12:09:23,413::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:09:23,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4785::DEBUG::2014-09-09 12:09:23,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc52398a-0011-4e0f-a03f-879be18d2c91`::moving from state init -> state preparing >Thread-4785::INFO::2014-09-09 12:09:23,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4785::INFO::2014-09-09 12:09:23,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4785::DEBUG::2014-09-09 12:09:23,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc52398a-0011-4e0f-a03f-879be18d2c91`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4785::DEBUG::2014-09-09 12:09:23,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc52398a-0011-4e0f-a03f-879be18d2c91`::moving from state preparing -> state finished >Thread-4785::DEBUG::2014-09-09 12:09:23,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4785::DEBUG::2014-09-09 12:09:23,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4785::DEBUG::2014-09-09 12:09:23,414::task::993::Storage.TaskManager.Task::(_decref) Task=`fc52398a-0011-4e0f-a03f-879be18d2c91`::ref 0 aborting False >Thread-4785::DEBUG::2014-09-09 12:09:23,415::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4785::DEBUG::2014-09-09 12:09:23,415::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:23,476::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4786::DEBUG::2014-09-09 12:09:23,477::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:09:23,477::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4786::DEBUG::2014-09-09 12:09:23,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`b984209d-8bc9-4d45-a1c8-362dba95b27f`::moving from state init -> state preparing >Thread-4786::INFO::2014-09-09 12:09:23,478::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4786::DEBUG::2014-09-09 12:09:23,478::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`606cf52c-838b-424f-8b58-def58147b3c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4786::DEBUG::2014-09-09 12:09:23,478::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4786::DEBUG::2014-09-09 12:09:23,478::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4786::DEBUG::2014-09-09 12:09:23,478::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`606cf52c-838b-424f-8b58-def58147b3c4`::Granted request >Thread-4786::DEBUG::2014-09-09 12:09:23,479::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b984209d-8bc9-4d45-a1c8-362dba95b27f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4786::DEBUG::2014-09-09 12:09:23,479::task::993::Storage.TaskManager.Task::(_decref) Task=`b984209d-8bc9-4d45-a1c8-362dba95b27f`::ref 1 aborting False >Thread-4786::INFO::2014-09-09 12:09:23,480::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4786::DEBUG::2014-09-09 12:09:23,480::task::1191::Storage.TaskManager.Task::(prepare) Task=`b984209d-8bc9-4d45-a1c8-362dba95b27f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4786::DEBUG::2014-09-09 12:09:23,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`b984209d-8bc9-4d45-a1c8-362dba95b27f`::moving from state preparing -> state finished >Thread-4786::DEBUG::2014-09-09 12:09:23,481::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4786::DEBUG::2014-09-09 12:09:23,481::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4786::DEBUG::2014-09-09 12:09:23,481::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4786::DEBUG::2014-09-09 12:09:23,481::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4786::DEBUG::2014-09-09 12:09:23,481::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4786::DEBUG::2014-09-09 12:09:23,481::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4786::DEBUG::2014-09-09 12:09:23,481::task::993::Storage.TaskManager.Task::(_decref) Task=`b984209d-8bc9-4d45-a1c8-362dba95b27f`::ref 0 aborting False >Thread-4786::DEBUG::2014-09-09 12:09:23,481::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4786::DEBUG::2014-09-09 12:09:23,482::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:25,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:25,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0935544 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:26,217::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:26,217::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:26,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:26,217::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:26,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:26,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:26,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:26,218::__init__::225::IOProcess::(_processLogs) (10192) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:26,218::__init__::225::IOProcess::(_processLogs) (10192) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:26,218::__init__::225::IOProcess::(_processLogs) DEBUG|(10192) Building response >Thread-19::DEBUG::2014-09-09 12:09:26,219::__init__::225::IOProcess::(_processLogs) (10192) Queuing response >Thread-3443::DEBUG::2014-09-09 12:09:26,219::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:26,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:26,224::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:09:26,226::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000924643 s, 384 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:26,226::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) (10193) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) (10193) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:26,227::__init__::225::IOProcess::(_processLogs) DEBUG|(10193) Building response >Thread-19::DEBUG::2014-09-09 12:09:26,228::__init__::225::IOProcess::(_processLogs) DEBUG|(10193) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:26,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:26,228::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:26,239::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:26,240::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4787::DEBUG::2014-09-09 12:09:26,241::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:27,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:27,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894209 s, 11.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:29,247::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:29,247::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:29,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:29,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:29,247::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:29,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:29,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:29,248::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-19::DEBUG::2014-09-09 12:09:29,248::__init__::225::IOProcess::(_processLogs) (10194) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:29,249::__init__::225::IOProcess::(_processLogs) (10194) Got request for method 'statvfs' >JsonRpcServer::DEBUG::2014-09-09 12:09:29,250::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-19::DEBUG::2014-09-09 12:09:29,251::__init__::225::IOProcess::(_processLogs) DEBUG|(10194) Building response >Thread-24::DEBUG::2014-09-09 12:09:29,252::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:29,253::__init__::225::IOProcess::(_processLogs) (10194) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:29,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-4788::DEBUG::2014-09-09 12:09:29,260::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:29,260::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:09:29,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000891369 s, 615 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:29,263::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:29,263::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:29,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:29,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:29,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) (10195) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) (10195) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) DEBUG|(10195) Building response >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) (10195) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:29,264::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:29,265::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:09:29,265::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:29,265::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:09:29,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:29,265::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) (10196) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) (10196) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) (10196) Building response >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) (10196) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:29,266::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) (10197) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) (10197) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) (10197) Building response >Thread-19::DEBUG::2014-09-09 12:09:29,267::__init__::225::IOProcess::(_processLogs) (10197) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:29,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:29,268::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:29,268::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:29,268::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:09:29,268::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:29,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) (10198) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) (10198) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) (10198) Building response >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) (10198) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:29,269::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:09:29,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:29,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895252 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:09:31,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:31,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895724 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:31,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:31,855::__init__::225::IOProcess::(_processLogs) (10199) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:31,855::__init__::225::IOProcess::(_processLogs) (10199) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:31,855::__init__::225::IOProcess::(_processLogs) DEBUG|(10199) Building response >Thread-19::DEBUG::2014-09-09 12:09:31,855::__init__::225::IOProcess::(_processLogs) (10199) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:31,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:31,855::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:09:31,856::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:09:31,862::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110409 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:31,863::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:31,863::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:31,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:31,863::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:31,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) (10200) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) (10200) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) DEBUG|(10200) Building response >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) (10200) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:31,864::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:31,865::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:32,269::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:32,270::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4789::DEBUG::2014-09-09 12:09:32,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eec2b1c-3f64-4afa-973e-bdd39a476978`::moving from state init -> state preparing >Thread-4789::INFO::2014-09-09 12:09:32,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4789::INFO::2014-09-09 12:09:32,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110409', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000891369', 'lastCheck': '3.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000924643', 'lastCheck': '6.0', 'valid': True}} >Thread-4789::DEBUG::2014-09-09 12:09:32,272::task::1191::Storage.TaskManager.Task::(prepare) Task=`1eec2b1c-3f64-4afa-973e-bdd39a476978`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110409', 'lastCheck': '0.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000891369', 'lastCheck': '3.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000924643', 'lastCheck': '6.0', 'valid': True}} >Thread-4789::DEBUG::2014-09-09 12:09:32,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eec2b1c-3f64-4afa-973e-bdd39a476978`::moving from state preparing -> state finished >Thread-4789::DEBUG::2014-09-09 12:09:32,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4789::DEBUG::2014-09-09 12:09:32,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4789::DEBUG::2014-09-09 12:09:32,272::task::993::Storage.TaskManager.Task::(_decref) Task=`1eec2b1c-3f64-4afa-973e-bdd39a476978`::ref 0 aborting False >Thread-4789::DEBUG::2014-09-09 12:09:32,273::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:32,281::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:32,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4790::DEBUG::2014-09-09 12:09:32,282::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:33,578::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:33,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4791::DEBUG::2014-09-09 12:09:33,579::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4791::DEBUG::2014-09-09 12:09:33,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4c003ec-f62a-45d0-b1e0-5b25d76be20f`::moving from state init -> state preparing >Thread-4791::INFO::2014-09-09 12:09:33,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4791::INFO::2014-09-09 12:09:33,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4791::DEBUG::2014-09-09 12:09:33,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4c003ec-f62a-45d0-b1e0-5b25d76be20f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4791::DEBUG::2014-09-09 12:09:33,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4c003ec-f62a-45d0-b1e0-5b25d76be20f`::moving from state preparing -> state finished >Thread-4791::DEBUG::2014-09-09 12:09:33,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4791::DEBUG::2014-09-09 12:09:33,580::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4791::DEBUG::2014-09-09 12:09:33,580::task::993::Storage.TaskManager.Task::(_decref) Task=`c4c003ec-f62a-45d0-b1e0-5b25d76be20f`::ref 0 aborting False >Thread-4791::DEBUG::2014-09-09 12:09:33,580::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4791::DEBUG::2014-09-09 12:09:33,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:33,594::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:33,595::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4792::DEBUG::2014-09-09 12:09:33,595::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4792::DEBUG::2014-09-09 12:09:33,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab81eaee-fe3c-4d39-8f00-21cafd514eff`::moving from state init -> state preparing >Thread-4792::INFO::2014-09-09 12:09:33,596::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4792::DEBUG::2014-09-09 12:09:33,596::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cdeade3a-436e-4322-a7d4-a56d93596f58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4792::DEBUG::2014-09-09 12:09:33,596::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4792::DEBUG::2014-09-09 12:09:33,596::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4792::DEBUG::2014-09-09 12:09:33,597::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cdeade3a-436e-4322-a7d4-a56d93596f58`::Granted request >Thread-4792::DEBUG::2014-09-09 12:09:33,597::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ab81eaee-fe3c-4d39-8f00-21cafd514eff`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4792::DEBUG::2014-09-09 12:09:33,597::task::993::Storage.TaskManager.Task::(_decref) Task=`ab81eaee-fe3c-4d39-8f00-21cafd514eff`::ref 1 aborting False >Thread-4792::INFO::2014-09-09 12:09:33,598::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4792::DEBUG::2014-09-09 12:09:33,598::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab81eaee-fe3c-4d39-8f00-21cafd514eff`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4792::DEBUG::2014-09-09 12:09:33,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab81eaee-fe3c-4d39-8f00-21cafd514eff`::moving from state preparing -> state finished >Thread-4792::DEBUG::2014-09-09 12:09:33,599::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4792::DEBUG::2014-09-09 12:09:33,599::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4792::DEBUG::2014-09-09 12:09:33,599::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4792::DEBUG::2014-09-09 12:09:33,599::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4792::DEBUG::2014-09-09 12:09:33,599::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4792::DEBUG::2014-09-09 12:09:33,599::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4792::DEBUG::2014-09-09 12:09:33,599::task::993::Storage.TaskManager.Task::(_decref) Task=`ab81eaee-fe3c-4d39-8f00-21cafd514eff`::ref 0 aborting False >Thread-4792::DEBUG::2014-09-09 12:09:33,599::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4792::DEBUG::2014-09-09 12:09:33,600::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:33,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:33,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895794 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:35,382::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:35,383::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4793::DEBUG::2014-09-09 12:09:35,384::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:35,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:35,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895557 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) (10201) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:36,229::__init__::225::IOProcess::(_processLogs) (10201) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:36,231::__init__::225::IOProcess::(_processLogs) DEBUG|(10201) Building response >Thread-19::DEBUG::2014-09-09 12:09:36,231::__init__::225::IOProcess::(_processLogs) (10201) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:36,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:36,231::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:09:36,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:09:36,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000869892 s, 408 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:36,240::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:36,240::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:36,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:36,240::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) (10202) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) (10202) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) DEBUG|(10202) Building response >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) (10202) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:36,241::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:36,242::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:09:37,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:38,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895915 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:38,390::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:38,391::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4794::DEBUG::2014-09-09 12:09:38,392::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:39,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:39,270::__init__::225::IOProcess::(_processLogs) (10203) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:39,270::__init__::225::IOProcess::(_processLogs) (10203) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:39,270::__init__::225::IOProcess::(_processLogs) DEBUG|(10203) Building response >Thread-19::DEBUG::2014-09-09 12:09:39,270::__init__::225::IOProcess::(_processLogs) (10203) Queuing response >Thread-24::DEBUG::2014-09-09 12:09:39,270::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:39,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:39,276::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:09:39,279::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00099538 s, 551 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:39,279::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:39,279::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:39,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:39,279::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:39,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) (10204) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) (10204) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) DEBUG|(10204) Building response >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) (10204) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:39,280::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:39,281::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:09:39,281::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:39,281::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:09:39,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:39,281::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) (10205) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) (10205) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) (10205) Building response >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) (10205) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:39,282::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) (10206) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:39,283::__init__::225::IOProcess::(_processLogs) (10206) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) (10206) Building response >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) (10206) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:09:39,284::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) (10207) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) (10207) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) (10207) Building response >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) (10207) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:39,285::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:09:40,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:40,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895615 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:41,397::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:41,398::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4795::DEBUG::2014-09-09 12:09:41,399::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:41,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:41,865::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:41,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:41,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:41,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:41,866::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:41,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:41,866::__init__::225::IOProcess::(_processLogs) (10208) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:41,866::__init__::225::IOProcess::(_processLogs) (10208) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:41,867::__init__::225::IOProcess::(_processLogs) DEBUG|(10208) Building response >Thread-19::DEBUG::2014-09-09 12:09:41,867::__init__::225::IOProcess::(_processLogs) (10208) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:41,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:41,867::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:09:41,868::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:09:41,875::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011235 s, 1000 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:41,876::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:41,876::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:41,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:41,876::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:41,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) (10209) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) (10209) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) DEBUG|(10209) Building response >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) (10209) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:41,877::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:41,878::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:09:42,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:42,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897138 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:43,639::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:43,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4796::DEBUG::2014-09-09 12:09:43,640::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4796::DEBUG::2014-09-09 12:09:43,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`f80f1a76-63e1-4fd6-a830-2bad8f4b636f`::moving from state init -> state preparing >Thread-4796::INFO::2014-09-09 12:09:43,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4796::INFO::2014-09-09 12:09:43,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4796::DEBUG::2014-09-09 12:09:43,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`f80f1a76-63e1-4fd6-a830-2bad8f4b636f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4796::DEBUG::2014-09-09 12:09:43,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`f80f1a76-63e1-4fd6-a830-2bad8f4b636f`::moving from state preparing -> state finished >Thread-4796::DEBUG::2014-09-09 12:09:43,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4796::DEBUG::2014-09-09 12:09:43,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4796::DEBUG::2014-09-09 12:09:43,642::task::993::Storage.TaskManager.Task::(_decref) Task=`f80f1a76-63e1-4fd6-a830-2bad8f4b636f`::ref 0 aborting False >Thread-4796::DEBUG::2014-09-09 12:09:43,642::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4796::DEBUG::2014-09-09 12:09:43,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:43,672::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:43,673::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4797::DEBUG::2014-09-09 12:09:43,673::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4797::DEBUG::2014-09-09 12:09:43,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3784d32-aad1-446d-991c-7049521ac6e8`::moving from state init -> state preparing >Thread-4797::INFO::2014-09-09 12:09:43,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4797::DEBUG::2014-09-09 12:09:43,674::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f9eb7f74-acdb-4ed5-8ae1-991d4266a777`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4797::DEBUG::2014-09-09 12:09:43,674::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4797::DEBUG::2014-09-09 12:09:43,674::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4797::DEBUG::2014-09-09 12:09:43,674::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f9eb7f74-acdb-4ed5-8ae1-991d4266a777`::Granted request >Thread-4797::DEBUG::2014-09-09 12:09:43,675::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f3784d32-aad1-446d-991c-7049521ac6e8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4797::DEBUG::2014-09-09 12:09:43,675::task::993::Storage.TaskManager.Task::(_decref) Task=`f3784d32-aad1-446d-991c-7049521ac6e8`::ref 1 aborting False >Thread-4797::INFO::2014-09-09 12:09:43,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4797::DEBUG::2014-09-09 12:09:43,676::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3784d32-aad1-446d-991c-7049521ac6e8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4797::DEBUG::2014-09-09 12:09:43,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3784d32-aad1-446d-991c-7049521ac6e8`::moving from state preparing -> state finished >Thread-4797::DEBUG::2014-09-09 12:09:43,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4797::DEBUG::2014-09-09 12:09:43,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4797::DEBUG::2014-09-09 12:09:43,677::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4797::DEBUG::2014-09-09 12:09:43,677::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4797::DEBUG::2014-09-09 12:09:43,677::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4797::DEBUG::2014-09-09 12:09:43,677::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4797::DEBUG::2014-09-09 12:09:43,677::task::993::Storage.TaskManager.Task::(_decref) Task=`f3784d32-aad1-446d-991c-7049521ac6e8`::ref 0 aborting False >Thread-4797::DEBUG::2014-09-09 12:09:43,677::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4797::DEBUG::2014-09-09 12:09:43,677::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:44,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:44,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895928 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:44,404::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:44,405::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4798::DEBUG::2014-09-09 12:09:44,406::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) (10210) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) (10210) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) DEBUG|(10210) Building response >Thread-19::DEBUG::2014-09-09 12:09:46,243::__init__::225::IOProcess::(_processLogs) (10210) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:46,244::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:46,244::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:09:46,244::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:09:46,251::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000922472 s, 385 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) (10211) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:46,252::__init__::225::IOProcess::(_processLogs) (10211) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:46,253::__init__::225::IOProcess::(_processLogs) DEBUG|(10211) Building response >Thread-19::DEBUG::2014-09-09 12:09:46,253::__init__::225::IOProcess::(_processLogs) (10211) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:46,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:46,253::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:09:46,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:46,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895703 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:47,411::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:47,412::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4799::DEBUG::2014-09-09 12:09:47,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`32a40198-8a6b-4143-bd24-8cc77c8ee9fb`::moving from state init -> state preparing >Thread-4799::INFO::2014-09-09 12:09:47,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4799::INFO::2014-09-09 12:09:47,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011235', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00099538', 'lastCheck': '8.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000922472', 'lastCheck': '1.2', 'valid': True}} >Thread-4799::DEBUG::2014-09-09 12:09:47,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`32a40198-8a6b-4143-bd24-8cc77c8ee9fb`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011235', 'lastCheck': '5.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00099538', 'lastCheck': '8.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000922472', 'lastCheck': '1.2', 'valid': True}} >Thread-4799::DEBUG::2014-09-09 12:09:47,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`32a40198-8a6b-4143-bd24-8cc77c8ee9fb`::moving from state preparing -> state finished >Thread-4799::DEBUG::2014-09-09 12:09:47,416::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4799::DEBUG::2014-09-09 12:09:47,416::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4799::DEBUG::2014-09-09 12:09:47,417::task::993::Storage.TaskManager.Task::(_decref) Task=`32a40198-8a6b-4143-bd24-8cc77c8ee9fb`::ref 0 aborting False >Thread-4799::DEBUG::2014-09-09 12:09:47,420::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:47,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:47,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4800::DEBUG::2014-09-09 12:09:47,429::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:48,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:48,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894665 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:49,285::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:49,285::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:49,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) (10212) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) (10212) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) DEBUG|(10212) Building response >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) (10212) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:49,286::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:09:49,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:49,287::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:09:49,295::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100896 s, 543 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) (10213) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:49,296::__init__::225::IOProcess::(_processLogs) (10213) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:49,297::__init__::225::IOProcess::(_processLogs) DEBUG|(10213) Building response >Thread-19::DEBUG::2014-09-09 12:09:49,297::__init__::225::IOProcess::(_processLogs) (10213) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:49,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:49,297::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) DEBUG|(10214) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) (10214) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:49,298::__init__::225::IOProcess::(_processLogs) DEBUG|(10214) Building response >Thread-19::DEBUG::2014-09-09 12:09:49,299::__init__::225::IOProcess::(_processLogs) (10214) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:49,299::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:49,299::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:49,299::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:49,299::__init__::225::IOProcess::(_processLogs) DEBUG|Message size is 170 >Thread-19::DEBUG::2014-09-09 12:09:49,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) (10215) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) (10215) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) DEBUG|(10215) Building response >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) (10215) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:49,300::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:49,301::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:49,301::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:49,301::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:09:49,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:49,301::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) (10216) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) (10216) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) (10216) Building response >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) (10216) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:49,302::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:09:50,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:50,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895527 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:50,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:50,678::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4801::DEBUG::2014-09-09 12:09:50,679::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:09:51,878::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) (10217) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) (10217) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:51,879::__init__::225::IOProcess::(_processLogs) DEBUG|(10217) Building response >Thread-19::DEBUG::2014-09-09 12:09:51,880::__init__::225::IOProcess::(_processLogs) (10217) Queuing response >Thread-23::DEBUG::2014-09-09 12:09:51,880::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:51,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:51,886::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:09:51,887::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010129 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) (10218) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:51,888::__init__::225::IOProcess::(_processLogs) (10218) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:51,889::__init__::225::IOProcess::(_processLogs) DEBUG|(10218) Building response >Thread-19::DEBUG::2014-09-09 12:09:51,889::__init__::225::IOProcess::(_processLogs) (10218) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:51,889::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:51,890::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:09:52,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:52,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897797 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:53,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:53,687::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4802::DEBUG::2014-09-09 12:09:53,688::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:53,715::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:53,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4803::DEBUG::2014-09-09 12:09:53,716::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4803::DEBUG::2014-09-09 12:09:53,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf8b8b3f-7742-4715-9e22-047de3ce66e2`::moving from state init -> state preparing >Thread-4803::INFO::2014-09-09 12:09:53,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4803::INFO::2014-09-09 12:09:53,717::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4803::DEBUG::2014-09-09 12:09:53,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf8b8b3f-7742-4715-9e22-047de3ce66e2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4803::DEBUG::2014-09-09 12:09:53,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf8b8b3f-7742-4715-9e22-047de3ce66e2`::moving from state preparing -> state finished >Thread-4803::DEBUG::2014-09-09 12:09:53,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4803::DEBUG::2014-09-09 12:09:53,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4803::DEBUG::2014-09-09 12:09:53,718::task::993::Storage.TaskManager.Task::(_decref) Task=`cf8b8b3f-7742-4715-9e22-047de3ce66e2`::ref 0 aborting False >Thread-4803::DEBUG::2014-09-09 12:09:53,718::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4803::DEBUG::2014-09-09 12:09:53,718::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:53,773::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:53,773::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4804::DEBUG::2014-09-09 12:09:53,773::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4804::DEBUG::2014-09-09 12:09:53,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b21db3e-1d67-4f2b-9864-921aeeca2d3d`::moving from state init -> state preparing >Thread-4804::INFO::2014-09-09 12:09:53,774::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4804::DEBUG::2014-09-09 12:09:53,775::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cbf9ec8e-aa3d-459e-8859-afa5605c9b31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4804::DEBUG::2014-09-09 12:09:53,775::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4804::DEBUG::2014-09-09 12:09:53,775::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4804::DEBUG::2014-09-09 12:09:53,775::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`cbf9ec8e-aa3d-459e-8859-afa5605c9b31`::Granted request >Thread-4804::DEBUG::2014-09-09 12:09:53,776::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0b21db3e-1d67-4f2b-9864-921aeeca2d3d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4804::DEBUG::2014-09-09 12:09:53,776::task::993::Storage.TaskManager.Task::(_decref) Task=`0b21db3e-1d67-4f2b-9864-921aeeca2d3d`::ref 1 aborting False >Thread-4804::INFO::2014-09-09 12:09:53,777::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4804::DEBUG::2014-09-09 12:09:53,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b21db3e-1d67-4f2b-9864-921aeeca2d3d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4804::DEBUG::2014-09-09 12:09:53,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b21db3e-1d67-4f2b-9864-921aeeca2d3d`::moving from state preparing -> state finished >Thread-4804::DEBUG::2014-09-09 12:09:53,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4804::DEBUG::2014-09-09 12:09:53,778::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4804::DEBUG::2014-09-09 12:09:53,778::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4804::DEBUG::2014-09-09 12:09:53,778::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4804::DEBUG::2014-09-09 12:09:53,778::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4804::DEBUG::2014-09-09 12:09:53,778::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4804::DEBUG::2014-09-09 12:09:53,778::task::993::Storage.TaskManager.Task::(_decref) Task=`0b21db3e-1d67-4f2b-9864-921aeeca2d3d`::ref 0 aborting False >Thread-4804::DEBUG::2014-09-09 12:09:53,778::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4804::DEBUG::2014-09-09 12:09:53,778::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:54,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:54,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895719 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:56,254::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:56,254::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:56,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) (10219) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) (10219) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:56,255::__init__::225::IOProcess::(_processLogs) DEBUG|(10219) Building response >Thread-3443::DEBUG::2014-09-09 12:09:56,256::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:09:56,256::__init__::225::IOProcess::(_processLogs) (10219) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:56,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:56,261::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:09:56,263::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000886891 s, 400 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:56,263::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:56,263::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) (10220) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) (10220) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) DEBUG|(10220) Building response >Thread-19::DEBUG::2014-09-09 12:09:56,264::__init__::225::IOProcess::(_processLogs) (10220) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:56,265::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:09:56,265::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:56,694::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:56,695::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4805::DEBUG::2014-09-09 12:09:56,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:09:56,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:56,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0903384 s, 11.3 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:09:58,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:09:59,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089576 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:59,302::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:59,302::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:59,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:59,302::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) (10221) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) (10221) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) DEBUG|(10221) Building response >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) (10221) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:59,303::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:09:59,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:09:59,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104564 s, 524 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:09:59,313::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:09:59,313::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:09:59,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:59,313::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:09:59,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:59,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:59,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:59,314::__init__::225::IOProcess::(_processLogs) (10222) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:09:59,314::__init__::225::IOProcess::(_processLogs) (10222) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:09:59,314::__init__::225::IOProcess::(_processLogs) DEBUG|(10222) Building response >Thread-19::DEBUG::2014-09-09 12:09:59,314::__init__::225::IOProcess::(_processLogs) (10222) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:59,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:59,315::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:09:59,315::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:09:59,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) (10223) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) (10223) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) (10223) Building response >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) (10223) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:59,316::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) (10224) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) (10224) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:59,317::__init__::225::IOProcess::(_processLogs) (10224) Building response >Thread-19::DEBUG::2014-09-09 12:09:59,318::__init__::225::IOProcess::(_processLogs) (10224) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:59,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:59,318::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:09:59,318::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:09:59,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:09:59,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) (10225) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) (10225) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) (10225) Building response >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) (10225) Queuing response >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:09:59,319::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:09:59,704::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:09:59,704::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4806::DEBUG::2014-09-09 12:09:59,705::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:01,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:01,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896046 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:01,890::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:01,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:01,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:01,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:01,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:01,891::__init__::225::IOProcess::(_processLogs) (10226) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:01,891::__init__::225::IOProcess::(_processLogs) (10226) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:01,891::__init__::225::IOProcess::(_processLogs) (10226) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:01,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:10:01,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:10:01,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112643 s, 997 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) (10227) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:01,900::__init__::225::IOProcess::(_processLogs) (10227) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:01,901::__init__::225::IOProcess::(_processLogs) (10227) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:01,901::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:02,713::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:02,714::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4807::DEBUG::2014-09-09 12:10:02,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa830785-1b05-4f25-9c1a-88447a192d03`::moving from state init -> state preparing >Thread-4807::INFO::2014-09-09 12:10:02,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4807::INFO::2014-09-09 12:10:02,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112643', 'lastCheck': '0.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104564', 'lastCheck': '3.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000886891', 'lastCheck': '6.5', 'valid': True}} >Thread-4807::DEBUG::2014-09-09 12:10:02,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa830785-1b05-4f25-9c1a-88447a192d03`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112643', 'lastCheck': '0.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104564', 'lastCheck': '3.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000886891', 'lastCheck': '6.5', 'valid': True}} >Thread-4807::DEBUG::2014-09-09 12:10:02,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa830785-1b05-4f25-9c1a-88447a192d03`::moving from state preparing -> state finished >Thread-4807::DEBUG::2014-09-09 12:10:02,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4807::DEBUG::2014-09-09 12:10:02,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4807::DEBUG::2014-09-09 12:10:02,716::task::993::Storage.TaskManager.Task::(_decref) Task=`fa830785-1b05-4f25-9c1a-88447a192d03`::ref 0 aborting False >Thread-4807::DEBUG::2014-09-09 12:10:02,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:02,726::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:02,727::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4808::DEBUG::2014-09-09 12:10:02,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:03,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:03,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895803 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:03,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:03,817::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4809::DEBUG::2014-09-09 12:10:03,817::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4809::DEBUG::2014-09-09 12:10:03,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`42b7a4da-2969-469a-a283-5401d33a5ceb`::moving from state init -> state preparing >Thread-4809::INFO::2014-09-09 12:10:03,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4809::INFO::2014-09-09 12:10:03,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4809::DEBUG::2014-09-09 12:10:03,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`42b7a4da-2969-469a-a283-5401d33a5ceb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4809::DEBUG::2014-09-09 12:10:03,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`42b7a4da-2969-469a-a283-5401d33a5ceb`::moving from state preparing -> state finished >Thread-4809::DEBUG::2014-09-09 12:10:03,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4809::DEBUG::2014-09-09 12:10:03,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4809::DEBUG::2014-09-09 12:10:03,819::task::993::Storage.TaskManager.Task::(_decref) Task=`42b7a4da-2969-469a-a283-5401d33a5ceb`::ref 0 aborting False >Thread-4809::DEBUG::2014-09-09 12:10:03,819::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4809::DEBUG::2014-09-09 12:10:03,819::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:03,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:03,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4810::DEBUG::2014-09-09 12:10:03,874::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4810::DEBUG::2014-09-09 12:10:03,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0575f10-b26c-450e-b3ae-ac3f9a0d2937`::moving from state init -> state preparing >Thread-4810::INFO::2014-09-09 12:10:03,875::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4810::DEBUG::2014-09-09 12:10:03,875::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6a66f223-b8ae-4ec1-ab08-8943b67149d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4810::DEBUG::2014-09-09 12:10:03,875::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4810::DEBUG::2014-09-09 12:10:03,876::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4810::DEBUG::2014-09-09 12:10:03,876::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6a66f223-b8ae-4ec1-ab08-8943b67149d6`::Granted request >Thread-4810::DEBUG::2014-09-09 12:10:03,876::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a0575f10-b26c-450e-b3ae-ac3f9a0d2937`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4810::DEBUG::2014-09-09 12:10:03,876::task::993::Storage.TaskManager.Task::(_decref) Task=`a0575f10-b26c-450e-b3ae-ac3f9a0d2937`::ref 1 aborting False >Thread-4810::INFO::2014-09-09 12:10:03,877::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4810::DEBUG::2014-09-09 12:10:03,878::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0575f10-b26c-450e-b3ae-ac3f9a0d2937`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4810::DEBUG::2014-09-09 12:10:03,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0575f10-b26c-450e-b3ae-ac3f9a0d2937`::moving from state preparing -> state finished >Thread-4810::DEBUG::2014-09-09 12:10:03,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4810::DEBUG::2014-09-09 12:10:03,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4810::DEBUG::2014-09-09 12:10:03,878::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4810::DEBUG::2014-09-09 12:10:03,878::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4810::DEBUG::2014-09-09 12:10:03,878::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4810::DEBUG::2014-09-09 12:10:03,878::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4810::DEBUG::2014-09-09 12:10:03,878::task::993::Storage.TaskManager.Task::(_decref) Task=`a0575f10-b26c-450e-b3ae-ac3f9a0d2937`::ref 0 aborting False >Thread-4810::DEBUG::2014-09-09 12:10:03,879::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4810::DEBUG::2014-09-09 12:10:03,879::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:05,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:05,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895615 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:05,865::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:05,866::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4811::DEBUG::2014-09-09 12:10:05,867::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:10:06,265::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) (10228) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) (10228) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:06,266::__init__::225::IOProcess::(_processLogs) (10228) Queuing response >Thread-3443::DEBUG::2014-09-09 12:10:06,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:06,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:06,272::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:10:06,275::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000867931 s, 409 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) (10229) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:06,275::__init__::225::IOProcess::(_processLogs) (10229) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:06,276::__init__::225::IOProcess::(_processLogs) (10229) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:06,276::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:10:07,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:07,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896559 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:08,872::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:08,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4812::DEBUG::2014-09-09 12:10:08,874::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:10:09,319::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:09,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:09,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:09,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:09,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:09,319::__init__::225::IOProcess::(_processLogs) (10230) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:09,320::__init__::225::IOProcess::(_processLogs) (10230) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:09,320::__init__::225::IOProcess::(_processLogs) (10230) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:09,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:09,320::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:10:09,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:10:09,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000878418 s, 624 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:09,328::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:09,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) (10231) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) (10231) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) DEBUG|(10231) Building response >Thread-19::DEBUG::2014-09-09 12:10:09,329::__init__::225::IOProcess::(_processLogs) (10231) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:09,330::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:09,330::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:09,330::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:09,330::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:10:09,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:09,331::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) (10232) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) (10232) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) (10232) Building response >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) (10232) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:09,332::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) (10233) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) (10233) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:09,333::__init__::225::IOProcess::(_processLogs) (10233) Building response >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) (10233) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:09,334::__init__::225::IOProcess::(_processLogs) (10234) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:09,335::__init__::225::IOProcess::(_processLogs) (10234) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:09,335::__init__::225::IOProcess::(_processLogs) DEBUG|(10234) Building response >Thread-19::DEBUG::2014-09-09 12:10:09,335::__init__::225::IOProcess::(_processLogs) (10234) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:09,335::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:09,335::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:10:09,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:09,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896723 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:10:11,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:11,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895335 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:11,880::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:11,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4813::DEBUG::2014-09-09 12:10:11,881::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) (10235) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:11,902::__init__::225::IOProcess::(_processLogs) (10235) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:11,903::__init__::225::IOProcess::(_processLogs) DEBUG|(10235) Building response >Thread-19::DEBUG::2014-09-09 12:10:11,903::__init__::225::IOProcess::(_processLogs) (10235) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:11,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:11,904::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:10:11,904::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:10:11,912::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110661 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:11,912::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) (10236) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) (10236) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) DEBUG|(10236) Building response >Thread-19::DEBUG::2014-09-09 12:10:11,913::__init__::225::IOProcess::(_processLogs) (10236) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:11,914::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:11,914::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:13,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:13,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895847 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:13,917::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:13,918::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4814::DEBUG::2014-09-09 12:10:13,918::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4814::DEBUG::2014-09-09 12:10:13,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d310b2b-16b6-4e78-95e0-bb4c3b3afc05`::moving from state init -> state preparing >Thread-4814::INFO::2014-09-09 12:10:13,919::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4814::INFO::2014-09-09 12:10:13,919::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4814::DEBUG::2014-09-09 12:10:13,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d310b2b-16b6-4e78-95e0-bb4c3b3afc05`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4814::DEBUG::2014-09-09 12:10:13,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d310b2b-16b6-4e78-95e0-bb4c3b3afc05`::moving from state preparing -> state finished >Thread-4814::DEBUG::2014-09-09 12:10:13,920::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4814::DEBUG::2014-09-09 12:10:13,920::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4814::DEBUG::2014-09-09 12:10:13,920::task::993::Storage.TaskManager.Task::(_decref) Task=`7d310b2b-16b6-4e78-95e0-bb4c3b3afc05`::ref 0 aborting False >Thread-4814::DEBUG::2014-09-09 12:10:13,920::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4814::DEBUG::2014-09-09 12:10:13,920::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:13,975::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:13,976::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4815::DEBUG::2014-09-09 12:10:13,976::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4815::DEBUG::2014-09-09 12:10:13,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`b46cb64d-92f4-46a3-bd43-a112f572e50b`::moving from state init -> state preparing >Thread-4815::INFO::2014-09-09 12:10:13,977::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4815::DEBUG::2014-09-09 12:10:13,977::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c24a9e31-501d-443f-a91b-710e28794681`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4815::DEBUG::2014-09-09 12:10:13,977::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4815::DEBUG::2014-09-09 12:10:13,977::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4815::DEBUG::2014-09-09 12:10:13,977::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c24a9e31-501d-443f-a91b-710e28794681`::Granted request >Thread-4815::DEBUG::2014-09-09 12:10:13,977::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b46cb64d-92f4-46a3-bd43-a112f572e50b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4815::DEBUG::2014-09-09 12:10:13,978::task::993::Storage.TaskManager.Task::(_decref) Task=`b46cb64d-92f4-46a3-bd43-a112f572e50b`::ref 1 aborting False >Thread-4815::INFO::2014-09-09 12:10:13,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4815::DEBUG::2014-09-09 12:10:13,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`b46cb64d-92f4-46a3-bd43-a112f572e50b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4815::DEBUG::2014-09-09 12:10:13,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`b46cb64d-92f4-46a3-bd43-a112f572e50b`::moving from state preparing -> state finished >Thread-4815::DEBUG::2014-09-09 12:10:13,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4815::DEBUG::2014-09-09 12:10:13,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4815::DEBUG::2014-09-09 12:10:13,980::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4815::DEBUG::2014-09-09 12:10:13,980::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4815::DEBUG::2014-09-09 12:10:13,980::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4815::DEBUG::2014-09-09 12:10:13,980::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4815::DEBUG::2014-09-09 12:10:13,980::task::993::Storage.TaskManager.Task::(_decref) Task=`b46cb64d-92f4-46a3-bd43-a112f572e50b`::ref 0 aborting False >Thread-4815::DEBUG::2014-09-09 12:10:13,980::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283542290432', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4815::DEBUG::2014-09-09 12:10:13,980::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:14,887::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:14,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4816::DEBUG::2014-09-09 12:10:14,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:15,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:15,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896051 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:16,277::__init__::225::IOProcess::(_processLogs) (10237) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:16,278::__init__::225::IOProcess::(_processLogs) (10237) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:16,278::__init__::225::IOProcess::(_processLogs) DEBUG|(10237) Building response >Thread-3443::DEBUG::2014-09-09 12:10:16,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:16,278::__init__::225::IOProcess::(_processLogs) (10237) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:16,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:16,284::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:10:16,286::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000878762 s, 404 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:16,286::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:16,286::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) (10238) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) (10238) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) (10238) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:16,287::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:17,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:17,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:17,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4817::DEBUG::2014-09-09 12:10:17,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bca869d-097d-4dae-97c8-32e8f7fe7270`::moving from state init -> state preparing >Thread-4817::INFO::2014-09-09 12:10:17,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4817::INFO::2014-09-09 12:10:17,900::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110661', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878418', 'lastCheck': '8.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878762', 'lastCheck': '1.6', 'valid': True}} >Thread-4817::DEBUG::2014-09-09 12:10:17,900::task::1191::Storage.TaskManager.Task::(prepare) Task=`3bca869d-097d-4dae-97c8-32e8f7fe7270`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110661', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878418', 'lastCheck': '8.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000878762', 'lastCheck': '1.6', 'valid': True}} >Thread-4817::DEBUG::2014-09-09 12:10:17,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bca869d-097d-4dae-97c8-32e8f7fe7270`::moving from state preparing -> state finished >Thread-4817::DEBUG::2014-09-09 12:10:17,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4817::DEBUG::2014-09-09 12:10:17,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4817::DEBUG::2014-09-09 12:10:17,900::task::993::Storage.TaskManager.Task::(_decref) Task=`3bca869d-097d-4dae-97c8-32e8f7fe7270`::ref 0 aborting False >Thread-4817::DEBUG::2014-09-09 12:10:17,901::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:17,915::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:17,916::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4818::DEBUG::2014-09-09 12:10:17,917::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:17,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895778 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:19,336::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:19,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:19,337::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:19,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:19,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:19,339::__init__::225::IOProcess::(_processLogs) (10239) Finding callback 'statvfs'... >Thread-24::DEBUG::2014-09-09 12:10:19,340::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:19,340::__init__::225::IOProcess::(_processLogs) (10239) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:19,346::__init__::225::IOProcess::(_processLogs) (10239) Building response >Thread-19::DEBUG::2014-09-09 12:10:19,347::__init__::225::IOProcess::(_processLogs) (10239) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:19,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:19,347::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:10:19,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000886739 s, 618 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:19,351::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:19,352::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:19,352::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:19,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:19,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:19,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:19,355::__init__::225::IOProcess::(_processLogs) (10240) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:19,355::__init__::225::IOProcess::(_processLogs) (10240) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:19,356::__init__::225::IOProcess::(_processLogs) (10240) Building response >Thread-19::DEBUG::2014-09-09 12:10:19,356::__init__::225::IOProcess::(_processLogs) (10240) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:19,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:19,357::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:19,358::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:19,358::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:10:19,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:19,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:19,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:19,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:19,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:19,361::__init__::225::IOProcess::(_processLogs) (10241) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:19,362::__init__::225::IOProcess::(_processLogs) (10241) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:19,362::__init__::225::IOProcess::(_processLogs) (10241) Building response >Thread-19::DEBUG::2014-09-09 12:10:19,363::__init__::225::IOProcess::(_processLogs) (10241) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:19,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:19,364::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:19,364::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:10:19,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:19,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:19,366::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:19,366::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:19,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:19,367::__init__::225::IOProcess::(_processLogs) (10242) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:19,368::__init__::225::IOProcess::(_processLogs) (10242) Building response >Thread-19::DEBUG::2014-09-09 12:10:19,368::__init__::225::IOProcess::(_processLogs) (10242) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:19,369::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:19,369::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:19,370::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:10:19,370::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:19,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:19,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:19,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:19,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:19,373::__init__::225::IOProcess::(_processLogs) (10243) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:19,373::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:19,374::__init__::225::IOProcess::(_processLogs) (10243) Building response >Thread-19::DEBUG::2014-09-09 12:10:19,375::__init__::225::IOProcess::(_processLogs) (10243) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:19,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:19,376::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:10:19,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:20,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.094237 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:21,004::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:21,005::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4819::DEBUG::2014-09-09 12:10:21,006::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:21,915::__init__::225::IOProcess::(_processLogs) (10244) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:21,916::__init__::225::IOProcess::(_processLogs) (10244) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:21,916::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|(10244) Building response >Thread-19::DEBUG::2014-09-09 12:10:21,916::__init__::225::IOProcess::(_processLogs) (10244) Queuing response >Thread-23::DEBUG::2014-09-09 12:10:21,916::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:21,917::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:21,922::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:10:21,924::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00101908 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:21,924::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:21,924::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:21,924::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) (10245) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) (10245) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|(10245) Building response >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) (10245) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:21,925::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:21,926::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:22,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:22,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896777 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:24,013::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:24,014::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4820::DEBUG::2014-09-09 12:10:24,015::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:24,018::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4821::DEBUG::2014-09-09 12:10:24,019::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:10:24,019::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4821::DEBUG::2014-09-09 12:10:24,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`76f89129-f697-4f41-afb5-033ca3cc7214`::moving from state init -> state preparing >Thread-4821::INFO::2014-09-09 12:10:24,020::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4821::INFO::2014-09-09 12:10:24,020::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4821::DEBUG::2014-09-09 12:10:24,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`76f89129-f697-4f41-afb5-033ca3cc7214`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4821::DEBUG::2014-09-09 12:10:24,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`76f89129-f697-4f41-afb5-033ca3cc7214`::moving from state preparing -> state finished >Thread-4821::DEBUG::2014-09-09 12:10:24,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4821::DEBUG::2014-09-09 12:10:24,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4821::DEBUG::2014-09-09 12:10:24,020::task::993::Storage.TaskManager.Task::(_decref) Task=`76f89129-f697-4f41-afb5-033ca3cc7214`::ref 0 aborting False >Thread-4821::DEBUG::2014-09-09 12:10:24,020::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4821::DEBUG::2014-09-09 12:10:24,021::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:24,042::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4822::DEBUG::2014-09-09 12:10:24,042::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:10:24,042::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4822::DEBUG::2014-09-09 12:10:24,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`875fd8b3-7230-43e2-921a-b75903d99216`::moving from state init -> state preparing >Thread-4822::INFO::2014-09-09 12:10:24,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4822::DEBUG::2014-09-09 12:10:24,044::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`43956b3b-eedc-4d67-8a19-3b6652a8220d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4822::DEBUG::2014-09-09 12:10:24,044::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4822::DEBUG::2014-09-09 12:10:24,044::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4822::DEBUG::2014-09-09 12:10:24,044::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`43956b3b-eedc-4d67-8a19-3b6652a8220d`::Granted request >Thread-4822::DEBUG::2014-09-09 12:10:24,044::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`875fd8b3-7230-43e2-921a-b75903d99216`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4822::DEBUG::2014-09-09 12:10:24,044::task::993::Storage.TaskManager.Task::(_decref) Task=`875fd8b3-7230-43e2-921a-b75903d99216`::ref 1 aborting False >Thread-4822::INFO::2014-09-09 12:10:24,046::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4822::DEBUG::2014-09-09 12:10:24,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`875fd8b3-7230-43e2-921a-b75903d99216`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4822::DEBUG::2014-09-09 12:10:24,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`875fd8b3-7230-43e2-921a-b75903d99216`::moving from state preparing -> state finished >Thread-4822::DEBUG::2014-09-09 12:10:24,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4822::DEBUG::2014-09-09 12:10:24,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4822::DEBUG::2014-09-09 12:10:24,046::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4822::DEBUG::2014-09-09 12:10:24,046::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4822::DEBUG::2014-09-09 12:10:24,046::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4822::DEBUG::2014-09-09 12:10:24,047::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4822::DEBUG::2014-09-09 12:10:24,047::task::993::Storage.TaskManager.Task::(_decref) Task=`875fd8b3-7230-43e2-921a-b75903d99216`::ref 0 aborting False >Thread-4822::DEBUG::2014-09-09 12:10:24,047::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4822::DEBUG::2014-09-09 12:10:24,047::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:24,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:24,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896564 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) (10246) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) (10246) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|(10246) Building response >Thread-19::DEBUG::2014-09-09 12:10:26,289::__init__::225::IOProcess::(_processLogs) (10246) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:26,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:26,290::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:10:26,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:10:26,297::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000895059 s, 397 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) (10247) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) (10247) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:26,298::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|(10247) Building response >Thread-19::DEBUG::2014-09-09 12:10:26,299::__init__::225::IOProcess::(_processLogs) (10247) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:26,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:26,299::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:26,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:26,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896468 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:27,022::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:27,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4823::DEBUG::2014-09-09 12:10:27,024::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:28,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:28,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08968 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) (10248) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:29,375::__init__::225::IOProcess::(_processLogs) (10248) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:29,376::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|(10248) Building response >Thread-19::DEBUG::2014-09-09 12:10:29,376::__init__::225::IOProcess::(_processLogs) (10248) Queuing response >Thread-24::DEBUG::2014-09-09 12:10:29,376::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:29,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:29,382::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:10:29,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000953726 s, 575 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) (10249) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:29,385::__init__::225::IOProcess::(_processLogs) (10249) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:29,386::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|(10249) Building response >Thread-19::DEBUG::2014-09-09 12:10:29,386::__init__::225::IOProcess::(_processLogs) (10249) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:29,386::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:29,386::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:29,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) (10250) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) (10250) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) (10250) Building response >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) (10250) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:10:29,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) (10251) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) (10251) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) (10251) Building response >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) (10251) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:29,389::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:29,390::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:29,390::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:10:29,390::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:29,390::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:29,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:29,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) (10252) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) (10252) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) (10252) Building response >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) (10252) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:29,391::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:30,030::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:30,031::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4824::DEBUG::2014-09-09 12:10:30,032::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:30,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:30,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896841 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) (10243) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) (10253) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:31,927::__init__::225::IOProcess::(_processLogs) (10253) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:31,928::__init__::225::IOProcess::(_processLogs) DEBUG|(10253) Building response >Thread-23::DEBUG::2014-09-09 12:10:31,928::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:31,928::__init__::225::IOProcess::(_processLogs) (10253) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:31,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:31,934::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:10:31,936::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00100796 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:31,936::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:31,936::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:31,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:31,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:31,937::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:31,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:31,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:31,937::__init__::225::IOProcess::(_processLogs) (10254) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:31,937::__init__::225::IOProcess::(_processLogs) (10254) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:31,937::__init__::225::IOProcess::(_processLogs) DEBUG|(10254) Building response >Thread-19::DEBUG::2014-09-09 12:10:31,938::__init__::225::IOProcess::(_processLogs) (10254) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:31,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:31,938::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:32,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:32,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895324 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:33,039::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:33,040::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4825::DEBUG::2014-09-09 12:10:33,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce404385-c042-4fa2-b62d-9d3f44999faa`::moving from state init -> state preparing >Thread-4825::INFO::2014-09-09 12:10:33,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4825::INFO::2014-09-09 12:10:33,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100796', 'lastCheck': '1.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000953726', 'lastCheck': '3.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895059', 'lastCheck': '6.7', 'valid': True}} >Thread-4825::DEBUG::2014-09-09 12:10:33,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce404385-c042-4fa2-b62d-9d3f44999faa`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100796', 'lastCheck': '1.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000953726', 'lastCheck': '3.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895059', 'lastCheck': '6.7', 'valid': True}} >Thread-4825::DEBUG::2014-09-09 12:10:33,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce404385-c042-4fa2-b62d-9d3f44999faa`::moving from state preparing -> state finished >Thread-4825::DEBUG::2014-09-09 12:10:33,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4825::DEBUG::2014-09-09 12:10:33,041::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4825::DEBUG::2014-09-09 12:10:33,042::task::993::Storage.TaskManager.Task::(_decref) Task=`ce404385-c042-4fa2-b62d-9d3f44999faa`::ref 0 aborting False >Thread-4825::DEBUG::2014-09-09 12:10:33,042::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:33,053::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:33,054::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4826::DEBUG::2014-09-09 12:10:33,054::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:34,135::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4827::DEBUG::2014-09-09 12:10:34,135::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:10:34,135::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4827::DEBUG::2014-09-09 12:10:34,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`79db5165-ec99-4457-96eb-3f94e3963bef`::moving from state init -> state preparing >Thread-4827::INFO::2014-09-09 12:10:34,136::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4827::INFO::2014-09-09 12:10:34,136::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4827::DEBUG::2014-09-09 12:10:34,137::task::1191::Storage.TaskManager.Task::(prepare) Task=`79db5165-ec99-4457-96eb-3f94e3963bef`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4827::DEBUG::2014-09-09 12:10:34,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`79db5165-ec99-4457-96eb-3f94e3963bef`::moving from state preparing -> state finished >Thread-4827::DEBUG::2014-09-09 12:10:34,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4827::DEBUG::2014-09-09 12:10:34,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4827::DEBUG::2014-09-09 12:10:34,137::task::993::Storage.TaskManager.Task::(_decref) Task=`79db5165-ec99-4457-96eb-3f94e3963bef`::ref 0 aborting False >Thread-4827::DEBUG::2014-09-09 12:10:34,137::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4827::DEBUG::2014-09-09 12:10:34,137::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:34,201::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:34,202::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4828::DEBUG::2014-09-09 12:10:34,202::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4828::DEBUG::2014-09-09 12:10:34,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`f754091a-d820-4c41-9260-c68ee14cd382`::moving from state init -> state preparing >Thread-4828::INFO::2014-09-09 12:10:34,202::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4828::DEBUG::2014-09-09 12:10:34,203::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`340ac7f0-4430-4712-8ecb-fa091d2230be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4828::DEBUG::2014-09-09 12:10:34,203::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4828::DEBUG::2014-09-09 12:10:34,203::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4828::DEBUG::2014-09-09 12:10:34,203::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`340ac7f0-4430-4712-8ecb-fa091d2230be`::Granted request >Thread-4828::DEBUG::2014-09-09 12:10:34,203::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f754091a-d820-4c41-9260-c68ee14cd382`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4828::DEBUG::2014-09-09 12:10:34,203::task::993::Storage.TaskManager.Task::(_decref) Task=`f754091a-d820-4c41-9260-c68ee14cd382`::ref 1 aborting False >Thread-4828::INFO::2014-09-09 12:10:34,205::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4828::DEBUG::2014-09-09 12:10:34,205::task::1191::Storage.TaskManager.Task::(prepare) Task=`f754091a-d820-4c41-9260-c68ee14cd382`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4828::DEBUG::2014-09-09 12:10:34,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`f754091a-d820-4c41-9260-c68ee14cd382`::moving from state preparing -> state finished >Thread-4828::DEBUG::2014-09-09 12:10:34,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4828::DEBUG::2014-09-09 12:10:34,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4828::DEBUG::2014-09-09 12:10:34,205::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4828::DEBUG::2014-09-09 12:10:34,206::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4828::DEBUG::2014-09-09 12:10:34,206::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4828::DEBUG::2014-09-09 12:10:34,206::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4828::DEBUG::2014-09-09 12:10:34,206::task::993::Storage.TaskManager.Task::(_decref) Task=`f754091a-d820-4c41-9260-c68ee14cd382`::ref 0 aborting False >Thread-4828::DEBUG::2014-09-09 12:10:34,206::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4828::DEBUG::2014-09-09 12:10:34,206::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:34,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:34,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895973 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:36,300::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:36,300::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:36,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:36,300::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:36,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:36,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:36,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:36,301::__init__::225::IOProcess::(_processLogs) (10255) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:36,301::__init__::225::IOProcess::(_processLogs) (10255) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:36,303::__init__::225::IOProcess::(_processLogs) DEBUG|(10255) Building response >Thread-19::DEBUG::2014-09-09 12:10:36,303::__init__::225::IOProcess::(_processLogs) (10255) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:36,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:36,303::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:10:36,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:10:36,311::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000827848 s, 429 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) (10256) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) (10256) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:36,312::__init__::225::IOProcess::(_processLogs) DEBUG|(10256) Building response >Thread-19::DEBUG::2014-09-09 12:10:36,313::__init__::225::IOProcess::(_processLogs) (10256) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:36,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:36,313::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:36,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:36,450::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4829::DEBUG::2014-09-09 12:10:36,452::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:36,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:36,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895855 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:10:39,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:39,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896111 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:39,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:39,392::__init__::225::IOProcess::(_processLogs) (10257) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:39,392::__init__::225::IOProcess::(_processLogs) (10257) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:39,392::__init__::225::IOProcess::(_processLogs) DEBUG|(10257) Building response >Thread-19::DEBUG::2014-09-09 12:10:39,392::__init__::225::IOProcess::(_processLogs) (10257) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:39,392::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:39,392::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:10:39,393::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:10:39,400::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00096417 s, 568 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) (10258) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:39,401::__init__::225::IOProcess::(_processLogs) (10258) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:39,402::__init__::225::IOProcess::(_processLogs) DEBUG|(10258) Building response >Thread-19::DEBUG::2014-09-09 12:10:39,402::__init__::225::IOProcess::(_processLogs) (10258) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:39,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:39,402::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:39,403::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:39,403::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:10:39,403::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:39,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) (10259) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) (10259) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) (10259) Building response >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) (10259) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:39,404::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) (10260) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) (10260) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) (10260) Building response >Thread-19::DEBUG::2014-09-09 12:10:39,405::__init__::225::IOProcess::(_processLogs) (10260) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:39,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:39,406::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:39,406::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:39,406::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:10:39,406::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) (10261) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) (10261) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) (10261) Building response >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) (10261) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:39,407::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:39,460::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:39,460::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4830::DEBUG::2014-09-09 12:10:39,461::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:41,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:41,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089724 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:41,938::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:41,938::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) (10262) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:41,939::__init__::225::IOProcess::(_processLogs) (10262) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:41,940::__init__::225::IOProcess::(_processLogs) DEBUG|(10262) Building response >Thread-19::DEBUG::2014-09-09 12:10:41,940::__init__::225::IOProcess::(_processLogs) (10262) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:41,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:41,940::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:10:41,941::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:10:41,949::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111692 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:41,949::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:41,949::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:41,949::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) (10263) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) (10263) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) DEBUG|(10263) Building response >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) (10263) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:41,950::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:41,951::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:42,468::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:42,469::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4831::DEBUG::2014-09-09 12:10:42,470::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:43,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:43,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896419 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:44,446::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:44,447::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4832::DEBUG::2014-09-09 12:10:44,447::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4832::DEBUG::2014-09-09 12:10:44,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a7e3cc1-6488-4cff-aec2-7cbb3881d5aa`::moving from state init -> state preparing >Thread-4832::INFO::2014-09-09 12:10:44,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4832::INFO::2014-09-09 12:10:44,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4832::DEBUG::2014-09-09 12:10:44,448::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a7e3cc1-6488-4cff-aec2-7cbb3881d5aa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4832::DEBUG::2014-09-09 12:10:44,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a7e3cc1-6488-4cff-aec2-7cbb3881d5aa`::moving from state preparing -> state finished >Thread-4832::DEBUG::2014-09-09 12:10:44,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4832::DEBUG::2014-09-09 12:10:44,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4832::DEBUG::2014-09-09 12:10:44,449::task::993::Storage.TaskManager.Task::(_decref) Task=`3a7e3cc1-6488-4cff-aec2-7cbb3881d5aa`::ref 0 aborting False >Thread-4832::DEBUG::2014-09-09 12:10:44,449::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4832::DEBUG::2014-09-09 12:10:44,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:44,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:44,486::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4833::DEBUG::2014-09-09 12:10:44,486::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4833::DEBUG::2014-09-09 12:10:44,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`44ae189a-667e-485f-82a0-0713e650cba9`::moving from state init -> state preparing >Thread-4833::INFO::2014-09-09 12:10:44,487::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4833::DEBUG::2014-09-09 12:10:44,487::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ce793f05-5fb3-4993-adb8-dee4e2d81cc9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4833::DEBUG::2014-09-09 12:10:44,487::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4833::DEBUG::2014-09-09 12:10:44,487::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4833::DEBUG::2014-09-09 12:10:44,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ce793f05-5fb3-4993-adb8-dee4e2d81cc9`::Granted request >Thread-4833::DEBUG::2014-09-09 12:10:44,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44ae189a-667e-485f-82a0-0713e650cba9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4833::DEBUG::2014-09-09 12:10:44,488::task::993::Storage.TaskManager.Task::(_decref) Task=`44ae189a-667e-485f-82a0-0713e650cba9`::ref 1 aborting False >Thread-4833::INFO::2014-09-09 12:10:44,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4833::DEBUG::2014-09-09 12:10:44,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`44ae189a-667e-485f-82a0-0713e650cba9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4833::DEBUG::2014-09-09 12:10:44,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`44ae189a-667e-485f-82a0-0713e650cba9`::moving from state preparing -> state finished >Thread-4833::DEBUG::2014-09-09 12:10:44,490::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4833::DEBUG::2014-09-09 12:10:44,490::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4833::DEBUG::2014-09-09 12:10:44,490::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4833::DEBUG::2014-09-09 12:10:44,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4833::DEBUG::2014-09-09 12:10:44,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4833::DEBUG::2014-09-09 12:10:44,490::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4833::DEBUG::2014-09-09 12:10:44,490::task::993::Storage.TaskManager.Task::(_decref) Task=`44ae189a-667e-485f-82a0-0713e650cba9`::ref 0 aborting False >Thread-4833::DEBUG::2014-09-09 12:10:44,490::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4833::DEBUG::2014-09-09 12:10:44,490::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:45,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:45,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895301 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:45,475::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:45,476::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4834::DEBUG::2014-09-09 12:10:45,477::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:10:46,314::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:46,314::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:46,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:46,314::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) (10264) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) (10264) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) DEBUG|(10264) Building response >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) (10264) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:46,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:46,316::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:10:46,316::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:10:46,323::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000814289 s, 436 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:46,323::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) (10265) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:46,324::__init__::225::IOProcess::(_processLogs) (10265) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:46,325::__init__::225::IOProcess::(_processLogs) DEBUG|(10265) Building response >Thread-19::DEBUG::2014-09-09 12:10:46,325::__init__::225::IOProcess::(_processLogs) (10265) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:46,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:46,325::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:47,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:47,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896249 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:48,483::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:48,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4835::DEBUG::2014-09-09 12:10:48,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bb08e10-7b89-4369-b86e-c97b150ca7ec`::moving from state init -> state preparing >Thread-4835::INFO::2014-09-09 12:10:48,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4835::INFO::2014-09-09 12:10:48,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111692', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096417', 'lastCheck': '9.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000814289', 'lastCheck': '2.2', 'valid': True}} >Thread-4835::DEBUG::2014-09-09 12:10:48,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bb08e10-7b89-4369-b86e-c97b150ca7ec`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111692', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00096417', 'lastCheck': '9.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000814289', 'lastCheck': '2.2', 'valid': True}} >Thread-4835::DEBUG::2014-09-09 12:10:48,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bb08e10-7b89-4369-b86e-c97b150ca7ec`::moving from state preparing -> state finished >Thread-4835::DEBUG::2014-09-09 12:10:48,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4835::DEBUG::2014-09-09 12:10:48,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4835::DEBUG::2014-09-09 12:10:48,486::task::993::Storage.TaskManager.Task::(_decref) Task=`4bb08e10-7b89-4369-b86e-c97b150ca7ec`::ref 0 aborting False >Thread-4835::DEBUG::2014-09-09 12:10:48,487::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:48,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:48,498::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4836::DEBUG::2014-09-09 12:10:48,499::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:10:49,407::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:49,408::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:49,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:49,409::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:49,410::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-24::DEBUG::2014-09-09 12:10:49,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:49,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:49,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:49,417::__init__::225::IOProcess::(_processLogs) (10266) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:49,418::__init__::225::IOProcess::(_processLogs) (10266) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:49,419::__init__::225::IOProcess::(_processLogs) (10266) Building response >Thread-19::DEBUG::2014-09-09 12:10:49,419::__init__::225::IOProcess::(_processLogs) (10266) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:49,420::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:10:49,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000984609 s, 557 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:49,421::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:49,422::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:49,423::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:49,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:49,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:49,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:49,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:49,426::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:49,426::__init__::225::IOProcess::(_processLogs) (10267) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:49,427::__init__::225::IOProcess::(_processLogs) (10267) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:49,427::__init__::225::IOProcess::(_processLogs) (10267) Building response >Thread-19::DEBUG::2014-09-09 12:10:49,428::__init__::225::IOProcess::(_processLogs) (10267) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:49,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:49,429::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:49,430::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:49,430::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:10:49,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:49,431::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:49,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:49,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:49,433::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:49,433::__init__::225::IOProcess::(_processLogs) (10268) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:49,434::__init__::225::IOProcess::(_processLogs) (10268) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:49,434::__init__::225::IOProcess::(_processLogs) (10268) Building response >Thread-19::DEBUG::2014-09-09 12:10:49,435::__init__::225::IOProcess::(_processLogs) (10268) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:49,435::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:49,436::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:49,436::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:49,437::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:10:49,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:49,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:49,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:49,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:49,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:49,440::__init__::225::IOProcess::(_processLogs) (10269) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:49,440::__init__::225::IOProcess::(_processLogs) DEBUG|(10269) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:49,441::__init__::225::IOProcess::(_processLogs) (10269) Building response >Thread-19::DEBUG::2014-09-09 12:10:49,442::__init__::225::IOProcess::(_processLogs) (10269) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:49,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:49,443::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:49,443::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:49,444::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:10:49,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:49,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:49,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:49,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:49,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:49,447::__init__::225::IOProcess::(_processLogs) (10270) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:49,447::__init__::225::IOProcess::(_processLogs) (10270) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:49,448::__init__::225::IOProcess::(_processLogs) (10270) Building response >Thread-19::DEBUG::2014-09-09 12:10:49,448::__init__::225::IOProcess::(_processLogs) (10270) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:49,449::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:49,450::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:10:49,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:49,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0941833 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:51,600::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:51,601::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4837::DEBUG::2014-09-09 12:10:51,602::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:51,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:51,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896638 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) (10271) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) (10271) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:51,952::__init__::225::IOProcess::(_processLogs) DEBUG|(10271) Building response >Thread-19::DEBUG::2014-09-09 12:10:51,953::__init__::225::IOProcess::(_processLogs) (10271) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:51,953::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:51,953::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:10:51,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:10:51,960::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112334 s, 1000 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:51,961::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:51,962::__init__::225::IOProcess::(_processLogs) (10272) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:51,962::__init__::225::IOProcess::(_processLogs) (10272) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:51,962::__init__::225::IOProcess::(_processLogs) DEBUG|(10272) Building response >Thread-19::DEBUG::2014-09-09 12:10:51,962::__init__::225::IOProcess::(_processLogs) (10272) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:51,962::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:10:51,963::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:10:53,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:53,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897282 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:54,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:54,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4838::DEBUG::2014-09-09 12:10:54,529::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4838::DEBUG::2014-09-09 12:10:54,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68784ad-0837-46a9-a0bd-45b010b37bae`::moving from state init -> state preparing >Thread-4838::INFO::2014-09-09 12:10:54,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4838::INFO::2014-09-09 12:10:54,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4838::DEBUG::2014-09-09 12:10:54,530::task::1191::Storage.TaskManager.Task::(prepare) Task=`f68784ad-0837-46a9-a0bd-45b010b37bae`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4838::DEBUG::2014-09-09 12:10:54,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68784ad-0837-46a9-a0bd-45b010b37bae`::moving from state preparing -> state finished >Thread-4838::DEBUG::2014-09-09 12:10:54,530::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4838::DEBUG::2014-09-09 12:10:54,530::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4838::DEBUG::2014-09-09 12:10:54,530::task::993::Storage.TaskManager.Task::(_decref) Task=`f68784ad-0837-46a9-a0bd-45b010b37bae`::ref 0 aborting False >Thread-4838::DEBUG::2014-09-09 12:10:54,531::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4838::DEBUG::2014-09-09 12:10:54,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:54,578::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:54,578::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4839::DEBUG::2014-09-09 12:10:54,578::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4839::DEBUG::2014-09-09 12:10:54,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c5d79e5-6e57-4d62-900f-26685f9d7605`::moving from state init -> state preparing >Thread-4839::INFO::2014-09-09 12:10:54,579::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4839::DEBUG::2014-09-09 12:10:54,579::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c8099bf3-9792-4004-b33b-2b8c25b11fab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4839::DEBUG::2014-09-09 12:10:54,579::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4839::DEBUG::2014-09-09 12:10:54,580::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4839::DEBUG::2014-09-09 12:10:54,580::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c8099bf3-9792-4004-b33b-2b8c25b11fab`::Granted request >Thread-4839::DEBUG::2014-09-09 12:10:54,580::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0c5d79e5-6e57-4d62-900f-26685f9d7605`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4839::DEBUG::2014-09-09 12:10:54,580::task::993::Storage.TaskManager.Task::(_decref) Task=`0c5d79e5-6e57-4d62-900f-26685f9d7605`::ref 1 aborting False >Thread-4839::INFO::2014-09-09 12:10:54,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4839::DEBUG::2014-09-09 12:10:54,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c5d79e5-6e57-4d62-900f-26685f9d7605`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4839::DEBUG::2014-09-09 12:10:54,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c5d79e5-6e57-4d62-900f-26685f9d7605`::moving from state preparing -> state finished >Thread-4839::DEBUG::2014-09-09 12:10:54,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4839::DEBUG::2014-09-09 12:10:54,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4839::DEBUG::2014-09-09 12:10:54,582::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4839::DEBUG::2014-09-09 12:10:54,582::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4839::DEBUG::2014-09-09 12:10:54,582::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4839::DEBUG::2014-09-09 12:10:54,582::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4839::DEBUG::2014-09-09 12:10:54,583::task::993::Storage.TaskManager.Task::(_decref) Task=`0c5d79e5-6e57-4d62-900f-26685f9d7605`::ref 0 aborting False >Thread-4839::DEBUG::2014-09-09 12:10:54,583::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4839::DEBUG::2014-09-09 12:10:54,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:54,608::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:54,609::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4840::DEBUG::2014-09-09 12:10:54,609::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:55,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:56,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899391 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) (10273) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:56,326::__init__::225::IOProcess::(_processLogs) (10273) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:56,327::__init__::225::IOProcess::(_processLogs) DEBUG|(10273) Building response >Thread-19::DEBUG::2014-09-09 12:10:56,327::__init__::225::IOProcess::(_processLogs) (10273) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:56,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:56,327::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:10:56,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:10:56,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000966151 s, 367 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) (10274) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:56,335::__init__::225::IOProcess::(_processLogs) (10274) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:56,336::__init__::225::IOProcess::(_processLogs) (10274) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:56,336::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:10:57,618::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:10:57,619::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4841::DEBUG::2014-09-09 12:10:57,620::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:10:58,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:10:58,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895112 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:59,450::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:59,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:59,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:59,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:59,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:59,451::__init__::225::IOProcess::(_processLogs) (10275) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:59,451::__init__::225::IOProcess::(_processLogs) (10275) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:59,451::__init__::225::IOProcess::(_processLogs) (10275) Queuing response >Thread-24::DEBUG::2014-09-09 12:10:59,452::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:10:59,452::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:59,457::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:10:59,460::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000922982 s, 594 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) (10276) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:10:59,461::__init__::225::IOProcess::(_processLogs) (10276) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:10:59,462::__init__::225::IOProcess::(_processLogs) (10276) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:59,462::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:10:59,462::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) (10277) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) (10277) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) (10277) Building response >Thread-19::DEBUG::2014-09-09 12:10:59,463::__init__::225::IOProcess::(_processLogs) (10277) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:59,464::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) (10278) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) (10278) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) (10278) Building response >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) (10278) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:10:59,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) (10279) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) (10279) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) (10279) Building response >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) (10279) Queuing response >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:10:59,466::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:11:00,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:00,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897544 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:00,627::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:00,628::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4842::DEBUG::2014-09-09 12:11:00,628::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:01,963::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:01,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) (10280) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) (10280) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) (10280) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:01,964::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:11:01,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:11:01,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109498 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:01,973::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:01,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:01,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:01,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:01,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:01,974::__init__::225::IOProcess::(_processLogs) (10281) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:01,974::__init__::225::IOProcess::(_processLogs) (10281) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:01,974::__init__::225::IOProcess::(_processLogs) (10281) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:01,974::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:02,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:02,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898048 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:03,634::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:03,634::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4843::DEBUG::2014-09-09 12:11:03,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`b75c243c-e839-4fcb-bdf8-5df3da3db416`::moving from state init -> state preparing >Thread-4843::INFO::2014-09-09 12:11:03,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4843::INFO::2014-09-09 12:11:03,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109498', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000922982', 'lastCheck': '4.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966151', 'lastCheck': '7.3', 'valid': True}} >Thread-4843::DEBUG::2014-09-09 12:11:03,636::task::1191::Storage.TaskManager.Task::(prepare) Task=`b75c243c-e839-4fcb-bdf8-5df3da3db416`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109498', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000922982', 'lastCheck': '4.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000966151', 'lastCheck': '7.3', 'valid': True}} >Thread-4843::DEBUG::2014-09-09 12:11:03,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`b75c243c-e839-4fcb-bdf8-5df3da3db416`::moving from state preparing -> state finished >Thread-4843::DEBUG::2014-09-09 12:11:03,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4843::DEBUG::2014-09-09 12:11:03,636::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4843::DEBUG::2014-09-09 12:11:03,636::task::993::Storage.TaskManager.Task::(_decref) Task=`b75c243c-e839-4fcb-bdf8-5df3da3db416`::ref 0 aborting False >Thread-4843::DEBUG::2014-09-09 12:11:03,637::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:03,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:03,649::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4844::DEBUG::2014-09-09 12:11:03,650::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:04,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:04,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895396 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:04,622::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:04,623::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4845::DEBUG::2014-09-09 12:11:04,623::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4845::DEBUG::2014-09-09 12:11:04,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`1df76272-ff7f-4f2d-aa0f-4a4f70b55a0b`::moving from state init -> state preparing >Thread-4845::INFO::2014-09-09 12:11:04,624::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4845::INFO::2014-09-09 12:11:04,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4845::DEBUG::2014-09-09 12:11:04,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`1df76272-ff7f-4f2d-aa0f-4a4f70b55a0b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4845::DEBUG::2014-09-09 12:11:04,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`1df76272-ff7f-4f2d-aa0f-4a4f70b55a0b`::moving from state preparing -> state finished >Thread-4845::DEBUG::2014-09-09 12:11:04,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4845::DEBUG::2014-09-09 12:11:04,625::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4845::DEBUG::2014-09-09 12:11:04,625::task::993::Storage.TaskManager.Task::(_decref) Task=`1df76272-ff7f-4f2d-aa0f-4a4f70b55a0b`::ref 0 aborting False >Thread-4845::DEBUG::2014-09-09 12:11:04,625::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4845::DEBUG::2014-09-09 12:11:04,625::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:04,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:04,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4846::DEBUG::2014-09-09 12:11:04,679::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4846::DEBUG::2014-09-09 12:11:04,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`2906d5ae-6084-4769-ab4f-93e23c5b3264`::moving from state init -> state preparing >Thread-4846::INFO::2014-09-09 12:11:04,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4846::DEBUG::2014-09-09 12:11:04,681::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`06f3d873-f6f8-49d1-b807-2e3588a4958d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4846::DEBUG::2014-09-09 12:11:04,681::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4846::DEBUG::2014-09-09 12:11:04,681::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4846::DEBUG::2014-09-09 12:11:04,681::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`06f3d873-f6f8-49d1-b807-2e3588a4958d`::Granted request >Thread-4846::DEBUG::2014-09-09 12:11:04,681::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2906d5ae-6084-4769-ab4f-93e23c5b3264`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4846::DEBUG::2014-09-09 12:11:04,681::task::993::Storage.TaskManager.Task::(_decref) Task=`2906d5ae-6084-4769-ab4f-93e23c5b3264`::ref 1 aborting False >Thread-4846::INFO::2014-09-09 12:11:04,683::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4846::DEBUG::2014-09-09 12:11:04,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`2906d5ae-6084-4769-ab4f-93e23c5b3264`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4846::DEBUG::2014-09-09 12:11:04,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`2906d5ae-6084-4769-ab4f-93e23c5b3264`::moving from state preparing -> state finished >Thread-4846::DEBUG::2014-09-09 12:11:04,683::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4846::DEBUG::2014-09-09 12:11:04,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4846::DEBUG::2014-09-09 12:11:04,684::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4846::DEBUG::2014-09-09 12:11:04,684::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4846::DEBUG::2014-09-09 12:11:04,684::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4846::DEBUG::2014-09-09 12:11:04,684::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4846::DEBUG::2014-09-09 12:11:04,684::task::993::Storage.TaskManager.Task::(_decref) Task=`2906d5ae-6084-4769-ab4f-93e23c5b3264`::ref 0 aborting False >Thread-4846::DEBUG::2014-09-09 12:11:04,684::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4846::DEBUG::2014-09-09 12:11:04,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:06,337::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:06,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:06,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:06,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:06,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:06,338::__init__::225::IOProcess::(_processLogs) (10282) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:06,338::__init__::225::IOProcess::(_processLogs) (10282) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:06,338::__init__::225::IOProcess::(_processLogs) (10282) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:06,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:11:06,338::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:11:06,346::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000949584 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:06,346::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:06,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) (10283) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) (10283) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) (10283) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:06,347::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:06,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:06,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0902145 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:06,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:06,753::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4847::DEBUG::2014-09-09 12:11:06,754::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:08,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:08,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894772 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:09,466::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:09,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) (10284) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) (10284) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) (10284) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:09,467::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:11:09,468::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:11:09,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0010131 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) (10285) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:09,476::__init__::225::IOProcess::(_processLogs) (10285) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:09,477::__init__::225::IOProcess::(_processLogs) (10285) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:09,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:09,477::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:11:09,477::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:11:09,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:09,477::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) (10286) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) (10286) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) (10286) Building response >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) (10286) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:09,478::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) (10287) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:09,479::__init__::225::IOProcess::(_processLogs) (10287) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) (10287) Building response >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) (10287) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) (10288) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:09,480::__init__::225::IOProcess::(_processLogs) (10288) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:09,481::__init__::225::IOProcess::(_processLogs) (10288) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:09,481::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:09,481::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:09,762::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:09,763::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4848::DEBUG::2014-09-09 12:11:09,764::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:10,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:10,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896883 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:11,975::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) (10289) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:11,976::__init__::225::IOProcess::(_processLogs) (10289) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:11,977::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|(10289) Building response >Thread-19::DEBUG::2014-09-09 12:11:11,977::__init__::225::IOProcess::(_processLogs) (10289) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:11,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:11,977::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:11:11,978::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:11:11,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104432 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:11,986::__init__::225::IOProcess::(_processLogs) (10290) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:11,987::__init__::225::IOProcess::(_processLogs) (10290) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:11,987::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|(10290) Building response >Thread-19::DEBUG::2014-09-09 12:11:11,987::__init__::225::IOProcess::(_processLogs) (10290) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:11,987::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:11,987::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:12,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:12,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:12,780::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4849::DEBUG::2014-09-09 12:11:12,781::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:12,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894458 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:14,723::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4850::DEBUG::2014-09-09 12:11:14,724::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:11:14,724::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4850::DEBUG::2014-09-09 12:11:14,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`1679f1d8-c7f7-471d-b05d-07ad9149ed7f`::moving from state init -> state preparing >Thread-4850::INFO::2014-09-09 12:11:14,725::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4850::INFO::2014-09-09 12:11:14,725::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4850::DEBUG::2014-09-09 12:11:14,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`1679f1d8-c7f7-471d-b05d-07ad9149ed7f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4850::DEBUG::2014-09-09 12:11:14,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`1679f1d8-c7f7-471d-b05d-07ad9149ed7f`::moving from state preparing -> state finished >Thread-4850::DEBUG::2014-09-09 12:11:14,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4850::DEBUG::2014-09-09 12:11:14,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4850::DEBUG::2014-09-09 12:11:14,726::task::993::Storage.TaskManager.Task::(_decref) Task=`1679f1d8-c7f7-471d-b05d-07ad9149ed7f`::ref 0 aborting False >Thread-4850::DEBUG::2014-09-09 12:11:14,726::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4850::DEBUG::2014-09-09 12:11:14,726::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:14,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4851::DEBUG::2014-09-09 12:11:14,780::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:11:14,780::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4851::DEBUG::2014-09-09 12:11:14,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2721726-e493-446a-8ecf-517f1298d320`::moving from state init -> state preparing >Thread-4851::INFO::2014-09-09 12:11:14,781::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4851::DEBUG::2014-09-09 12:11:14,781::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`39129b82-03ab-48a0-a436-c0db5e2c4838`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4851::DEBUG::2014-09-09 12:11:14,781::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4851::DEBUG::2014-09-09 12:11:14,781::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4851::DEBUG::2014-09-09 12:11:14,781::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`39129b82-03ab-48a0-a436-c0db5e2c4838`::Granted request >Thread-4851::DEBUG::2014-09-09 12:11:14,782::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f2721726-e493-446a-8ecf-517f1298d320`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4851::DEBUG::2014-09-09 12:11:14,782::task::993::Storage.TaskManager.Task::(_decref) Task=`f2721726-e493-446a-8ecf-517f1298d320`::ref 1 aborting False >Thread-4851::INFO::2014-09-09 12:11:14,783::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4851::DEBUG::2014-09-09 12:11:14,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2721726-e493-446a-8ecf-517f1298d320`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4851::DEBUG::2014-09-09 12:11:14,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2721726-e493-446a-8ecf-517f1298d320`::moving from state preparing -> state finished >Thread-4851::DEBUG::2014-09-09 12:11:14,784::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4851::DEBUG::2014-09-09 12:11:14,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4851::DEBUG::2014-09-09 12:11:14,784::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4851::DEBUG::2014-09-09 12:11:14,784::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4851::DEBUG::2014-09-09 12:11:14,784::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4851::DEBUG::2014-09-09 12:11:14,784::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4851::DEBUG::2014-09-09 12:11:14,784::task::993::Storage.TaskManager.Task::(_decref) Task=`f2721726-e493-446a-8ecf-517f1298d320`::ref 0 aborting False >Thread-4851::DEBUG::2014-09-09 12:11:14,784::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4851::DEBUG::2014-09-09 12:11:14,785::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:14,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:14,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895746 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:15,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:15,789::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4852::DEBUG::2014-09-09 12:11:15,790::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:16,348::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) (10291) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) (10291) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:16,349::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|(10291) Building response >Thread-3443::DEBUG::2014-09-09 12:11:16,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:16,350::__init__::225::IOProcess::(_processLogs) (10291) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:16,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:16,356::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:11:16,358::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000851198 s, 417 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:16,358::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) (10292) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) (10292) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|(10292) Building response >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) (10292) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:16,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:16,360::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:16,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:17,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895781 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:18,797::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:18,798::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4853::DEBUG::2014-09-09 12:11:18,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bfa3aa8-81f1-4781-a939-9a94f2c9a291`::moving from state init -> state preparing >Thread-4853::INFO::2014-09-09 12:11:18,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4853::INFO::2014-09-09 12:11:18,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104432', 'lastCheck': '6.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010131', 'lastCheck': '9.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000851198', 'lastCheck': '2.4', 'valid': True}} >Thread-4853::DEBUG::2014-09-09 12:11:18,800::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bfa3aa8-81f1-4781-a939-9a94f2c9a291`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104432', 'lastCheck': '6.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010131', 'lastCheck': '9.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000851198', 'lastCheck': '2.4', 'valid': True}} >Thread-4853::DEBUG::2014-09-09 12:11:18,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bfa3aa8-81f1-4781-a939-9a94f2c9a291`::moving from state preparing -> state finished >Thread-4853::DEBUG::2014-09-09 12:11:18,800::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4853::DEBUG::2014-09-09 12:11:18,800::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4853::DEBUG::2014-09-09 12:11:18,800::task::993::Storage.TaskManager.Task::(_decref) Task=`6bfa3aa8-81f1-4781-a939-9a94f2c9a291`::ref 0 aborting False >Thread-4853::DEBUG::2014-09-09 12:11:18,801::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:18,811::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:18,811::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4854::DEBUG::2014-09-09 12:11:18,812::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:19,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:19,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896206 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:19,482::__init__::225::IOProcess::(_processLogs) (10288) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:19,483::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:19,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:19,484::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:19,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-24::DEBUG::2014-09-09 12:11:19,486::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:19,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:19,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:19,492::__init__::225::IOProcess::(_processLogs) (10293) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:19,493::__init__::225::IOProcess::(_processLogs) (10293) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:19,493::__init__::225::IOProcess::(_processLogs) (10293) Building response >Thread-19::DEBUG::2014-09-09 12:11:19,494::__init__::225::IOProcess::(_processLogs) (10293) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:19,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:19,495::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:11:19,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000961144 s, 570 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:19,497::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:19,498::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:19,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:19,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:19,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:19,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:19,500::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:19,502::__init__::225::IOProcess::(_processLogs) (10294) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:19,502::__init__::225::IOProcess::(_processLogs) (10294) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:19,503::__init__::225::IOProcess::(_processLogs) (10294) Building response >Thread-19::DEBUG::2014-09-09 12:11:19,503::__init__::225::IOProcess::(_processLogs) (10294) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:19,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:19,504::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:11:19,505::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:19,506::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:11:19,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:19,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:19,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:19,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:19,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:19,508::__init__::225::IOProcess::(_processLogs) (10295) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:19,509::__init__::225::IOProcess::(_processLogs) (10295) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:19,509::__init__::225::IOProcess::(_processLogs) (10295) Building response >Thread-19::DEBUG::2014-09-09 12:11:19,510::__init__::225::IOProcess::(_processLogs) (10295) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:19,510::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:19,511::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:19,512::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:19,512::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:11:19,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:19,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:19,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:19,514::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:19,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:19,515::__init__::225::IOProcess::(_processLogs) (10296) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:19,516::__init__::225::IOProcess::(_processLogs) (10296) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:19,516::__init__::225::IOProcess::(_processLogs) DEBUG|(10296) Building response >Thread-19::DEBUG::2014-09-09 12:11:19,517::__init__::225::IOProcess::(_processLogs) (10296) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:19,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:19,518::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:19,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:19,519::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:11:19,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:19,520::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:19,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:19,521::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:19,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:19,521::__init__::225::IOProcess::(_processLogs) (10297) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:19,522::__init__::225::IOProcess::(_processLogs) (10297) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:19,522::__init__::225::IOProcess::(_processLogs) (10297) Building response >Thread-19::DEBUG::2014-09-09 12:11:19,523::__init__::225::IOProcess::(_processLogs) (10297) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:19,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:19,524::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:11:21,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:21,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895084 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:21,939::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:21,940::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4855::DEBUG::2014-09-09 12:11:21,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:21,988::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:21,988::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:21,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:21,988::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:21,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:21,989::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:21,989::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:21,989::__init__::225::IOProcess::(_processLogs) (10298) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:21,989::__init__::225::IOProcess::(_processLogs) (10298) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:21,989::__init__::225::IOProcess::(_processLogs) DEBUG|(10298) Building response >Thread-23::DEBUG::2014-09-09 12:11:21,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:21,990::__init__::225::IOProcess::(_processLogs) (10298) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:21,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:21,995::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:11:21,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010368 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:21,997::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:21,997::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:21,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) (10299) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) (10299) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) DEBUG|(10299) Building response >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) (10299) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:21,998::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:21,999::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:23,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:23,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896172 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:24,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:24,947::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4856::DEBUG::2014-09-09 12:11:24,948::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:25,038::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:25,039::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4857::DEBUG::2014-09-09 12:11:25,039::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4857::DEBUG::2014-09-09 12:11:25,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`7acfef97-bb7e-4ddd-8085-aa946d8e2dfc`::moving from state init -> state preparing >Thread-4857::INFO::2014-09-09 12:11:25,040::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4857::INFO::2014-09-09 12:11:25,040::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4857::DEBUG::2014-09-09 12:11:25,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`7acfef97-bb7e-4ddd-8085-aa946d8e2dfc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4857::DEBUG::2014-09-09 12:11:25,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`7acfef97-bb7e-4ddd-8085-aa946d8e2dfc`::moving from state preparing -> state finished >Thread-4857::DEBUG::2014-09-09 12:11:25,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4857::DEBUG::2014-09-09 12:11:25,041::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4857::DEBUG::2014-09-09 12:11:25,041::task::993::Storage.TaskManager.Task::(_decref) Task=`7acfef97-bb7e-4ddd-8085-aa946d8e2dfc`::ref 0 aborting False >Thread-4857::DEBUG::2014-09-09 12:11:25,041::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4857::DEBUG::2014-09-09 12:11:25,041::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:25,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4858::DEBUG::2014-09-09 12:11:25,064::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:11:25,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4858::DEBUG::2014-09-09 12:11:25,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ea62459-852d-4c74-ae65-e170a803f314`::moving from state init -> state preparing >Thread-4858::INFO::2014-09-09 12:11:25,065::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4858::DEBUG::2014-09-09 12:11:25,065::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6f5c17bf-3716-4c14-8e0b-b4d984ad69d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4858::DEBUG::2014-09-09 12:11:25,065::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4858::DEBUG::2014-09-09 12:11:25,065::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4858::DEBUG::2014-09-09 12:11:25,065::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6f5c17bf-3716-4c14-8e0b-b4d984ad69d7`::Granted request >Thread-4858::DEBUG::2014-09-09 12:11:25,065::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5ea62459-852d-4c74-ae65-e170a803f314`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4858::DEBUG::2014-09-09 12:11:25,066::task::993::Storage.TaskManager.Task::(_decref) Task=`5ea62459-852d-4c74-ae65-e170a803f314`::ref 1 aborting False >Thread-4858::INFO::2014-09-09 12:11:25,067::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4858::DEBUG::2014-09-09 12:11:25,067::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ea62459-852d-4c74-ae65-e170a803f314`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4858::DEBUG::2014-09-09 12:11:25,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ea62459-852d-4c74-ae65-e170a803f314`::moving from state preparing -> state finished >Thread-4858::DEBUG::2014-09-09 12:11:25,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4858::DEBUG::2014-09-09 12:11:25,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4858::DEBUG::2014-09-09 12:11:25,068::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4858::DEBUG::2014-09-09 12:11:25,068::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4858::DEBUG::2014-09-09 12:11:25,068::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4858::DEBUG::2014-09-09 12:11:25,068::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4858::DEBUG::2014-09-09 12:11:25,068::task::993::Storage.TaskManager.Task::(_decref) Task=`5ea62459-852d-4c74-ae65-e170a803f314`::ref 0 aborting False >Thread-4858::DEBUG::2014-09-09 12:11:25,068::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4858::DEBUG::2014-09-09 12:11:25,068::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:25,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:25,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895642 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:26,361::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:26,361::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:26,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:26,361::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:26,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:26,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:26,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:26,362::__init__::225::IOProcess::(_processLogs) (10300) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:26,362::__init__::225::IOProcess::(_processLogs) (10300) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:26,362::__init__::225::IOProcess::(_processLogs) DEBUG|(10300) Building response >Thread-3443::DEBUG::2014-09-09 12:11:26,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:26,363::__init__::225::IOProcess::(_processLogs) (10300) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:26,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:26,368::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:11:26,370::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000904447 s, 393 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:26,370::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:26,370::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) (10301) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) (10301) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) DEBUG|(10301) Building response >Thread-19::DEBUG::2014-09-09 12:11:26,371::__init__::225::IOProcess::(_processLogs) (10301) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:26,372::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:26,372::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:27,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:27,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895988 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:27,954::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:27,954::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4859::DEBUG::2014-09-09 12:11:27,955::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:29,525::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:29,525::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:29,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:29,525::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:29,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:29,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:29,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:29,526::__init__::225::IOProcess::(_processLogs) (10302) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:29,526::__init__::225::IOProcess::(_processLogs) (10302) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:29,526::__init__::225::IOProcess::(_processLogs) DEBUG|(10302) Building response >Thread-19::DEBUG::2014-09-09 12:11:29,527::__init__::225::IOProcess::(_processLogs) (10302) Queuing response >Thread-24::DEBUG::2014-09-09 12:11:29,527::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:29,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:29,532::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:11:29,535::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000923009 s, 594 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:29,535::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:29,535::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:29,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:29,535::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:29,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) (10303) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) (10303) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) DEBUG|(10303) Building response >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) (10303) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:29,536::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:29,537::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:11:29,537::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:29,537::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:11:29,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:29,537::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) (10304) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) (10304) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) (10304) Building response >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) (10304) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:29,538::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) (10305) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:29,539::__init__::225::IOProcess::(_processLogs) (10305) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) (10305) Building response >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) (10305) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:11:29,540::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) (10306) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) (10306) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) (10306) Building response >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) (10306) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:29,541::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:11:29,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:29,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089409 s, 11.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:30,961::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:30,962::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4860::DEBUG::2014-09-09 12:11:30,963::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:31,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:31,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895672 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) (10307) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:32,000::__init__::225::IOProcess::(_processLogs) (10307) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:32,001::__init__::225::IOProcess::(_processLogs) DEBUG|(10307) Building response >Thread-19::DEBUG::2014-09-09 12:11:32,001::__init__::225::IOProcess::(_processLogs) (10307) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:32,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:32,001::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:11:32,001::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:11:32,008::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114353 s, 982 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:32,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:32,010::__init__::225::IOProcess::(_processLogs) (10308) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:32,010::__init__::225::IOProcess::(_processLogs) (10308) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:32,010::__init__::225::IOProcess::(_processLogs) DEBUG|(10308) Building response >Thread-19::DEBUG::2014-09-09 12:11:32,010::__init__::225::IOProcess::(_processLogs) (10308) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:32,010::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:32,011::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:33,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:33,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896123 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:33,969::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:33,970::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4861::DEBUG::2014-09-09 12:11:33,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`afa310a4-423d-4b96-87af-48ecd8b6b3d0`::moving from state init -> state preparing >Thread-4861::INFO::2014-09-09 12:11:33,971::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4861::INFO::2014-09-09 12:11:33,971::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114353', 'lastCheck': '2.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000923009', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000904447', 'lastCheck': '7.6', 'valid': True}} >Thread-4861::DEBUG::2014-09-09 12:11:33,971::task::1191::Storage.TaskManager.Task::(prepare) Task=`afa310a4-423d-4b96-87af-48ecd8b6b3d0`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114353', 'lastCheck': '2.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000923009', 'lastCheck': '4.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000904447', 'lastCheck': '7.6', 'valid': True}} >Thread-4861::DEBUG::2014-09-09 12:11:33,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`afa310a4-423d-4b96-87af-48ecd8b6b3d0`::moving from state preparing -> state finished >Thread-4861::DEBUG::2014-09-09 12:11:33,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4861::DEBUG::2014-09-09 12:11:33,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4861::DEBUG::2014-09-09 12:11:33,972::task::993::Storage.TaskManager.Task::(_decref) Task=`afa310a4-423d-4b96-87af-48ecd8b6b3d0`::ref 0 aborting False >Thread-4861::DEBUG::2014-09-09 12:11:33,973::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:33,979::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:33,980::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4862::DEBUG::2014-09-09 12:11:33,981::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:35,123::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4863::DEBUG::2014-09-09 12:11:35,123::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:11:35,123::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4863::DEBUG::2014-09-09 12:11:35,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`29612eb7-4258-43eb-bc1b-9dcabf4dda65`::moving from state init -> state preparing >Thread-4863::INFO::2014-09-09 12:11:35,124::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4863::INFO::2014-09-09 12:11:35,125::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4863::DEBUG::2014-09-09 12:11:35,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`29612eb7-4258-43eb-bc1b-9dcabf4dda65`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4863::DEBUG::2014-09-09 12:11:35,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`29612eb7-4258-43eb-bc1b-9dcabf4dda65`::moving from state preparing -> state finished >Thread-4863::DEBUG::2014-09-09 12:11:35,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4863::DEBUG::2014-09-09 12:11:35,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4863::DEBUG::2014-09-09 12:11:35,125::task::993::Storage.TaskManager.Task::(_decref) Task=`29612eb7-4258-43eb-bc1b-9dcabf4dda65`::ref 0 aborting False >Thread-4863::DEBUG::2014-09-09 12:11:35,125::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4863::DEBUG::2014-09-09 12:11:35,125::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:35,139::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:35,140::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4864::DEBUG::2014-09-09 12:11:35,140::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4864::DEBUG::2014-09-09 12:11:35,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cb654b6-fdf7-41db-82da-6993d90060af`::moving from state init -> state preparing >Thread-4864::INFO::2014-09-09 12:11:35,141::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4864::DEBUG::2014-09-09 12:11:35,141::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6d990209-95a7-43e7-af4e-a2e2e3b1904d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4864::DEBUG::2014-09-09 12:11:35,141::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4864::DEBUG::2014-09-09 12:11:35,141::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4864::DEBUG::2014-09-09 12:11:35,141::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`6d990209-95a7-43e7-af4e-a2e2e3b1904d`::Granted request >Thread-4864::DEBUG::2014-09-09 12:11:35,142::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3cb654b6-fdf7-41db-82da-6993d90060af`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4864::DEBUG::2014-09-09 12:11:35,142::task::993::Storage.TaskManager.Task::(_decref) Task=`3cb654b6-fdf7-41db-82da-6993d90060af`::ref 1 aborting False >Thread-4864::INFO::2014-09-09 12:11:35,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4864::DEBUG::2014-09-09 12:11:35,143::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cb654b6-fdf7-41db-82da-6993d90060af`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4864::DEBUG::2014-09-09 12:11:35,143::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cb654b6-fdf7-41db-82da-6993d90060af`::moving from state preparing -> state finished >Thread-4864::DEBUG::2014-09-09 12:11:35,143::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4864::DEBUG::2014-09-09 12:11:35,143::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4864::DEBUG::2014-09-09 12:11:35,144::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4864::DEBUG::2014-09-09 12:11:35,144::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4864::DEBUG::2014-09-09 12:11:35,144::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4864::DEBUG::2014-09-09 12:11:35,144::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4864::DEBUG::2014-09-09 12:11:35,144::task::993::Storage.TaskManager.Task::(_decref) Task=`3cb654b6-fdf7-41db-82da-6993d90060af`::ref 0 aborting False >Thread-4864::DEBUG::2014-09-09 12:11:35,144::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4864::DEBUG::2014-09-09 12:11:35,144::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:35,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:35,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895163 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:36,373::__init__::225::IOProcess::(_processLogs) (10309) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:36,374::__init__::225::IOProcess::(_processLogs) (10309) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:36,375::__init__::225::IOProcess::(_processLogs) DEBUG|(10309) Building response >Thread-19::DEBUG::2014-09-09 12:11:36,375::__init__::225::IOProcess::(_processLogs) (10309) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:36,375::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:36,376::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:11:36,376::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:11:36,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00082368 s, 431 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:36,384::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:36,384::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) (10310) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) (10310) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) DEBUG|(10310) Building response >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) (10310) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:36,385::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:36,386::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:37,079::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:37,080::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4865::DEBUG::2014-09-09 12:11:37,081::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:38,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:38,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895918 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:39,541::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:39,541::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:39,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) (10311) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) (10311) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:39,542::__init__::225::IOProcess::(_processLogs) DEBUG|(10311) Building response >Thread-19::DEBUG::2014-09-09 12:11:39,543::__init__::225::IOProcess::(_processLogs) (10311) Queuing response >Thread-24::DEBUG::2014-09-09 12:11:39,543::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:39,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:39,549::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:11:39,551::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100475 s, 545 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) (10312) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) (10312) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:39,552::__init__::225::IOProcess::(_processLogs) DEBUG|(10312) Building response >Thread-19::DEBUG::2014-09-09 12:11:39,553::__init__::225::IOProcess::(_processLogs) (10312) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:39,553::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:39,553::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:39,554::__init__::225::IOProcess::(_processLogs) (10313) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) (10313) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) (10313) Building response >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) (10313) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:11:39,555::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) (10314) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) (10314) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) (10314) Building response >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) (10314) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:39,556::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:39,557::__init__::225::IOProcess::(_processLogs) (10315) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:39,558::__init__::225::IOProcess::(_processLogs) (10315) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:39,558::__init__::225::IOProcess::(_processLogs) (10315) Building response >Thread-19::DEBUG::2014-09-09 12:11:39,558::__init__::225::IOProcess::(_processLogs) (10315) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:39,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:39,558::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:40,090::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:40,090::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4866::DEBUG::2014-09-09 12:11:40,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:40,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:40,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895888 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:42,011::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:42,011::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:42,011::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:42,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:42,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:42,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:42,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:42,012::__init__::225::IOProcess::(_processLogs) (10316) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:42,012::__init__::225::IOProcess::(_processLogs) (10316) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:42,013::__init__::225::IOProcess::(_processLogs) DEBUG|(10316) Building response >Thread-19::DEBUG::2014-09-09 12:11:42,013::__init__::225::IOProcess::(_processLogs) (10316) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:42,013::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:11:42,013::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:42,014::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:11:42,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00116415 s, 965 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:42,022::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:42,022::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:42,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:42,022::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:42,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) (10317) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) (10317) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) DEBUG|(10317) Building response >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) (10317) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:42,023::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:11:42,024::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:42,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:42,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896286 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:43,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:43,100::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4867::DEBUG::2014-09-09 12:11:43,101::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:44,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:44,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897473 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:45,182::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:45,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4868::DEBUG::2014-09-09 12:11:45,183::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4868::DEBUG::2014-09-09 12:11:45,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`26bc95cc-d329-4853-880f-6e51a620b91d`::moving from state init -> state preparing >Thread-4868::INFO::2014-09-09 12:11:45,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4868::INFO::2014-09-09 12:11:45,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4868::DEBUG::2014-09-09 12:11:45,185::task::1191::Storage.TaskManager.Task::(prepare) Task=`26bc95cc-d329-4853-880f-6e51a620b91d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4868::DEBUG::2014-09-09 12:11:45,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`26bc95cc-d329-4853-880f-6e51a620b91d`::moving from state preparing -> state finished >Thread-4868::DEBUG::2014-09-09 12:11:45,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4868::DEBUG::2014-09-09 12:11:45,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4868::DEBUG::2014-09-09 12:11:45,185::task::993::Storage.TaskManager.Task::(_decref) Task=`26bc95cc-d329-4853-880f-6e51a620b91d`::ref 0 aborting False >Thread-4868::DEBUG::2014-09-09 12:11:45,185::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4868::DEBUG::2014-09-09 12:11:45,185::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:45,225::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:45,225::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4869::DEBUG::2014-09-09 12:11:45,225::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4869::DEBUG::2014-09-09 12:11:45,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff36631d-f10d-44b8-9a7d-7f5aacafe05c`::moving from state init -> state preparing >Thread-4869::INFO::2014-09-09 12:11:45,226::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4869::DEBUG::2014-09-09 12:11:45,227::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b7b4530a-0f6e-490a-b092-3d1e2070a37e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4869::DEBUG::2014-09-09 12:11:45,227::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4869::DEBUG::2014-09-09 12:11:45,227::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4869::DEBUG::2014-09-09 12:11:45,227::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b7b4530a-0f6e-490a-b092-3d1e2070a37e`::Granted request >Thread-4869::DEBUG::2014-09-09 12:11:45,227::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff36631d-f10d-44b8-9a7d-7f5aacafe05c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4869::DEBUG::2014-09-09 12:11:45,227::task::993::Storage.TaskManager.Task::(_decref) Task=`ff36631d-f10d-44b8-9a7d-7f5aacafe05c`::ref 1 aborting False >Thread-4869::INFO::2014-09-09 12:11:45,229::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4869::DEBUG::2014-09-09 12:11:45,229::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff36631d-f10d-44b8-9a7d-7f5aacafe05c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4869::DEBUG::2014-09-09 12:11:45,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff36631d-f10d-44b8-9a7d-7f5aacafe05c`::moving from state preparing -> state finished >Thread-4869::DEBUG::2014-09-09 12:11:45,229::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4869::DEBUG::2014-09-09 12:11:45,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4869::DEBUG::2014-09-09 12:11:45,229::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4869::DEBUG::2014-09-09 12:11:45,229::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4869::DEBUG::2014-09-09 12:11:45,230::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4869::DEBUG::2014-09-09 12:11:45,230::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4869::DEBUG::2014-09-09 12:11:45,230::task::993::Storage.TaskManager.Task::(_decref) Task=`ff36631d-f10d-44b8-9a7d-7f5aacafe05c`::ref 0 aborting False >Thread-4869::DEBUG::2014-09-09 12:11:45,230::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4869::DEBUG::2014-09-09 12:11:45,230::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:46,107::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:46,107::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4870::DEBUG::2014-09-09 12:11:46,108::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) (10318) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) (10318) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:46,387::__init__::225::IOProcess::(_processLogs) DEBUG|(10318) Building response >Thread-19::DEBUG::2014-09-09 12:11:46,388::__init__::225::IOProcess::(_processLogs) (10318) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:46,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:46,388::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:11:46,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:11:46,395::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000942981 s, 376 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:46,395::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) (10319) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) (10319) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) (10319) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:46,396::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:46,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:46,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895884 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:11:48,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:48,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896589 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:49,112::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:49,113::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4871::DEBUG::2014-09-09 12:11:49,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7d89173-ff96-47f0-a0b2-6724cca76fcc`::moving from state init -> state preparing >Thread-4871::INFO::2014-09-09 12:11:49,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4871::INFO::2014-09-09 12:11:49,115::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116415', 'lastCheck': '7.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100475', 'lastCheck': '9.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942981', 'lastCheck': '2.7', 'valid': True}} >Thread-4871::DEBUG::2014-09-09 12:11:49,115::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7d89173-ff96-47f0-a0b2-6724cca76fcc`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00116415', 'lastCheck': '7.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100475', 'lastCheck': '9.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942981', 'lastCheck': '2.7', 'valid': True}} >Thread-4871::DEBUG::2014-09-09 12:11:49,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7d89173-ff96-47f0-a0b2-6724cca76fcc`::moving from state preparing -> state finished >Thread-4871::DEBUG::2014-09-09 12:11:49,115::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4871::DEBUG::2014-09-09 12:11:49,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4871::DEBUG::2014-09-09 12:11:49,115::task::993::Storage.TaskManager.Task::(_decref) Task=`e7d89173-ff96-47f0-a0b2-6724cca76fcc`::ref 0 aborting False >Thread-4871::DEBUG::2014-09-09 12:11:49,116::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:49,123::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:49,124::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4872::DEBUG::2014-09-09 12:11:49,125::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:49,558::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:49,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:49,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:49,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:49,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-24::DEBUG::2014-09-09 12:11:49,561::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:11:49,561::__init__::225::IOProcess::(_processLogs) (10320) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:49,567::__init__::225::IOProcess::(_processLogs) (10320) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:49,568::__init__::225::IOProcess::(_processLogs) (10320) Building response >Thread-19::DEBUG::2014-09-09 12:11:49,568::__init__::225::IOProcess::(_processLogs) (10320) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:49,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:49,569::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:11:49,570::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000957344 s, 572 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:49,571::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:49,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:49,572::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:49,573::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:49,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:49,575::__init__::225::IOProcess::(_processLogs) (10321) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:49,575::__init__::225::IOProcess::(_processLogs) (10321) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:49,576::__init__::225::IOProcess::(_processLogs) (10321) Building response >Thread-19::DEBUG::2014-09-09 12:11:49,576::__init__::225::IOProcess::(_processLogs) (10321) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:49,576::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:49,577::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:11:49,578::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:11:49,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:49,579::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:49,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:49,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:49,580::__init__::225::IOProcess::(_processLogs) (10322) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:49,581::__init__::225::IOProcess::(_processLogs) (10322) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:49,582::__init__::225::IOProcess::(_processLogs) (10322) Building response >Thread-19::DEBUG::2014-09-09 12:11:49,582::__init__::225::IOProcess::(_processLogs) (10322) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:49,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:49,583::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:49,584::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:11:49,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:49,585::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:49,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:49,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:49,586::__init__::225::IOProcess::(_processLogs) (10323) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:49,587::__init__::225::IOProcess::(_processLogs) (10323) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:49,588::__init__::225::IOProcess::(_processLogs) (10323) Building response >Thread-19::DEBUG::2014-09-09 12:11:49,588::__init__::225::IOProcess::(_processLogs) (10323) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:49,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:49,589::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:49,590::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:11:49,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:49,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:49,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:49,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:49,592::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:49,592::__init__::225::IOProcess::(_processLogs) (10324) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:49,593::__init__::225::IOProcess::(_processLogs) (10324) Building response >Thread-19::DEBUG::2014-09-09 12:11:49,594::__init__::225::IOProcess::(_processLogs) (10324) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:49,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:49,595::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:11:50,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:50,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089443 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:52,024::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) (10325) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) (10325) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) (10325) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:52,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:11:52,026::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:11:52,032::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106735 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) (10326) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:52,033::__init__::225::IOProcess::(_processLogs) (10326) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:52,034::__init__::225::IOProcess::(_processLogs) (10326) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:52,034::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:52,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:52,266::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4873::DEBUG::2014-09-09 12:11:52,267::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:52,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:52,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089511 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:11:54,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:54,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895661 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:55,269::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:55,269::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4874::DEBUG::2014-09-09 12:11:55,269::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4874::DEBUG::2014-09-09 12:11:55,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d8cc786-dcfb-406c-945c-20f9cac9918a`::moving from state init -> state preparing >Thread-4874::INFO::2014-09-09 12:11:55,270::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4874::INFO::2014-09-09 12:11:55,271::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4874::DEBUG::2014-09-09 12:11:55,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d8cc786-dcfb-406c-945c-20f9cac9918a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4874::DEBUG::2014-09-09 12:11:55,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d8cc786-dcfb-406c-945c-20f9cac9918a`::moving from state preparing -> state finished >Thread-4874::DEBUG::2014-09-09 12:11:55,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4874::DEBUG::2014-09-09 12:11:55,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4874::DEBUG::2014-09-09 12:11:55,271::task::993::Storage.TaskManager.Task::(_decref) Task=`5d8cc786-dcfb-406c-945c-20f9cac9918a`::ref 0 aborting False >Thread-4874::DEBUG::2014-09-09 12:11:55,271::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4874::DEBUG::2014-09-09 12:11:55,271::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:55,274::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:55,274::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4875::DEBUG::2014-09-09 12:11:55,275::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:55,309::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:55,309::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4876::DEBUG::2014-09-09 12:11:55,309::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4876::DEBUG::2014-09-09 12:11:55,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a17770e-0ca2-41d7-95fd-a8b33d1ea8c9`::moving from state init -> state preparing >Thread-4876::INFO::2014-09-09 12:11:55,310::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4876::DEBUG::2014-09-09 12:11:55,310::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a20be2d3-950d-4d97-b21c-ac330ce54122`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4876::DEBUG::2014-09-09 12:11:55,310::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4876::DEBUG::2014-09-09 12:11:55,311::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4876::DEBUG::2014-09-09 12:11:55,311::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a20be2d3-950d-4d97-b21c-ac330ce54122`::Granted request >Thread-4876::DEBUG::2014-09-09 12:11:55,311::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2a17770e-0ca2-41d7-95fd-a8b33d1ea8c9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4876::DEBUG::2014-09-09 12:11:55,311::task::993::Storage.TaskManager.Task::(_decref) Task=`2a17770e-0ca2-41d7-95fd-a8b33d1ea8c9`::ref 1 aborting False >Thread-4876::INFO::2014-09-09 12:11:55,312::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4876::DEBUG::2014-09-09 12:11:55,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a17770e-0ca2-41d7-95fd-a8b33d1ea8c9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4876::DEBUG::2014-09-09 12:11:55,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a17770e-0ca2-41d7-95fd-a8b33d1ea8c9`::moving from state preparing -> state finished >Thread-4876::DEBUG::2014-09-09 12:11:55,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4876::DEBUG::2014-09-09 12:11:55,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4876::DEBUG::2014-09-09 12:11:55,313::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4876::DEBUG::2014-09-09 12:11:55,313::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4876::DEBUG::2014-09-09 12:11:55,313::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4876::DEBUG::2014-09-09 12:11:55,313::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4876::DEBUG::2014-09-09 12:11:55,313::task::993::Storage.TaskManager.Task::(_decref) Task=`2a17770e-0ca2-41d7-95fd-a8b33d1ea8c9`::ref 0 aborting False >Thread-4876::DEBUG::2014-09-09 12:11:55,314::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4876::DEBUG::2014-09-09 12:11:55,314::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) (10327) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) (10327) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) (10327) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:56,398::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:11:56,399::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:11:56,406::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000880237 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:56,406::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:11:56,406::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) (10328) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) (10328) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) (10328) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:56,407::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:11:56,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:57,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895226 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:11:58,281::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:11:58,282::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4877::DEBUG::2014-09-09 12:11:58,283::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:11:59,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:11:59,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895108 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:59,594::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:59,594::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:59,594::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:11:59,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:59,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:59,595::__init__::225::IOProcess::(_processLogs) (10329) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:59,595::__init__::225::IOProcess::(_processLogs) (10329) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:59,595::__init__::225::IOProcess::(_processLogs) (10329) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:59,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:11:59,595::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:11:59,603::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000981308 s, 558 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:11:59,603::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:11:59,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) (10330) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) (10330) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) (10330) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:59,604::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:11:59,605::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:11:59,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:59,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) (10331) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) (10331) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) (10331) Building response >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) (10331) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:11:59,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) (10332) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) (10332) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) (10332) Building response >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) (10332) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:59,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:59,608::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:11:59,608::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:11:59,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:11:59,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:11:59,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) (10333) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) (10333) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) (10333) Building response >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) (10333) Queuing response >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:11:59,609::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:12:01,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:01,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895112 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:01,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:01,288::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4878::DEBUG::2014-09-09 12:12:01,289::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) (10334) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:02,035::__init__::225::IOProcess::(_processLogs) (10334) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:02,036::__init__::225::IOProcess::(_processLogs) (10334) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:02,036::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:12:02,036::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:12:02,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.001113 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:02,044::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:02,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:02,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:02,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:02,044::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:02,044::__init__::225::IOProcess::(_processLogs) (10335) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:02,045::__init__::225::IOProcess::(_processLogs) (10335) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:02,045::__init__::225::IOProcess::(_processLogs) (10335) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:02,045::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:12:03,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:03,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895607 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:04,294::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:04,294::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4879::DEBUG::2014-09-09 12:12:04,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b9f02c7-050d-4fd6-a3b3-93b623684ffc`::moving from state init -> state preparing >Thread-4879::INFO::2014-09-09 12:12:04,295::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4879::INFO::2014-09-09 12:12:04,296::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001113', 'lastCheck': '2.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000981308', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000880237', 'lastCheck': '7.9', 'valid': True}} >Thread-4879::DEBUG::2014-09-09 12:12:04,296::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b9f02c7-050d-4fd6-a3b3-93b623684ffc`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.001113', 'lastCheck': '2.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000981308', 'lastCheck': '4.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000880237', 'lastCheck': '7.9', 'valid': True}} >Thread-4879::DEBUG::2014-09-09 12:12:04,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b9f02c7-050d-4fd6-a3b3-93b623684ffc`::moving from state preparing -> state finished >Thread-4879::DEBUG::2014-09-09 12:12:04,296::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4879::DEBUG::2014-09-09 12:12:04,296::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4879::DEBUG::2014-09-09 12:12:04,296::task::993::Storage.TaskManager.Task::(_decref) Task=`8b9f02c7-050d-4fd6-a3b3-93b623684ffc`::ref 0 aborting False >Thread-4879::DEBUG::2014-09-09 12:12:04,297::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:04,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:04,305::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4880::DEBUG::2014-09-09 12:12:04,306::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:05,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:05,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896325 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:05,462::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:05,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4881::DEBUG::2014-09-09 12:12:05,464::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4881::DEBUG::2014-09-09 12:12:05,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02efc86-b5d1-4ff1-8087-917dd960a8fe`::moving from state init -> state preparing >Thread-4881::INFO::2014-09-09 12:12:05,468::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4881::INFO::2014-09-09 12:12:05,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4881::DEBUG::2014-09-09 12:12:05,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`b02efc86-b5d1-4ff1-8087-917dd960a8fe`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4881::DEBUG::2014-09-09 12:12:05,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`b02efc86-b5d1-4ff1-8087-917dd960a8fe`::moving from state preparing -> state finished >Thread-4881::DEBUG::2014-09-09 12:12:05,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4881::DEBUG::2014-09-09 12:12:05,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4881::DEBUG::2014-09-09 12:12:05,470::task::993::Storage.TaskManager.Task::(_decref) Task=`b02efc86-b5d1-4ff1-8087-917dd960a8fe`::ref 0 aborting False >Thread-4881::DEBUG::2014-09-09 12:12:05,471::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4881::DEBUG::2014-09-09 12:12:05,472::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:05,543::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:05,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4882::DEBUG::2014-09-09 12:12:05,544::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4882::DEBUG::2014-09-09 12:12:05,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`aea06abb-6a80-4bd6-8703-7b1cfc2ab3b1`::moving from state init -> state preparing >Thread-4882::INFO::2014-09-09 12:12:05,544::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4882::DEBUG::2014-09-09 12:12:05,545::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b2764bb2-4011-4b99-beed-14eb97e38dbc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4882::DEBUG::2014-09-09 12:12:05,545::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4882::DEBUG::2014-09-09 12:12:05,545::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4882::DEBUG::2014-09-09 12:12:05,545::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b2764bb2-4011-4b99-beed-14eb97e38dbc`::Granted request >Thread-4882::DEBUG::2014-09-09 12:12:05,545::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aea06abb-6a80-4bd6-8703-7b1cfc2ab3b1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4882::DEBUG::2014-09-09 12:12:05,545::task::993::Storage.TaskManager.Task::(_decref) Task=`aea06abb-6a80-4bd6-8703-7b1cfc2ab3b1`::ref 1 aborting False >Thread-4882::INFO::2014-09-09 12:12:05,547::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4882::DEBUG::2014-09-09 12:12:05,547::task::1191::Storage.TaskManager.Task::(prepare) Task=`aea06abb-6a80-4bd6-8703-7b1cfc2ab3b1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4882::DEBUG::2014-09-09 12:12:05,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`aea06abb-6a80-4bd6-8703-7b1cfc2ab3b1`::moving from state preparing -> state finished >Thread-4882::DEBUG::2014-09-09 12:12:05,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4882::DEBUG::2014-09-09 12:12:05,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4882::DEBUG::2014-09-09 12:12:05,547::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4882::DEBUG::2014-09-09 12:12:05,548::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4882::DEBUG::2014-09-09 12:12:05,548::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4882::DEBUG::2014-09-09 12:12:05,548::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4882::DEBUG::2014-09-09 12:12:05,548::task::993::Storage.TaskManager.Task::(_decref) Task=`aea06abb-6a80-4bd6-8703-7b1cfc2ab3b1`::ref 0 aborting False >Thread-4882::DEBUG::2014-09-09 12:12:05,548::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283541241856', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4882::DEBUG::2014-09-09 12:12:05,548::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:06,408::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:06,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:06,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:06,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:06,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:06,409::__init__::225::IOProcess::(_processLogs) (10336) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:06,409::__init__::225::IOProcess::(_processLogs) (10336) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:06,410::__init__::225::IOProcess::(_processLogs) (10336) Queuing response >Thread-3443::DEBUG::2014-09-09 12:12:06,410::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:12:06,410::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:06,415::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:12:06,418::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000919261 s, 386 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) (10337) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) (10337) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:06,419::__init__::225::IOProcess::(_processLogs) (10337) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:06,420::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:12:07,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:07,508::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:07,509::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4883::DEBUG::2014-09-09 12:12:07,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:07,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894989 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:12:09,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:12:09,609::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:09,609::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:09,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:09,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:09,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:09,610::__init__::225::IOProcess::(_processLogs) (10338) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:09,610::__init__::225::IOProcess::(_processLogs) (10338) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:09,677::__init__::225::IOProcess::(_processLogs) (10338) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:09,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:12:09,678::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:12:09,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000910553 s, 602 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:09,689::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:09,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:09,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:09,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:09,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-97::DEBUG::2014-09-09 12:12:09,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103858 s, 9.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:09,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:09,695::__init__::225::IOProcess::(_processLogs) (10339) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:09,696::__init__::225::IOProcess::(_processLogs) (10339) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:09,697::__init__::225::IOProcess::(_processLogs) (10339) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:09,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:09,698::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:12:09,699::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:12:09,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:09,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:09,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:09,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:09,701::__init__::225::IOProcess::(_processLogs) (10340) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:09,702::__init__::225::IOProcess::(_processLogs) (10340) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:09,702::__init__::225::IOProcess::(_processLogs) (10340) Building response >Thread-19::DEBUG::2014-09-09 12:12:09,702::__init__::225::IOProcess::(_processLogs) (10340) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:09,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:09,703::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:09,704::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:12:09,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:09,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:09,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:09,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:09,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:09,706::__init__::225::IOProcess::(_processLogs) (10341) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:09,707::__init__::225::IOProcess::(_processLogs) (10341) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:09,707::__init__::225::IOProcess::(_processLogs) (10341) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:09,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:09,708::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:09,709::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:12:09,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:09,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:09,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:09,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:09,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:09,711::__init__::225::IOProcess::(_processLogs) (10342) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:09,712::__init__::225::IOProcess::(_processLogs) (10342) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:09,713::__init__::225::IOProcess::(_processLogs) (10342) Building response >Thread-19::DEBUG::2014-09-09 12:12:09,713::__init__::225::IOProcess::(_processLogs) (10342) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:09,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:09,714::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:10,515::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:10,516::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4884::DEBUG::2014-09-09 12:12:10,517::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:11,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:11,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898705 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) (10343) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:12,046::__init__::225::IOProcess::(_processLogs) (10343) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:12,047::__init__::225::IOProcess::(_processLogs) (10343) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:12,047::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:12:12,048::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:12:12,056::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117771 s, 954 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:12,056::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:12,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:12,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:12,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:12,057::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:12,057::__init__::225::IOProcess::(_processLogs) (10344) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:12,057::__init__::225::IOProcess::(_processLogs) (10344) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:12,057::__init__::225::IOProcess::(_processLogs) (10344) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:12,057::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:13,523::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:13,524::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4885::DEBUG::2014-09-09 12:12:13,525::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:13,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:13,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894473 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:15,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4886::DEBUG::2014-09-09 12:12:15,679::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:12:15,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4886::DEBUG::2014-09-09 12:12:15,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcfc3883-0f5b-4ff0-8fb6-91be4d3646bc`::moving from state init -> state preparing >Thread-4886::INFO::2014-09-09 12:12:15,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4886::INFO::2014-09-09 12:12:15,680::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4886::DEBUG::2014-09-09 12:12:15,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcfc3883-0f5b-4ff0-8fb6-91be4d3646bc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4886::DEBUG::2014-09-09 12:12:15,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcfc3883-0f5b-4ff0-8fb6-91be4d3646bc`::moving from state preparing -> state finished >Thread-4886::DEBUG::2014-09-09 12:12:15,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4886::DEBUG::2014-09-09 12:12:15,681::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4886::DEBUG::2014-09-09 12:12:15,681::task::993::Storage.TaskManager.Task::(_decref) Task=`fcfc3883-0f5b-4ff0-8fb6-91be4d3646bc`::ref 0 aborting False >Thread-4886::DEBUG::2014-09-09 12:12:15,681::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4886::DEBUG::2014-09-09 12:12:15,681::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:15,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4887::DEBUG::2014-09-09 12:12:15,736::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:12:15,736::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4887::DEBUG::2014-09-09 12:12:15,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`380acd3e-d6c7-4bdf-8fa1-9ed78be86950`::moving from state init -> state preparing >Thread-4887::INFO::2014-09-09 12:12:15,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4887::DEBUG::2014-09-09 12:12:15,737::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3745b3d8-be08-4d93-bf3a-b35aacf935ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4887::DEBUG::2014-09-09 12:12:15,737::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4887::DEBUG::2014-09-09 12:12:15,738::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4887::DEBUG::2014-09-09 12:12:15,738::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`3745b3d8-be08-4d93-bf3a-b35aacf935ff`::Granted request >Thread-4887::DEBUG::2014-09-09 12:12:15,739::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`380acd3e-d6c7-4bdf-8fa1-9ed78be86950`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4887::DEBUG::2014-09-09 12:12:15,739::task::993::Storage.TaskManager.Task::(_decref) Task=`380acd3e-d6c7-4bdf-8fa1-9ed78be86950`::ref 1 aborting False >Thread-4887::INFO::2014-09-09 12:12:15,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4887::DEBUG::2014-09-09 12:12:15,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`380acd3e-d6c7-4bdf-8fa1-9ed78be86950`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4887::DEBUG::2014-09-09 12:12:15,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`380acd3e-d6c7-4bdf-8fa1-9ed78be86950`::moving from state preparing -> state finished >Thread-4887::DEBUG::2014-09-09 12:12:15,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4887::DEBUG::2014-09-09 12:12:15,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4887::DEBUG::2014-09-09 12:12:15,741::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4887::DEBUG::2014-09-09 12:12:15,741::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4887::DEBUG::2014-09-09 12:12:15,741::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4887::DEBUG::2014-09-09 12:12:15,741::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4887::DEBUG::2014-09-09 12:12:15,741::task::993::Storage.TaskManager.Task::(_decref) Task=`380acd3e-d6c7-4bdf-8fa1-9ed78be86950`::ref 0 aborting False >Thread-4887::DEBUG::2014-09-09 12:12:15,741::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4887::DEBUG::2014-09-09 12:12:15,742::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:15,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:16,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895954 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) (10345) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:16,421::__init__::225::IOProcess::(_processLogs) (10345) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:16,422::__init__::225::IOProcess::(_processLogs) (10345) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:16,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:12:16,422::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:12:16,429::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000921977 s, 385 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:16,430::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:16,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:16,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:16,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:16,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:16,431::__init__::225::IOProcess::(_processLogs) (10346) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:16,431::__init__::225::IOProcess::(_processLogs) (10346) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:16,431::__init__::225::IOProcess::(_processLogs) (10346) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:16,431::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:16,530::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:16,530::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4888::DEBUG::2014-09-09 12:12:16,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:18,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:18,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894209 s, 11.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:19,535::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:19,537::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4889::DEBUG::2014-09-09 12:12:19,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6b9760e-0ce3-4198-bc2f-bd9d3fe45df9`::moving from state init -> state preparing >Thread-4889::INFO::2014-09-09 12:12:19,541::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4889::INFO::2014-09-09 12:12:19,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117771', 'lastCheck': '7.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910553', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000921977', 'lastCheck': '3.1', 'valid': True}} >Thread-4889::DEBUG::2014-09-09 12:12:19,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6b9760e-0ce3-4198-bc2f-bd9d3fe45df9`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117771', 'lastCheck': '7.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000910553', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000921977', 'lastCheck': '3.1', 'valid': True}} >Thread-4889::DEBUG::2014-09-09 12:12:19,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6b9760e-0ce3-4198-bc2f-bd9d3fe45df9`::moving from state preparing -> state finished >Thread-4889::DEBUG::2014-09-09 12:12:19,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4889::DEBUG::2014-09-09 12:12:19,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4889::DEBUG::2014-09-09 12:12:19,544::task::993::Storage.TaskManager.Task::(_decref) Task=`b6b9760e-0ce3-4198-bc2f-bd9d3fe45df9`::ref 0 aborting False >Thread-4889::DEBUG::2014-09-09 12:12:19,548::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:19,555::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:19,556::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4890::DEBUG::2014-09-09 12:12:19,559::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:19,714::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:19,715::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:19,716::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:19,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:19,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:19,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:19,719::__init__::225::IOProcess::(_processLogs) (10347) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:19,720::__init__::225::IOProcess::(_processLogs) (10347) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:19,720::__init__::225::IOProcess::(_processLogs) (10347) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:19,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:12:19,722::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:12:19,722::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:12:19,732::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000923838 s, 593 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:19,733::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:19,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:19,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:19,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:19,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:19,737::__init__::225::IOProcess::(_processLogs) (10348) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:19,737::__init__::225::IOProcess::(_processLogs) (10348) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:19,738::__init__::225::IOProcess::(_processLogs) (10348) Building response >Thread-19::DEBUG::2014-09-09 12:12:19,738::__init__::225::IOProcess::(_processLogs) (10348) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:19,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:19,739::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:12:19,740::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:12:19,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:19,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:19,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:19,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:19,743::__init__::225::IOProcess::(_processLogs) (10349) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:19,743::__init__::225::IOProcess::(_processLogs) (10349) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:19,744::__init__::225::IOProcess::(_processLogs) (10349) Building response >Thread-19::DEBUG::2014-09-09 12:12:19,744::__init__::225::IOProcess::(_processLogs) (10349) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:19,745::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:19,745::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:19,746::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:12:19,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:19,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:19,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:19,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:19,749::__init__::225::IOProcess::(_processLogs) (10350) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:19,750::__init__::225::IOProcess::(_processLogs) (10350) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:19,750::__init__::225::IOProcess::(_processLogs) (10350) Building response >Thread-19::DEBUG::2014-09-09 12:12:19,750::__init__::225::IOProcess::(_processLogs) (10350) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:19,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:19,751::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:19,752::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:12:19,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:19,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:19,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:19,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:19,755::__init__::225::IOProcess::(_processLogs) (10351) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:19,756::__init__::225::IOProcess::(_processLogs) (10351) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:19,757::__init__::225::IOProcess::(_processLogs) (10351) Building response >Thread-19::DEBUG::2014-09-09 12:12:19,757::__init__::225::IOProcess::(_processLogs) (10351) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:19,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:19,758::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:12:20,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:20,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0939092 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:22,058::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:22,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:22,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:22,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:22,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:22,059::__init__::225::IOProcess::(_processLogs) (10352) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:22,059::__init__::225::IOProcess::(_processLogs) (10352) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:22,059::__init__::225::IOProcess::(_processLogs) (10352) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:22,059::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:12:22,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:12:22,067::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107981 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:22,067::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:22,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:22,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:22,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:22,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:22,068::__init__::225::IOProcess::(_processLogs) (10353) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:22,068::__init__::225::IOProcess::(_processLogs) (10353) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:22,068::__init__::225::IOProcess::(_processLogs) (10353) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:22,068::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:12:22,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:22,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895215 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:22,651::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:22,652::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4891::DEBUG::2014-09-09 12:12:22,653::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:24,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:24,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895282 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:25,659::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:25,660::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4892::DEBUG::2014-09-09 12:12:25,661::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:26,020::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4893::DEBUG::2014-09-09 12:12:26,021::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:12:26,021::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4893::DEBUG::2014-09-09 12:12:26,022::task::595::Storage.TaskManager.Task::(_updateState) Task=`6225a702-e819-4cee-8557-6625545c3c08`::moving from state init -> state preparing >Thread-4893::INFO::2014-09-09 12:12:26,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4893::INFO::2014-09-09 12:12:26,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4893::DEBUG::2014-09-09 12:12:26,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`6225a702-e819-4cee-8557-6625545c3c08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4893::DEBUG::2014-09-09 12:12:26,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`6225a702-e819-4cee-8557-6625545c3c08`::moving from state preparing -> state finished >Thread-4893::DEBUG::2014-09-09 12:12:26,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4893::DEBUG::2014-09-09 12:12:26,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4893::DEBUG::2014-09-09 12:12:26,023::task::993::Storage.TaskManager.Task::(_decref) Task=`6225a702-e819-4cee-8557-6625545c3c08`::ref 0 aborting False >Thread-4893::DEBUG::2014-09-09 12:12:26,023::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4893::DEBUG::2014-09-09 12:12:26,023::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:26,044::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:26,045::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4894::DEBUG::2014-09-09 12:12:26,045::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4894::DEBUG::2014-09-09 12:12:26,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`68105da5-801c-4114-a5dc-29643d3cf0d1`::moving from state init -> state preparing >Thread-4894::INFO::2014-09-09 12:12:26,046::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4894::DEBUG::2014-09-09 12:12:26,046::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`61f5fec5-4818-4f3d-8796-89fc0c995741`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4894::DEBUG::2014-09-09 12:12:26,046::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4894::DEBUG::2014-09-09 12:12:26,046::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4894::DEBUG::2014-09-09 12:12:26,046::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`61f5fec5-4818-4f3d-8796-89fc0c995741`::Granted request >Thread-4894::DEBUG::2014-09-09 12:12:26,047::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68105da5-801c-4114-a5dc-29643d3cf0d1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4894::DEBUG::2014-09-09 12:12:26,047::task::993::Storage.TaskManager.Task::(_decref) Task=`68105da5-801c-4114-a5dc-29643d3cf0d1`::ref 1 aborting False >Thread-4894::INFO::2014-09-09 12:12:26,048::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4894::DEBUG::2014-09-09 12:12:26,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`68105da5-801c-4114-a5dc-29643d3cf0d1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4894::DEBUG::2014-09-09 12:12:26,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`68105da5-801c-4114-a5dc-29643d3cf0d1`::moving from state preparing -> state finished >Thread-4894::DEBUG::2014-09-09 12:12:26,049::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4894::DEBUG::2014-09-09 12:12:26,049::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4894::DEBUG::2014-09-09 12:12:26,049::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4894::DEBUG::2014-09-09 12:12:26,049::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4894::DEBUG::2014-09-09 12:12:26,049::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4894::DEBUG::2014-09-09 12:12:26,049::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4894::DEBUG::2014-09-09 12:12:26,049::task::993::Storage.TaskManager.Task::(_decref) Task=`68105da5-801c-4114-a5dc-29643d3cf0d1`::ref 0 aborting False >Thread-4894::DEBUG::2014-09-09 12:12:26,049::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4894::DEBUG::2014-09-09 12:12:26,050::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:26,432::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:26,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:26,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:26,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:26,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:26,433::__init__::225::IOProcess::(_processLogs) (10354) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:26,433::__init__::225::IOProcess::(_processLogs) (10354) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:26,433::__init__::225::IOProcess::(_processLogs) (10354) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:26,433::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:12:26,434::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:12:26,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00097551 s, 364 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) (10355) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:26,441::__init__::225::IOProcess::(_processLogs) (10355) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:26,442::__init__::225::IOProcess::(_processLogs) (10355) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:26,442::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:12:26,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:26,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895934 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:12:28,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:28,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:28,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4895::DEBUG::2014-09-09 12:12:28,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:28,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895174 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:29,756::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:29,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) (10356) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) (10356) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) (10356) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:29,757::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:12:29,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:12:29,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000971922 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) (10357) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:29,766::__init__::225::IOProcess::(_processLogs) (10357) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:29,767::__init__::225::IOProcess::(_processLogs) (10357) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:29,767::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:12:29,768::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:12:29,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:29,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:29,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:29,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:29,769::__init__::225::IOProcess::(_processLogs) (10358) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) (10358) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) (10358) Building response >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) (10358) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:29,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) (10359) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) (10359) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) (10359) Building response >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) (10359) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:12:29,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) (10360) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) (10360) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) (10360) Building response >Thread-19::DEBUG::2014-09-09 12:12:29,772::__init__::225::IOProcess::(_processLogs) (10360) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:29,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:29,773::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:12:30,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:30,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896228 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:31,682::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:31,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4896::DEBUG::2014-09-09 12:12:31,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) (10361) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:32,070::__init__::225::IOProcess::(_processLogs) (10361) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:32,071::__init__::225::IOProcess::(_processLogs) (10361) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:32,071::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:12:32,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:12:32,078::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00104916 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) (10362) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:32,079::__init__::225::IOProcess::(_processLogs) (10362) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:32,080::__init__::225::IOProcess::(_processLogs) (10362) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:32,080::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:12:32,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:32,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895504 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:34,688::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:34,688::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4897::DEBUG::2014-09-09 12:12:34,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`2958602f-92c1-468b-a4a4-d0249bdf395f`::moving from state init -> state preparing >Thread-4897::INFO::2014-09-09 12:12:34,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4897::INFO::2014-09-09 12:12:34,690::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104916', 'lastCheck': '2.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971922', 'lastCheck': '4.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00097551', 'lastCheck': '8.2', 'valid': True}} >Thread-4897::DEBUG::2014-09-09 12:12:34,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`2958602f-92c1-468b-a4a4-d0249bdf395f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104916', 'lastCheck': '2.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971922', 'lastCheck': '4.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00097551', 'lastCheck': '8.2', 'valid': True}} >Thread-4897::DEBUG::2014-09-09 12:12:34,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`2958602f-92c1-468b-a4a4-d0249bdf395f`::moving from state preparing -> state finished >Thread-4897::DEBUG::2014-09-09 12:12:34,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4897::DEBUG::2014-09-09 12:12:34,690::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4897::DEBUG::2014-09-09 12:12:34,690::task::993::Storage.TaskManager.Task::(_decref) Task=`2958602f-92c1-468b-a4a4-d0249bdf395f`::ref 0 aborting False >Thread-4897::DEBUG::2014-09-09 12:12:34,691::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:34,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:34,698::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4898::DEBUG::2014-09-09 12:12:34,698::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:34,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:35,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896377 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:36,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:36,089::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4899::DEBUG::2014-09-09 12:12:36,090::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4899::DEBUG::2014-09-09 12:12:36,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3aaf569-0552-41f6-a07d-ff06f5b91daf`::moving from state init -> state preparing >Thread-4899::INFO::2014-09-09 12:12:36,091::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4899::INFO::2014-09-09 12:12:36,091::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4899::DEBUG::2014-09-09 12:12:36,091::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3aaf569-0552-41f6-a07d-ff06f5b91daf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4899::DEBUG::2014-09-09 12:12:36,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3aaf569-0552-41f6-a07d-ff06f5b91daf`::moving from state preparing -> state finished >Thread-4899::DEBUG::2014-09-09 12:12:36,091::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4899::DEBUG::2014-09-09 12:12:36,091::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4899::DEBUG::2014-09-09 12:12:36,091::task::993::Storage.TaskManager.Task::(_decref) Task=`b3aaf569-0552-41f6-a07d-ff06f5b91daf`::ref 0 aborting False >Thread-4899::DEBUG::2014-09-09 12:12:36,091::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4899::DEBUG::2014-09-09 12:12:36,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:36,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:36,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4900::DEBUG::2014-09-09 12:12:36,121::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4900::DEBUG::2014-09-09 12:12:36,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`78c6623a-c6f3-4ca5-b53b-5be0eab85af7`::moving from state init -> state preparing >Thread-4900::INFO::2014-09-09 12:12:36,122::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4900::DEBUG::2014-09-09 12:12:36,122::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8b4db610-4d25-41ef-a4e7-7a4b94bfbe0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4900::DEBUG::2014-09-09 12:12:36,122::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4900::DEBUG::2014-09-09 12:12:36,122::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4900::DEBUG::2014-09-09 12:12:36,122::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8b4db610-4d25-41ef-a4e7-7a4b94bfbe0f`::Granted request >Thread-4900::DEBUG::2014-09-09 12:12:36,123::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`78c6623a-c6f3-4ca5-b53b-5be0eab85af7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4900::DEBUG::2014-09-09 12:12:36,123::task::993::Storage.TaskManager.Task::(_decref) Task=`78c6623a-c6f3-4ca5-b53b-5be0eab85af7`::ref 1 aborting False >Thread-4900::INFO::2014-09-09 12:12:36,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4900::DEBUG::2014-09-09 12:12:36,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`78c6623a-c6f3-4ca5-b53b-5be0eab85af7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4900::DEBUG::2014-09-09 12:12:36,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`78c6623a-c6f3-4ca5-b53b-5be0eab85af7`::moving from state preparing -> state finished >Thread-4900::DEBUG::2014-09-09 12:12:36,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4900::DEBUG::2014-09-09 12:12:36,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4900::DEBUG::2014-09-09 12:12:36,125::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4900::DEBUG::2014-09-09 12:12:36,125::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4900::DEBUG::2014-09-09 12:12:36,125::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4900::DEBUG::2014-09-09 12:12:36,125::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4900::DEBUG::2014-09-09 12:12:36,125::task::993::Storage.TaskManager.Task::(_decref) Task=`78c6623a-c6f3-4ca5-b53b-5be0eab85af7`::ref 0 aborting False >Thread-4900::DEBUG::2014-09-09 12:12:36,125::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4900::DEBUG::2014-09-09 12:12:36,125::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) (10363) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:36,443::__init__::225::IOProcess::(_processLogs) (10363) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:36,445::__init__::225::IOProcess::(_processLogs) (10363) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:36,445::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:12:36,445::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:12:36,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00086535 s, 410 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) (10364) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:36,454::__init__::225::IOProcess::(_processLogs) (10364) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:36,455::__init__::225::IOProcess::(_processLogs) (10364) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:36,455::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:12:37,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:37,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895785 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:37,794::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:37,795::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4901::DEBUG::2014-09-09 12:12:37,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:39,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:39,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896318 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:39,772::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) (10365) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) (10365) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:39,773::__init__::225::IOProcess::(_processLogs) (10365) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:39,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:12:39,774::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:12:39,774::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:12:39,782::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000908501 s, 603 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:39,783::__init__::225::IOProcess::(_processLogs) (10366) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:39,784::__init__::225::IOProcess::(_processLogs) (10366) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:39,784::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10366) Building response >Thread-19::DEBUG::2014-09-09 12:12:39,784::__init__::225::IOProcess::(_processLogs) (10366) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:39,784::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:39,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) (10367) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) (10367) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) (10367) Building response >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) (10367) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:12:39,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) (10368) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) (10368) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) (10368) Building response >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) (10368) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:39,787::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) (10369) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) (10369) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) (10369) Building response >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) (10369) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:39,788::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:40,804::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:40,805::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4902::DEBUG::2014-09-09 12:12:40,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:41,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:41,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895342 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:42,081::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:42,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:42,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:42,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:42,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:42,082::__init__::225::IOProcess::(_processLogs) (10370) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:42,082::__init__::225::IOProcess::(_processLogs) (10370) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:42,083::__init__::225::IOProcess::(_processLogs) (10370) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:42,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:12:42,083::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:12:42,091::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115672 s, 971 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) (10371) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:42,092::__init__::225::IOProcess::(_processLogs) (10371) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:42,093::__init__::225::IOProcess::(_processLogs) (10371) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:42,093::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:12:43,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:43,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895723 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:43,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:43,817::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4903::DEBUG::2014-09-09 12:12:43,818::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:45,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:45,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897329 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:46,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4904::DEBUG::2014-09-09 12:12:46,199::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:12:46,199::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4904::DEBUG::2014-09-09 12:12:46,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a426a4f-8e05-4103-8866-0d841ffac0d7`::moving from state init -> state preparing >Thread-4904::INFO::2014-09-09 12:12:46,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4904::INFO::2014-09-09 12:12:46,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4904::DEBUG::2014-09-09 12:12:46,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a426a4f-8e05-4103-8866-0d841ffac0d7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4904::DEBUG::2014-09-09 12:12:46,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a426a4f-8e05-4103-8866-0d841ffac0d7`::moving from state preparing -> state finished >Thread-4904::DEBUG::2014-09-09 12:12:46,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4904::DEBUG::2014-09-09 12:12:46,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4904::DEBUG::2014-09-09 12:12:46,201::task::993::Storage.TaskManager.Task::(_decref) Task=`6a426a4f-8e05-4103-8866-0d841ffac0d7`::ref 0 aborting False >Thread-4904::DEBUG::2014-09-09 12:12:46,201::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4904::DEBUG::2014-09-09 12:12:46,201::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:46,230::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:46,230::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4905::DEBUG::2014-09-09 12:12:46,230::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4905::DEBUG::2014-09-09 12:12:46,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`a155b2d5-eac2-4b4e-bb49-4aa4779fa192`::moving from state init -> state preparing >Thread-4905::INFO::2014-09-09 12:12:46,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4905::DEBUG::2014-09-09 12:12:46,232::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0bc13fac-6b81-4422-afef-e0e09fc33a07`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4905::DEBUG::2014-09-09 12:12:46,232::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4905::DEBUG::2014-09-09 12:12:46,232::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4905::DEBUG::2014-09-09 12:12:46,232::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0bc13fac-6b81-4422-afef-e0e09fc33a07`::Granted request >Thread-4905::DEBUG::2014-09-09 12:12:46,232::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a155b2d5-eac2-4b4e-bb49-4aa4779fa192`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4905::DEBUG::2014-09-09 12:12:46,232::task::993::Storage.TaskManager.Task::(_decref) Task=`a155b2d5-eac2-4b4e-bb49-4aa4779fa192`::ref 1 aborting False >Thread-4905::INFO::2014-09-09 12:12:46,234::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4905::DEBUG::2014-09-09 12:12:46,234::task::1191::Storage.TaskManager.Task::(prepare) Task=`a155b2d5-eac2-4b4e-bb49-4aa4779fa192`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4905::DEBUG::2014-09-09 12:12:46,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`a155b2d5-eac2-4b4e-bb49-4aa4779fa192`::moving from state preparing -> state finished >Thread-4905::DEBUG::2014-09-09 12:12:46,234::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4905::DEBUG::2014-09-09 12:12:46,234::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4905::DEBUG::2014-09-09 12:12:46,234::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4905::DEBUG::2014-09-09 12:12:46,235::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4905::DEBUG::2014-09-09 12:12:46,235::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4905::DEBUG::2014-09-09 12:12:46,235::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4905::DEBUG::2014-09-09 12:12:46,235::task::993::Storage.TaskManager.Task::(_decref) Task=`a155b2d5-eac2-4b4e-bb49-4aa4779fa192`::ref 0 aborting False >Thread-4905::DEBUG::2014-09-09 12:12:46,235::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4905::DEBUG::2014-09-09 12:12:46,235::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) (10372) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:46,456::__init__::225::IOProcess::(_processLogs) (10372) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:46,457::__init__::225::IOProcess::(_processLogs) (10372) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:46,457::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:12:46,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:12:46,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000947278 s, 375 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) (10373) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:46,465::__init__::225::IOProcess::(_processLogs) (10373) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:46,466::__init__::225::IOProcess::(_processLogs) (10373) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:46,466::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:46,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:46,825::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4906::DEBUG::2014-09-09 12:12:46,826::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:47,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:47,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089684 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:12:49,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:49,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0974141 s, 10.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:49,790::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:49,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:49,792::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:49,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:49,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:49,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:49,795::__init__::225::IOProcess::(_processLogs) (10374) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:49,796::__init__::225::IOProcess::(_processLogs) (10374) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:49,797::__init__::225::IOProcess::(_processLogs) (10374) Queuing response >Thread-24::DEBUG::2014-09-09 12:12:49,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:12:49,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:49,804::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:12:49,807::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000924384 s, 593 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:49,809::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:49,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:49,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:49,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:49,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:49,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:49,815::__init__::225::IOProcess::(_processLogs) (10375) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:49,816::__init__::225::IOProcess::(_processLogs) (10375) Building response >Thread-19::DEBUG::2014-09-09 12:12:49,817::__init__::225::IOProcess::(_processLogs) (10375) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:49,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:49,819::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:12:49,820::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:12:49,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:49,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:49,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:49,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:49,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:49,825::__init__::225::IOProcess::(_processLogs) (10376) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:49,826::__init__::225::IOProcess::(_processLogs) (10376) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:49,827::__init__::225::IOProcess::(_processLogs) (10376) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:49,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:49,829::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:49,831::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:12:49,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:49,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:49,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:49,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-19::DEBUG::2014-09-09 12:12:49,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:49,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >JsonRpcServer::DEBUG::2014-09-09 12:12:49,838::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-19::DEBUG::2014-09-09 12:12:49,839::__init__::225::IOProcess::(_processLogs) (10377) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:49,840::__init__::225::IOProcess::(_processLogs) (10377) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:49,842::__init__::225::IOProcess::(_processLogs) (10377) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:49,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:49,845::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-4907::DEBUG::2014-09-09 12:12:49,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`227e1a72-830c-4dd3-ba14-b851d29fe150`::moving from state init -> state preparing >Thread-19::DEBUG::2014-09-09 12:12:49,848::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-4907::INFO::2014-09-09 12:12:49,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2014-09-09 12:12:49,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:49,852::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-4907::INFO::2014-09-09 12:12:49,852::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115672', 'lastCheck': '7.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000924384', 'lastCheck': '0.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000947278', 'lastCheck': '3.4', 'valid': True}} >Thread-19::DEBUG::2014-09-09 12:12:49,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-4907::DEBUG::2014-09-09 12:12:49,854::task::1191::Storage.TaskManager.Task::(prepare) Task=`227e1a72-830c-4dd3-ba14-b851d29fe150`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00115672', 'lastCheck': '7.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000924384', 'lastCheck': '0.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000947278', 'lastCheck': '3.4', 'valid': True}} >Thread-19::DEBUG::2014-09-09 12:12:49,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-4907::DEBUG::2014-09-09 12:12:49,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`227e1a72-830c-4dd3-ba14-b851d29fe150`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-09-09 12:12:49,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-4907::DEBUG::2014-09-09 12:12:49,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4907::DEBUG::2014-09-09 12:12:49,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 12:12:49,858::__init__::225::IOProcess::(_processLogs) (10378) Finding callback 'access'... >Thread-4907::DEBUG::2014-09-09 12:12:49,859::task::993::Storage.TaskManager.Task::(_decref) Task=`227e1a72-830c-4dd3-ba14-b851d29fe150`::ref 0 aborting False >Thread-19::DEBUG::2014-09-09 12:12:49,860::__init__::225::IOProcess::(_processLogs) (10378) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:49,862::__init__::225::IOProcess::(_processLogs) (10378) Building response >Thread-19::DEBUG::2014-09-09 12:12:49,863::__init__::225::IOProcess::(_processLogs) (10378) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:49,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:49,867::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-4907::DEBUG::2014-09-09 12:12:49,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:49,881::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:49,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4908::DEBUG::2014-09-09 12:12:49,888::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:51,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:52,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895709 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:52,094::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:52,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:52,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:52,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:52,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:52,095::__init__::225::IOProcess::(_processLogs) (10379) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:52,095::__init__::225::IOProcess::(_processLogs) (10379) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:52,095::__init__::225::IOProcess::(_processLogs) (10379) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:52,095::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:12:52,096::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:12:52,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114596 s, 980 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:52,103::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) (10380) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) (10380) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) (10380) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:52,104::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:52,962::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:52,962::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4909::DEBUG::2014-09-09 12:12:52,963::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:54,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:54,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896214 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:55,972::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:55,973::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4910::DEBUG::2014-09-09 12:12:55,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:12:56,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:56,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895669 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:56,274::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:56,274::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4911::DEBUG::2014-09-09 12:12:56,274::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4911::DEBUG::2014-09-09 12:12:56,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bde9a37-37d7-45f9-ba8c-759d4a860e5e`::moving from state init -> state preparing >Thread-4911::INFO::2014-09-09 12:12:56,276::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4911::INFO::2014-09-09 12:12:56,276::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4911::DEBUG::2014-09-09 12:12:56,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bde9a37-37d7-45f9-ba8c-759d4a860e5e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4911::DEBUG::2014-09-09 12:12:56,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bde9a37-37d7-45f9-ba8c-759d4a860e5e`::moving from state preparing -> state finished >Thread-4911::DEBUG::2014-09-09 12:12:56,276::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4911::DEBUG::2014-09-09 12:12:56,276::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4911::DEBUG::2014-09-09 12:12:56,276::task::993::Storage.TaskManager.Task::(_decref) Task=`0bde9a37-37d7-45f9-ba8c-759d4a860e5e`::ref 0 aborting False >Thread-4911::DEBUG::2014-09-09 12:12:56,276::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4911::DEBUG::2014-09-09 12:12:56,276::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:56,306::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:56,306::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4912::DEBUG::2014-09-09 12:12:56,306::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4912::DEBUG::2014-09-09 12:12:56,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`03a0ef17-a181-4def-9a08-668d646216dc`::moving from state init -> state preparing >Thread-4912::INFO::2014-09-09 12:12:56,307::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4912::DEBUG::2014-09-09 12:12:56,307::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d950538d-8819-456b-982a-80a34d8e2fcb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4912::DEBUG::2014-09-09 12:12:56,307::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4912::DEBUG::2014-09-09 12:12:56,308::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4912::DEBUG::2014-09-09 12:12:56,308::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d950538d-8819-456b-982a-80a34d8e2fcb`::Granted request >Thread-4912::DEBUG::2014-09-09 12:12:56,308::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`03a0ef17-a181-4def-9a08-668d646216dc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4912::DEBUG::2014-09-09 12:12:56,308::task::993::Storage.TaskManager.Task::(_decref) Task=`03a0ef17-a181-4def-9a08-668d646216dc`::ref 1 aborting False >Thread-4912::INFO::2014-09-09 12:12:56,310::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4912::DEBUG::2014-09-09 12:12:56,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`03a0ef17-a181-4def-9a08-668d646216dc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4912::DEBUG::2014-09-09 12:12:56,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`03a0ef17-a181-4def-9a08-668d646216dc`::moving from state preparing -> state finished >Thread-4912::DEBUG::2014-09-09 12:12:56,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4912::DEBUG::2014-09-09 12:12:56,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4912::DEBUG::2014-09-09 12:12:56,310::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4912::DEBUG::2014-09-09 12:12:56,310::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4912::DEBUG::2014-09-09 12:12:56,310::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4912::DEBUG::2014-09-09 12:12:56,310::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4912::DEBUG::2014-09-09 12:12:56,310::task::993::Storage.TaskManager.Task::(_decref) Task=`03a0ef17-a181-4def-9a08-668d646216dc`::ref 0 aborting False >Thread-4912::DEBUG::2014-09-09 12:12:56,311::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4912::DEBUG::2014-09-09 12:12:56,311::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) (10381) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:56,467::__init__::225::IOProcess::(_processLogs) (10381) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:56,468::__init__::225::IOProcess::(_processLogs) (10381) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:56,468::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:12:56,469::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:12:56,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000887215 s, 400 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) (10382) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:56,476::__init__::225::IOProcess::(_processLogs) (10382) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:56,477::__init__::225::IOProcess::(_processLogs) (10382) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:56,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:56,478::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:12:58,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:12:58,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089678 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:12:58,981::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:12:58,982::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4913::DEBUG::2014-09-09 12:12:58,983::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) (10383) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) (10383) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:59,850::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(10383) Building response >Thread-19::DEBUG::2014-09-09 12:12:59,851::__init__::225::IOProcess::(_processLogs) (10383) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:59,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:59,851::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:12:59,851::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:12:59,859::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00105314 s, 520 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:12:59,860::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:12:59,860::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:12:59,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:59,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:59,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:59,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:59,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:59,861::__init__::225::IOProcess::(_processLogs) (10384) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:12:59,861::__init__::225::IOProcess::(_processLogs) (10384) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:12:59,861::__init__::225::IOProcess::(_processLogs) (10384) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:59,861::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:12:59,862::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:12:59,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:59,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:59,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:59,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) (10385) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) (10385) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) (10385) Building response >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) (10385) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:12:59,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) (10386) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) (10386) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) (10386) Building response >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) (10386) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:12:59,864::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) (10387) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) (10387) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) (10387) Building response >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) (10387) Queuing response >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:12:59,865::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:13:00,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:00,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895906 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:01,989::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:01,990::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4914::DEBUG::2014-09-09 12:13:01,990::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) (10388) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) (10388) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:02,106::__init__::225::IOProcess::(_processLogs) (10388) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:02,107::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:13:02,107::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:13:02,115::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00102777 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:02,115::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:02,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) (10389) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) (10389) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) (10389) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:02,116::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:13:02,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:02,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896656 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:13:04,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:04,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896849 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:04,995::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:04,996::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4915::DEBUG::2014-09-09 12:13:04,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbd81bf2-8b23-463e-9104-5162fa7776a4`::moving from state init -> state preparing >Thread-4915::INFO::2014-09-09 12:13:04,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4915::INFO::2014-09-09 12:13:04,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102777', 'lastCheck': '2.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105314', 'lastCheck': '5.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000887215', 'lastCheck': '8.5', 'valid': True}} >Thread-4915::DEBUG::2014-09-09 12:13:04,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbd81bf2-8b23-463e-9104-5162fa7776a4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102777', 'lastCheck': '2.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105314', 'lastCheck': '5.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000887215', 'lastCheck': '8.5', 'valid': True}} >Thread-4915::DEBUG::2014-09-09 12:13:04,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbd81bf2-8b23-463e-9104-5162fa7776a4`::moving from state preparing -> state finished >Thread-4915::DEBUG::2014-09-09 12:13:04,997::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4915::DEBUG::2014-09-09 12:13:04,997::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4915::DEBUG::2014-09-09 12:13:04,998::task::993::Storage.TaskManager.Task::(_decref) Task=`fbd81bf2-8b23-463e-9104-5162fa7776a4`::ref 0 aborting False >Thread-4915::DEBUG::2014-09-09 12:13:04,998::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:05,006::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:05,006::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4916::DEBUG::2014-09-09 12:13:05,007::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:06,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4917::DEBUG::2014-09-09 12:13:06,351::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:13:06,351::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4917::DEBUG::2014-09-09 12:13:06,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`5960a536-0f58-4b50-b71b-7062b4abdf14`::moving from state init -> state preparing >Thread-4917::INFO::2014-09-09 12:13:06,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4917::INFO::2014-09-09 12:13:06,352::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4917::DEBUG::2014-09-09 12:13:06,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`5960a536-0f58-4b50-b71b-7062b4abdf14`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4917::DEBUG::2014-09-09 12:13:06,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`5960a536-0f58-4b50-b71b-7062b4abdf14`::moving from state preparing -> state finished >Thread-4917::DEBUG::2014-09-09 12:13:06,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4917::DEBUG::2014-09-09 12:13:06,353::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4917::DEBUG::2014-09-09 12:13:06,353::task::993::Storage.TaskManager.Task::(_decref) Task=`5960a536-0f58-4b50-b71b-7062b4abdf14`::ref 0 aborting False >Thread-4917::DEBUG::2014-09-09 12:13:06,353::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4917::DEBUG::2014-09-09 12:13:06,353::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:06,381::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:06,382::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4918::DEBUG::2014-09-09 12:13:06,382::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4918::DEBUG::2014-09-09 12:13:06,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bee2602-90c3-41c1-898d-3cfd04f373c9`::moving from state init -> state preparing >Thread-4918::INFO::2014-09-09 12:13:06,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4918::DEBUG::2014-09-09 12:13:06,383::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1f39c80d-4ac8-4d5b-80cd-5cdc733f98ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4918::DEBUG::2014-09-09 12:13:06,383::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4918::DEBUG::2014-09-09 12:13:06,383::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4918::DEBUG::2014-09-09 12:13:06,383::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`1f39c80d-4ac8-4d5b-80cd-5cdc733f98ed`::Granted request >Thread-4918::DEBUG::2014-09-09 12:13:06,384::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1bee2602-90c3-41c1-898d-3cfd04f373c9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4918::DEBUG::2014-09-09 12:13:06,384::task::993::Storage.TaskManager.Task::(_decref) Task=`1bee2602-90c3-41c1-898d-3cfd04f373c9`::ref 1 aborting False >Thread-4918::INFO::2014-09-09 12:13:06,385::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4918::DEBUG::2014-09-09 12:13:06,385::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bee2602-90c3-41c1-898d-3cfd04f373c9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4918::DEBUG::2014-09-09 12:13:06,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bee2602-90c3-41c1-898d-3cfd04f373c9`::moving from state preparing -> state finished >Thread-4918::DEBUG::2014-09-09 12:13:06,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4918::DEBUG::2014-09-09 12:13:06,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4918::DEBUG::2014-09-09 12:13:06,386::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4918::DEBUG::2014-09-09 12:13:06,386::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4918::DEBUG::2014-09-09 12:13:06,386::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4918::DEBUG::2014-09-09 12:13:06,386::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4918::DEBUG::2014-09-09 12:13:06,386::task::993::Storage.TaskManager.Task::(_decref) Task=`1bee2602-90c3-41c1-898d-3cfd04f373c9`::ref 0 aborting False >Thread-4918::DEBUG::2014-09-09 12:13:06,386::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4918::DEBUG::2014-09-09 12:13:06,386::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:06,478::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:06,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:06,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:06,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:06,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:06,479::__init__::225::IOProcess::(_processLogs) (10390) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:06,479::__init__::225::IOProcess::(_processLogs) (10390) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:06,479::__init__::225::IOProcess::(_processLogs) (10390) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:06,479::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:13:06,480::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:13:06,487::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000963217 s, 369 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:06,488::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:06,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:06,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:06,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:06,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:06,488::__init__::225::IOProcess::(_processLogs) (10391) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:06,489::__init__::225::IOProcess::(_processLogs) (10391) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:06,489::__init__::225::IOProcess::(_processLogs) (10391) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:06,489::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:13:06,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:06,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896906 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:08,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:08,089::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4919::DEBUG::2014-09-09 12:13:08,089::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:08,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:08,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08961 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:09,866::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:09,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:09,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:09,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:09,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:09,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:09,867::__init__::225::IOProcess::(_processLogs) (10392) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:09,867::__init__::225::IOProcess::(_processLogs) (10392) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:09,867::__init__::225::IOProcess::(_processLogs) (10392) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:09,867::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:13:09,868::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:13:09,875::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0010034 s, 546 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) (10393) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:09,876::__init__::225::IOProcess::(_processLogs) (10393) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:09,877::__init__::225::IOProcess::(_processLogs) (10393) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:09,877::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) (10394) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) (10394) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:09,878::__init__::225::IOProcess::(_processLogs) (10394) Building response >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) (10394) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:09,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) (10395) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) (10395) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) (10395) Building response >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) (10395) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:09,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:09,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:09,881::__init__::225::IOProcess::(_processLogs) (10396) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:09,881::__init__::225::IOProcess::(_processLogs) (10396) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:09,881::__init__::225::IOProcess::(_processLogs) (10396) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:09,881::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:13:10,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:10,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896895 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:11,096::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:11,097::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4920::DEBUG::2014-09-09 12:13:11,098::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-23::DEBUG::2014-09-09 12:13:12,117::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:13:12,119::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:13:12,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:12,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,120::__init__::225::IOProcess::(_processLogs) (10397) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:12,120::__init__::225::IOProcess::(_processLogs) (10397) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:12,120::__init__::225::IOProcess::(_processLogs) (10397) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) (10398) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) (10398) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:12,121::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) (10399) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) (10399) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) (10398) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,122::__init__::225::IOProcess::(_processLogs) (10399) Building response >Thread-19::DEBUG::2014-09-09 12:13:12,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:12,123::__init__::225::IOProcess::(_processLogs) (10399) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,123::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:13:12,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:12,123::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-23::DEBUG::2014-09-09 12:13:12,124::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) (10400) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:13:12,125::__init__::225::IOProcess::(_processLogs) (10400) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:13:12,175::__init__::225::IOProcess::(_processLogs) (10400) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,175::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-23::DEBUG::2014-09-09 12:13:12,175::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) (10401) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:13:12,176::__init__::225::IOProcess::(_processLogs) (10401) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:13:12,178::__init__::225::IOProcess::(_processLogs) (10401) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,178::__init__::225::IOProcess::(_processLogs) Sending response sized 1555 >Thread-23::DEBUG::2014-09-09 12:13:12,179::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 12:13:12,179::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 12:13:12,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) (10402) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) (10402) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) (10402) Building response >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) (10402) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) (10403) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:12,181::__init__::225::IOProcess::(_processLogs) (10403) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:12,182::__init__::225::IOProcess::(_processLogs) (10403) Queuing response >Thread-23::DEBUG::2014-09-09 12:13:12,183::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:13:12,183::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-23::INFO::2014-09-09 12:13:12,183::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 12:13:12,183::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) (10404) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) (10404) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:12,184::__init__::225::IOProcess::(_processLogs) (10404) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,185::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:13:12,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:13:12,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109041 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) (10405) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) (10405) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:12,193::__init__::225::IOProcess::(_processLogs) (10405) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:12,194::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:13:12,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:13,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896508 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:14,107::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:14,107::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4924::DEBUG::2014-09-09 12:13:14,108::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:15,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:15,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896245 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:16,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4925::DEBUG::2014-09-09 12:13:16,427::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:13:16,427::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4925::DEBUG::2014-09-09 12:13:16,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`f69a43e7-99e2-42fe-90e4-bbec976fa74f`::moving from state init -> state preparing >Thread-4925::INFO::2014-09-09 12:13:16,429::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4925::INFO::2014-09-09 12:13:16,429::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4925::DEBUG::2014-09-09 12:13:16,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`f69a43e7-99e2-42fe-90e4-bbec976fa74f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4925::DEBUG::2014-09-09 12:13:16,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`f69a43e7-99e2-42fe-90e4-bbec976fa74f`::moving from state preparing -> state finished >Thread-4925::DEBUG::2014-09-09 12:13:16,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4925::DEBUG::2014-09-09 12:13:16,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4925::DEBUG::2014-09-09 12:13:16,429::task::993::Storage.TaskManager.Task::(_decref) Task=`f69a43e7-99e2-42fe-90e4-bbec976fa74f`::ref 0 aborting False >Thread-4925::DEBUG::2014-09-09 12:13:16,429::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4925::DEBUG::2014-09-09 12:13:16,430::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:16,457::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4926::DEBUG::2014-09-09 12:13:16,458::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:13:16,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4926::DEBUG::2014-09-09 12:13:16,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`3157b0ac-73e0-4aef-89ba-b168111f612b`::moving from state init -> state preparing >Thread-4926::INFO::2014-09-09 12:13:16,458::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4926::DEBUG::2014-09-09 12:13:16,459::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2dda4684-414a-495a-b768-f909d66e69f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4926::DEBUG::2014-09-09 12:13:16,459::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4926::DEBUG::2014-09-09 12:13:16,459::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4926::DEBUG::2014-09-09 12:13:16,459::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2dda4684-414a-495a-b768-f909d66e69f7`::Granted request >Thread-4926::DEBUG::2014-09-09 12:13:16,459::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3157b0ac-73e0-4aef-89ba-b168111f612b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4926::DEBUG::2014-09-09 12:13:16,459::task::993::Storage.TaskManager.Task::(_decref) Task=`3157b0ac-73e0-4aef-89ba-b168111f612b`::ref 1 aborting False >Thread-4926::INFO::2014-09-09 12:13:16,461::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4926::DEBUG::2014-09-09 12:13:16,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`3157b0ac-73e0-4aef-89ba-b168111f612b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4926::DEBUG::2014-09-09 12:13:16,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`3157b0ac-73e0-4aef-89ba-b168111f612b`::moving from state preparing -> state finished >Thread-4926::DEBUG::2014-09-09 12:13:16,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4926::DEBUG::2014-09-09 12:13:16,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4926::DEBUG::2014-09-09 12:13:16,462::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4926::DEBUG::2014-09-09 12:13:16,462::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4926::DEBUG::2014-09-09 12:13:16,462::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4926::DEBUG::2014-09-09 12:13:16,462::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4926::DEBUG::2014-09-09 12:13:16,462::task::993::Storage.TaskManager.Task::(_decref) Task=`3157b0ac-73e0-4aef-89ba-b168111f612b`::ref 0 aborting False >Thread-4926::DEBUG::2014-09-09 12:13:16,462::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4926::DEBUG::2014-09-09 12:13:16,462::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:16,490::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:16,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:16,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:16,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:16,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:16,490::__init__::225::IOProcess::(_processLogs) (10406) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:16,491::__init__::225::IOProcess::(_processLogs) (10406) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:16,491::__init__::225::IOProcess::(_processLogs) (10406) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:16,491::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:13:16,491::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:13:16,499::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000972775 s, 365 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) (10407) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:16,500::__init__::225::IOProcess::(_processLogs) (10407) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:16,501::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10407) Building response >Thread-19::DEBUG::2014-09-09 12:13:16,501::__init__::225::IOProcess::(_processLogs) (10407) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:16,501::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:13:16,502::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:17,113::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:17,114::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4927::DEBUG::2014-09-09 12:13:17,115::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:17,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:17,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900938 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:13:19,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:19,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0941208 s, 10.9 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:13:19,882::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:13:19,885::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,886::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:13:19,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,889::__init__::225::IOProcess::(_processLogs) (10408) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:19,889::__init__::225::IOProcess::(_processLogs) (10408) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:19,890::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10408) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,891::__init__::225::IOProcess::(_processLogs) (10408) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,892::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:13:19,892::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,893::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:13:19,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,894::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,896::__init__::225::IOProcess::(_processLogs) (10409) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:19,896::__init__::225::IOProcess::(_processLogs) (10409) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:19,897::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10409) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,899::__init__::225::IOProcess::(_processLogs) (10409) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,901::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:13:19,902::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,903::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:13:19,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-24::DEBUG::2014-09-09 12:13:19,907::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:13:19,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,909::__init__::225::IOProcess::(_processLogs) (10410) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:19,910::__init__::225::IOProcess::(_processLogs) (10410) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:19,910::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10410) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,911::__init__::225::IOProcess::(_processLogs) (10410) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,912::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,912::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:13:19,913::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,913::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 12:13:19,914::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,916::__init__::225::IOProcess::(_processLogs) (10411) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:13:19,916::__init__::225::IOProcess::(_processLogs) (10411) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:13:19,951::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10411) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,952::__init__::225::IOProcess::(_processLogs) (10411) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,953::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 57 >Thread-24::DEBUG::2014-09-09 12:13:19,953::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:13:19,955::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,955::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 12:13:19,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,957::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,958::__init__::225::IOProcess::(_processLogs) (10412) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:13:19,958::__init__::225::IOProcess::(_processLogs) (10412) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:13:19,959::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10412) Building response >Thread-24::DEBUG::2014-09-09 12:13:19,959::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 12:13:19,960::__init__::225::IOProcess::(_processLogs) (10412) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,962::__init__::225::IOProcess::(_processLogs) Sending response sized 787 >Thread-19::DEBUG::2014-09-09 12:13:19,963::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,963::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 12:13:19,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,966::__init__::225::IOProcess::(_processLogs) (10413) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:19,966::__init__::225::IOProcess::(_processLogs) (10413) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:19,967::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10413) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,968::__init__::225::IOProcess::(_processLogs) (10413) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,969::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:19,969::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:19,970::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:13:19,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-24::DEBUG::2014-09-09 12:13:19,973::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:13:19,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-24::INFO::2014-09-09 12:13:19,973::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 12:13:19,974::__init__::225::IOProcess::(_processLogs) (10414) Finding callback 'glob'... >Thread-24::INFO::2014-09-09 12:13:19,974::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:13:19,975::__init__::225::IOProcess::(_processLogs) (10414) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:19,976::__init__::225::IOProcess::(_processLogs) (10414) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,976::__init__::225::IOProcess::(_processLogs) (10414) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,977::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-19::DEBUG::2014-09-09 12:13:19,978::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:19,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,979::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:19,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,981::__init__::225::IOProcess::(_processLogs) (10415) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:19,981::__init__::225::IOProcess::(_processLogs) (10415) Building response >Thread-24::DEBUG::2014-09-09 12:13:19,982::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:13:19,982::__init__::225::IOProcess::(_processLogs) (10415) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,989::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:13:19,991::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000916856 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:19,992::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:19,992::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,993::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:19,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:19,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:19,995::__init__::225::IOProcess::(_processLogs) (10416) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:19,995::__init__::225::IOProcess::(_processLogs) (10416) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:19,996::__init__::225::IOProcess::(_processLogs) (10416) Building response >Thread-19::DEBUG::2014-09-09 12:13:19,996::__init__::225::IOProcess::(_processLogs) (10416) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:19,997::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:19,997::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:13:19,998::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:13:19,999::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:19,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:20,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:20,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:20,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:20,001::__init__::225::IOProcess::(_processLogs) (10417) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:20,002::__init__::225::IOProcess::(_processLogs) (10417) Building response >Thread-19::DEBUG::2014-09-09 12:13:20,002::__init__::225::IOProcess::(_processLogs) (10417) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:20,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:20,003::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:20,004::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:13:20,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:20,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:20,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:20,006::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:20,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:20,007::__init__::225::IOProcess::(_processLogs) (10418) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:20,007::__init__::225::IOProcess::(_processLogs) (10418) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:20,008::__init__::225::IOProcess::(_processLogs) (10418) Building response >Thread-19::DEBUG::2014-09-09 12:13:20,008::__init__::225::IOProcess::(_processLogs) (10418) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:20,009::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:20,010::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:13:20,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:20,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:20,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:20,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:20,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:20,013::__init__::225::IOProcess::(_processLogs) (10419) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:20,014::__init__::225::IOProcess::(_processLogs) (10419) Building response >Thread-19::DEBUG::2014-09-09 12:13:20,014::__init__::225::IOProcess::(_processLogs) (10419) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:20,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:20,015::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:20,122::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:20,124::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4931::DEBUG::2014-09-09 12:13:20,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`50af5519-4ba6-4bbd-ba12-dfd6bd4cf968`::moving from state init -> state preparing >Thread-4931::INFO::2014-09-09 12:13:20,129::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4931::INFO::2014-09-09 12:13:20,129::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109041', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916856', 'lastCheck': '0.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000972775', 'lastCheck': '3.6', 'valid': True}} >Thread-4931::DEBUG::2014-09-09 12:13:20,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`50af5519-4ba6-4bbd-ba12-dfd6bd4cf968`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109041', 'lastCheck': '7.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916856', 'lastCheck': '0.1', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000972775', 'lastCheck': '3.6', 'valid': True}} >Thread-4931::DEBUG::2014-09-09 12:13:20,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`50af5519-4ba6-4bbd-ba12-dfd6bd4cf968`::moving from state preparing -> state finished >Thread-4931::DEBUG::2014-09-09 12:13:20,131::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4931::DEBUG::2014-09-09 12:13:20,131::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4931::DEBUG::2014-09-09 12:13:20,132::task::993::Storage.TaskManager.Task::(_decref) Task=`50af5519-4ba6-4bbd-ba12-dfd6bd4cf968`::ref 0 aborting False >Thread-4931::DEBUG::2014-09-09 12:13:20,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:20,143::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:20,144::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4932::DEBUG::2014-09-09 12:13:20,147::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:21,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:21,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894557 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) (10420) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:22,195::__init__::225::IOProcess::(_processLogs) (10420) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:22,196::__init__::225::IOProcess::(_processLogs) (10420) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:22,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:13:22,196::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:13:22,203::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.001246 s, 901 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) (10421) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:22,204::__init__::225::IOProcess::(_processLogs) (10421) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:22,205::__init__::225::IOProcess::(_processLogs) (10421) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:22,205::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:23,231::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:23,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4933::DEBUG::2014-09-09 12:13:23,235::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:23,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:23,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896464 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:13:25,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:25,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089546 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:26,244::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:26,245::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4934::DEBUG::2014-09-09 12:13:26,246::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:26,500::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4935::DEBUG::2014-09-09 12:13:26,501::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:13:26,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3443::DEBUG::2014-09-09 12:13:26,502::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-4935::DEBUG::2014-09-09 12:13:26,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`26643056-43f6-47f4-94b0-1f52c90b99b6`::moving from state init -> state preparing >Thread-4935::INFO::2014-09-09 12:13:26,505::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-19::DEBUG::2014-09-09 12:13:26,506::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-4935::INFO::2014-09-09 12:13:26,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-19::DEBUG::2014-09-09 12:13:26,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-4935::DEBUG::2014-09-09 12:13:26,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`26643056-43f6-47f4-94b0-1f52c90b99b6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-19::DEBUG::2014-09-09 12:13:26,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-4935::DEBUG::2014-09-09 12:13:26,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`26643056-43f6-47f4-94b0-1f52c90b99b6`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-09-09 12:13:26,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-4935::DEBUG::2014-09-09 12:13:26,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-09-09 12:13:26,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-4935::DEBUG::2014-09-09 12:13:26,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 12:13:26,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-4935::DEBUG::2014-09-09 12:13:26,509::task::993::Storage.TaskManager.Task::(_decref) Task=`26643056-43f6-47f4-94b0-1f52c90b99b6`::ref 0 aborting False >Thread-19::DEBUG::2014-09-09 12:13:26,510::__init__::225::IOProcess::(_processLogs) (10422) Finding callback 'glob'... >Thread-4935::DEBUG::2014-09-09 12:13:26,510::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-19::DEBUG::2014-09-09 12:13:26,510::__init__::225::IOProcess::(_processLogs) (10422) Got request for method 'glob' >Thread-4935::DEBUG::2014-09-09 12:13:26,511::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:26,511::__init__::225::IOProcess::(_processLogs) (10422) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:26,514::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:13:26,515::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:13:26,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,517::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,518::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,519::__init__::225::IOProcess::(_processLogs) (10423) Finding callback 'glob'... >Thread-3443::DEBUG::2014-09-09 12:13:26,519::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:13:26,520::__init__::225::IOProcess::(_processLogs) (10423) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:26,520::__init__::225::IOProcess::(_processLogs) (10423) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) (10424) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:26,521::__init__::225::IOProcess::(_processLogs) (10424) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) (10424) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) Message size is 159 >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,523::__init__::225::IOProcess::(_processLogs) (10425) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:13:26,523::__init__::225::IOProcess::(_processLogs) (10425) Got request for method 'touch' >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:26,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:26,541::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4939::DEBUG::2014-09-09 12:13:26,541::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4939::DEBUG::2014-09-09 12:13:26,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`050c744d-fdd8-4ead-b75a-e1d93746b267`::moving from state init -> state preparing >Thread-4939::INFO::2014-09-09 12:13:26,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4939::DEBUG::2014-09-09 12:13:26,543::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9d2d1ab5-8289-4d49-98fb-b75b4a979b7b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4939::DEBUG::2014-09-09 12:13:26,543::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4939::DEBUG::2014-09-09 12:13:26,543::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4939::DEBUG::2014-09-09 12:13:26,543::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9d2d1ab5-8289-4d49-98fb-b75b4a979b7b`::Granted request >Thread-4939::DEBUG::2014-09-09 12:13:26,543::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`050c744d-fdd8-4ead-b75a-e1d93746b267`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4939::DEBUG::2014-09-09 12:13:26,543::task::993::Storage.TaskManager.Task::(_decref) Task=`050c744d-fdd8-4ead-b75a-e1d93746b267`::ref 1 aborting False >Thread-4939::INFO::2014-09-09 12:13:26,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4939::DEBUG::2014-09-09 12:13:26,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`050c744d-fdd8-4ead-b75a-e1d93746b267`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4939::DEBUG::2014-09-09 12:13:26,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`050c744d-fdd8-4ead-b75a-e1d93746b267`::moving from state preparing -> state finished >Thread-4939::DEBUG::2014-09-09 12:13:26,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4939::DEBUG::2014-09-09 12:13:26,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4939::DEBUG::2014-09-09 12:13:26,545::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4939::DEBUG::2014-09-09 12:13:26,545::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4939::DEBUG::2014-09-09 12:13:26,545::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4939::DEBUG::2014-09-09 12:13:26,545::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4939::DEBUG::2014-09-09 12:13:26,546::task::993::Storage.TaskManager.Task::(_decref) Task=`050c744d-fdd8-4ead-b75a-e1d93746b267`::ref 0 aborting False >Thread-4939::DEBUG::2014-09-09 12:13:26,546::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4939::DEBUG::2014-09-09 12:13:26,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:26,603::__init__::225::IOProcess::(_processLogs) (10425) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:13:26,604::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:13:26,604::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) (10426) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:13:26,605::__init__::225::IOProcess::(_processLogs) (10426) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:13:26,607::__init__::225::IOProcess::(_processLogs) DEBUG|(10426) Building response >Thread-19::DEBUG::2014-09-09 12:13:26,607::__init__::225::IOProcess::(_processLogs) (10426) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,607::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:13:26,607::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 12:13:26,608::__init__::225::IOProcess::(_processLogs) Sending response sized 531 >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) (10427) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) (10427) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) (10427) Building response >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) (10427) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,611::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,611::__init__::225::IOProcess::(_processLogs) (10428) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:13:26,611::__init__::225::IOProcess::(_processLogs) (10428) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:13:26,612::__init__::225::IOProcess::(_processLogs) DEBUG|(10428) Building response >Thread-19::DEBUG::2014-09-09 12:13:26,612::__init__::225::IOProcess::(_processLogs) (10428) Queuing response >Thread-3443::DEBUG::2014-09-09 12:13:26,612::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:13:26,612::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::INFO::2014-09-09 12:13:26,612::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-19::DEBUG::2014-09-09 12:13:26,613::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-3443::INFO::2014-09-09 12:13:26,613::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:13:26,613::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:26,613::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:26,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) (10429) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) (10429) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|(10429) Building response >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) (10429) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,614::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:13:26,615::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:13:26,615::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:13:26,622::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000860886 s, 412 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) (10430) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:26,623::__init__::225::IOProcess::(_processLogs) (10430) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:26,624::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|(10430) Building response >Thread-19::DEBUG::2014-09-09 12:13:26,624::__init__::225::IOProcess::(_processLogs) (10430) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:26,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:26,624::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:13:27,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:27,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894394 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:29,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:29,254::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4940::DEBUG::2014-09-09 12:13:29,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:29,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:29,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895134 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:30,014::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:30,014::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:30,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:30,014::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:30,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) (10431) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) (10431) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|(10431) Building response >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) (10431) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:30,015::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:13:30,016::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:13:30,016::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:13:30,024::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000978987 s, 560 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:30,024::__init__::225::IOProcess::(_processLogs) Message size is 150DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:30,024::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:30,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:30,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:30,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:30,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:30,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:30,025::__init__::225::IOProcess::(_processLogs) (10432) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:30,025::__init__::225::IOProcess::(_processLogs) (10432) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:30,025::__init__::225::IOProcess::(_processLogs) (10432) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:30,025::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:13:30,026::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:13:30,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:30,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:30,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:30,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:30,026::__init__::225::IOProcess::(_processLogs) (10433) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) (10433) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) (10433) Building response >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) (10433) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:13:30,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) (10434) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) (10434) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) (10434) Building response >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) (10434) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:30,028::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) (10435) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) (10435) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) (10435) Building response >Thread-19::DEBUG::2014-09-09 12:13:30,029::__init__::225::IOProcess::(_processLogs) (10435) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:30,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:30,030::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:13:31,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:32,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895125 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) (10436) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) (10436) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:32,206::__init__::225::IOProcess::(_processLogs) (10436) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:32,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:32,207::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:13:32,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:13:32,214::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110625 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) (10437) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) (10437) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:32,215::__init__::225::IOProcess::(_processLogs) DEBUG|(10437) Building response >Thread-19::DEBUG::2014-09-09 12:13:32,216::__init__::225::IOProcess::(_processLogs) (10437) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:32,216::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:13:32,216::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:32,262::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:32,262::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4941::DEBUG::2014-09-09 12:13:32,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:34,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:34,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896872 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:35,269::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:35,270::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4942::DEBUG::2014-09-09 12:13:35,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`979c02b7-91ac-4b86-a84b-1077624560b7`::moving from state init -> state preparing >Thread-4942::INFO::2014-09-09 12:13:35,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4942::INFO::2014-09-09 12:13:35,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110625', 'lastCheck': '3.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000978987', 'lastCheck': '5.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000860886', 'lastCheck': '8.6', 'valid': True}} >Thread-4942::DEBUG::2014-09-09 12:13:35,272::task::1191::Storage.TaskManager.Task::(prepare) Task=`979c02b7-91ac-4b86-a84b-1077624560b7`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110625', 'lastCheck': '3.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000978987', 'lastCheck': '5.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000860886', 'lastCheck': '8.6', 'valid': True}} >Thread-4942::DEBUG::2014-09-09 12:13:35,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`979c02b7-91ac-4b86-a84b-1077624560b7`::moving from state preparing -> state finished >Thread-4942::DEBUG::2014-09-09 12:13:35,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4942::DEBUG::2014-09-09 12:13:35,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4942::DEBUG::2014-09-09 12:13:35,272::task::993::Storage.TaskManager.Task::(_decref) Task=`979c02b7-91ac-4b86-a84b-1077624560b7`::ref 0 aborting False >Thread-4942::DEBUG::2014-09-09 12:13:35,273::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:35,283::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:35,284::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4943::DEBUG::2014-09-09 12:13:35,285::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:36,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:36,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895898 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) (10438) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:36,625::__init__::225::IOProcess::(_processLogs) (10438) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:36,627::__init__::225::IOProcess::(_processLogs) DEBUG|(10438) Building response >Thread-19::DEBUG::2014-09-09 12:13:36,627::__init__::225::IOProcess::(_processLogs) (10438) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:36,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:36,627::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:13:36,628::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:13:36,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00104784 s, 339 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:36,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:36,637::__init__::225::IOProcess::(_processLogs) (10439) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:36,637::__init__::225::IOProcess::(_processLogs) (10439) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:36,637::__init__::225::IOProcess::(_processLogs) DEBUG|(10439) Building response >Thread-19::DEBUG::2014-09-09 12:13:36,637::__init__::225::IOProcess::(_processLogs) (10439) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:36,637::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:36,637::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:36,684::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4944::DEBUG::2014-09-09 12:13:36,685::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:13:36,685::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4944::DEBUG::2014-09-09 12:13:36,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd30034d-5466-42c4-ba22-50a5ae2a8d16`::moving from state init -> state preparing >Thread-4944::INFO::2014-09-09 12:13:36,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4944::INFO::2014-09-09 12:13:36,686::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4944::DEBUG::2014-09-09 12:13:36,686::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd30034d-5466-42c4-ba22-50a5ae2a8d16`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4944::DEBUG::2014-09-09 12:13:36,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd30034d-5466-42c4-ba22-50a5ae2a8d16`::moving from state preparing -> state finished >Thread-4944::DEBUG::2014-09-09 12:13:36,686::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4944::DEBUG::2014-09-09 12:13:36,686::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4944::DEBUG::2014-09-09 12:13:36,686::task::993::Storage.TaskManager.Task::(_decref) Task=`cd30034d-5466-42c4-ba22-50a5ae2a8d16`::ref 0 aborting False >Thread-4944::DEBUG::2014-09-09 12:13:36,687::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4944::DEBUG::2014-09-09 12:13:36,687::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:36,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:36,701::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4945::DEBUG::2014-09-09 12:13:36,701::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4945::DEBUG::2014-09-09 12:13:36,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`31dcbb8e-e5e9-482a-b961-50c1b90473e5`::moving from state init -> state preparing >Thread-4945::INFO::2014-09-09 12:13:36,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4945::DEBUG::2014-09-09 12:13:36,702::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`005740fc-a31a-4852-91fa-85ad4ea9f5f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4945::DEBUG::2014-09-09 12:13:36,702::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4945::DEBUG::2014-09-09 12:13:36,702::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4945::DEBUG::2014-09-09 12:13:36,702::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`005740fc-a31a-4852-91fa-85ad4ea9f5f7`::Granted request >Thread-4945::DEBUG::2014-09-09 12:13:36,702::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31dcbb8e-e5e9-482a-b961-50c1b90473e5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4945::DEBUG::2014-09-09 12:13:36,702::task::993::Storage.TaskManager.Task::(_decref) Task=`31dcbb8e-e5e9-482a-b961-50c1b90473e5`::ref 1 aborting False >Thread-4945::INFO::2014-09-09 12:13:36,704::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4945::DEBUG::2014-09-09 12:13:36,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`31dcbb8e-e5e9-482a-b961-50c1b90473e5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4945::DEBUG::2014-09-09 12:13:36,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`31dcbb8e-e5e9-482a-b961-50c1b90473e5`::moving from state preparing -> state finished >Thread-4945::DEBUG::2014-09-09 12:13:36,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4945::DEBUG::2014-09-09 12:13:36,704::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4945::DEBUG::2014-09-09 12:13:36,704::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4945::DEBUG::2014-09-09 12:13:36,705::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4945::DEBUG::2014-09-09 12:13:36,705::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4945::DEBUG::2014-09-09 12:13:36,705::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4945::DEBUG::2014-09-09 12:13:36,705::task::993::Storage.TaskManager.Task::(_decref) Task=`31dcbb8e-e5e9-482a-b961-50c1b90473e5`::ref 0 aborting False >Thread-4945::DEBUG::2014-09-09 12:13:36,705::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4945::DEBUG::2014-09-09 12:13:36,705::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:38,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:38,366::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:38,368::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4946::DEBUG::2014-09-09 12:13:38,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:38,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0954025 s, 10.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:40,029::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) (10440) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) (10440) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10440) Building response >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) (10440) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:40,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:40,031::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:13:40,031::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:13:40,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000928543 s, 590 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:40,039::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:40,039::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:40,039::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) (10441) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) (10441) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10441) Building response >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) (10441) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:40,040::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:13:40,041::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:13:40,041::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:40,041::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:13:40,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) (10442) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) (10442) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) (10442) Building response >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) (10442) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:40,042::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:40,043::__init__::225::IOProcess::(_processLogs) (10443) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) (10443) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) (10443) Building response >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) (10443) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:40,044::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) (10444) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) (10444) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) (10444) Building response >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) (10444) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:40,045::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:13:40,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:40,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894503 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:41,379::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:41,380::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4947::DEBUG::2014-09-09 12:13:41,381::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:42,217::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:42,217::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:42,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:42,217::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:42,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:42,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:42,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:42,218::__init__::225::IOProcess::(_processLogs) (10445) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:42,218::__init__::225::IOProcess::(_processLogs) (10445) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:42,218::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10445) Building response >Thread-19::DEBUG::2014-09-09 12:13:42,219::__init__::225::IOProcess::(_processLogs) (10445) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:42,219::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:13:42,219::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:13:42,219::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:13:42,227::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109684 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) (10446) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) (10446) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:42,228::__init__::225::IOProcess::(_processLogs) DEBUG|(10446) Building response >Thread-19::DEBUG::2014-09-09 12:13:42,229::__init__::225::IOProcess::(_processLogs) (10446) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:42,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:42,229::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:13:42,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:42,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895787 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:44,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:44,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4948::DEBUG::2014-09-09 12:13:44,390::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:44,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:44,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895429 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:46,638::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:46,638::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:46,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:46,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:46,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:46,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:46,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:46,639::__init__::225::IOProcess::(_processLogs) (10447) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:46,639::__init__::225::IOProcess::(_processLogs) (10447) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:46,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10447) Building response >Thread-19::DEBUG::2014-09-09 12:13:46,640::__init__::225::IOProcess::(_processLogs) (10447) Queuing response >Thread-3443::DEBUG::2014-09-09 12:13:46,640::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:13:46,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:46,645::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:13:46,647::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000895092 s, 397 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:46,647::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) (10448) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) (10448) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10448) Building response >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) (10448) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:46,648::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:46,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:13:46,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:46,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:46,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4949::DEBUG::2014-09-09 12:13:46,754::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4949::DEBUG::2014-09-09 12:13:46,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0d739f1-9c64-4db7-b1d7-e40d5900773b`::moving from state init -> state preparing >Thread-4949::INFO::2014-09-09 12:13:46,755::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4949::INFO::2014-09-09 12:13:46,755::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4949::DEBUG::2014-09-09 12:13:46,755::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0d739f1-9c64-4db7-b1d7-e40d5900773b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4949::DEBUG::2014-09-09 12:13:46,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0d739f1-9c64-4db7-b1d7-e40d5900773b`::moving from state preparing -> state finished >Thread-4949::DEBUG::2014-09-09 12:13:46,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4949::DEBUG::2014-09-09 12:13:46,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4949::DEBUG::2014-09-09 12:13:46,756::task::993::Storage.TaskManager.Task::(_decref) Task=`b0d739f1-9c64-4db7-b1d7-e40d5900773b`::ref 0 aborting False >Thread-4949::DEBUG::2014-09-09 12:13:46,756::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4949::DEBUG::2014-09-09 12:13:46,756::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:46,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:46,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4950::DEBUG::2014-09-09 12:13:46,790::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4950::DEBUG::2014-09-09 12:13:46,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`f92870d0-3ce0-4366-b2e6-4a97b3bafadc`::moving from state init -> state preparing >Thread-4950::INFO::2014-09-09 12:13:46,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4950::DEBUG::2014-09-09 12:13:46,796::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f0f3d115-78de-40ba-8aa8-545aa0c9cac3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4950::DEBUG::2014-09-09 12:13:46,797::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4950::DEBUG::2014-09-09 12:13:46,798::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4950::DEBUG::2014-09-09 12:13:46,798::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f0f3d115-78de-40ba-8aa8-545aa0c9cac3`::Granted request >Thread-4950::DEBUG::2014-09-09 12:13:46,800::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f92870d0-3ce0-4366-b2e6-4a97b3bafadc`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4950::DEBUG::2014-09-09 12:13:46,801::task::993::Storage.TaskManager.Task::(_decref) Task=`f92870d0-3ce0-4366-b2e6-4a97b3bafadc`::ref 1 aborting False >Dummy-97::DEBUG::2014-09-09 12:13:46,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101522 s, 10.1 MB/s\n'; <rc> = 0 >Thread-4950::INFO::2014-09-09 12:13:46,811::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4950::DEBUG::2014-09-09 12:13:46,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`f92870d0-3ce0-4366-b2e6-4a97b3bafadc`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4950::DEBUG::2014-09-09 12:13:46,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`f92870d0-3ce0-4366-b2e6-4a97b3bafadc`::moving from state preparing -> state finished >Thread-4950::DEBUG::2014-09-09 12:13:46,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4950::DEBUG::2014-09-09 12:13:46,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4950::DEBUG::2014-09-09 12:13:46,813::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4950::DEBUG::2014-09-09 12:13:46,814::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4950::DEBUG::2014-09-09 12:13:46,814::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4950::DEBUG::2014-09-09 12:13:46,814::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4950::DEBUG::2014-09-09 12:13:46,815::task::993::Storage.TaskManager.Task::(_decref) Task=`f92870d0-3ce0-4366-b2e6-4a97b3bafadc`::ref 0 aborting False >Thread-4950::DEBUG::2014-09-09 12:13:46,815::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4950::DEBUG::2014-09-09 12:13:46,816::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:47,398::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:47,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4951::DEBUG::2014-09-09 12:13:47,400::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:48,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:48,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896358 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:50,046::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:13:50,046::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:50,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:50,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-24::DEBUG::2014-09-09 12:13:50,049::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:13:50,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:50,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:50,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:50,056::__init__::225::IOProcess::(_processLogs) (10449) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:50,057::__init__::225::IOProcess::(_processLogs) (10449) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:50,057::__init__::225::IOProcess::(_processLogs) (10449) Building response >Thread-24::DEBUG::2014-09-09 12:13:50,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000975089 s, 562 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:50,059::__init__::225::IOProcess::(_processLogs) (10449) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:50,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:50,061::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:13:50,062::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:13:50,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:50,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:50,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:50,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:50,065::__init__::225::IOProcess::(_processLogs) (10450) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:50,066::__init__::225::IOProcess::(_processLogs) (10450) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:50,066::__init__::225::IOProcess::(_processLogs) (10450) Building response >Thread-19::DEBUG::2014-09-09 12:13:50,067::__init__::225::IOProcess::(_processLogs) (10450) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:50,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:50,067::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:13:50,068::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:13:50,069::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:50,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:50,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:50,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:50,071::__init__::225::IOProcess::(_processLogs) (10451) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:50,072::__init__::225::IOProcess::(_processLogs) (10451) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:50,072::__init__::225::IOProcess::(_processLogs) (10451) Building response >Thread-19::DEBUG::2014-09-09 12:13:50,073::__init__::225::IOProcess::(_processLogs) (10451) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:50,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:50,073::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:50,074::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:13:50,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:50,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:50,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:50,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:50,077::__init__::225::IOProcess::(_processLogs) (10452) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:13:50,078::__init__::225::IOProcess::(_processLogs) (10452) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:50,078::__init__::225::IOProcess::(_processLogs) (10452) Building response >Thread-19::DEBUG::2014-09-09 12:13:50,079::__init__::225::IOProcess::(_processLogs) (10452) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:50,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:50,080::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:13:50,080::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:13:50,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:50,081::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:50,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:50,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:50,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:50,083::__init__::225::IOProcess::(_processLogs) (10453) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:13:50,084::__init__::225::IOProcess::(_processLogs) (10453) Building response >Thread-19::DEBUG::2014-09-09 12:13:50,085::__init__::225::IOProcess::(_processLogs) (10453) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:50,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:50,086::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:50,406::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:50,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4952::DEBUG::2014-09-09 12:13:50,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`91eb76d5-b106-4fcb-a8d5-54c2eb00131c`::moving from state init -> state preparing >Thread-4952::INFO::2014-09-09 12:13:50,408::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4952::INFO::2014-09-09 12:13:50,408::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109684', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000975089', 'lastCheck': '0.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895092', 'lastCheck': '3.8', 'valid': True}} >Thread-4952::DEBUG::2014-09-09 12:13:50,408::task::1191::Storage.TaskManager.Task::(prepare) Task=`91eb76d5-b106-4fcb-a8d5-54c2eb00131c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109684', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000975089', 'lastCheck': '0.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000895092', 'lastCheck': '3.8', 'valid': True}} >Thread-4952::DEBUG::2014-09-09 12:13:50,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`91eb76d5-b106-4fcb-a8d5-54c2eb00131c`::moving from state preparing -> state finished >Thread-4952::DEBUG::2014-09-09 12:13:50,408::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4952::DEBUG::2014-09-09 12:13:50,408::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4952::DEBUG::2014-09-09 12:13:50,408::task::993::Storage.TaskManager.Task::(_decref) Task=`91eb76d5-b106-4fcb-a8d5-54c2eb00131c`::ref 0 aborting False >Thread-4952::DEBUG::2014-09-09 12:13:50,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:50,418::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:50,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4953::DEBUG::2014-09-09 12:13:50,420::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:50,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:51,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894737 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:52,230::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:52,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:52,230::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:52,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:52,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:52,231::__init__::225::IOProcess::(_processLogs) (10454) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:52,231::__init__::225::IOProcess::(_processLogs) (10454) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:52,231::__init__::225::IOProcess::(_processLogs) (10454) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:52,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:13:52,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:13:52,238::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115405 s, 973 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) (10455) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:52,239::__init__::225::IOProcess::(_processLogs) (10455) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:52,240::__init__::225::IOProcess::(_processLogs) (10455) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:52,240::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:13:53,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:53,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894691 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:53,499::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:53,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4954::DEBUG::2014-09-09 12:13:53,500::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:55,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:55,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897264 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:56,507::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:56,508::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4955::DEBUG::2014-09-09 12:13:56,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) (10456) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) (10456) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:56,650::__init__::225::IOProcess::(_processLogs) (10456) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:56,651::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:13:56,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:13:56,659::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000981789 s, 362 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:13:56,659::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:13:56,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:13:56,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:13:56,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:13:56,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:13:56,660::__init__::225::IOProcess::(_processLogs) (10457) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:13:56,660::__init__::225::IOProcess::(_processLogs) (10457) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:13:56,661::__init__::225::IOProcess::(_processLogs) (10457) Queuing response >Thread-19::DEBUG::2014-09-09 12:13:56,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:13:56,661::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:56,852::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:56,853::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4956::DEBUG::2014-09-09 12:13:56,853::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4956::DEBUG::2014-09-09 12:13:56,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`49112990-9416-4555-9b8a-1066174738b5`::moving from state init -> state preparing >Thread-4956::INFO::2014-09-09 12:13:56,854::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4956::INFO::2014-09-09 12:13:56,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4956::DEBUG::2014-09-09 12:13:56,854::task::1191::Storage.TaskManager.Task::(prepare) Task=`49112990-9416-4555-9b8a-1066174738b5`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4956::DEBUG::2014-09-09 12:13:56,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`49112990-9416-4555-9b8a-1066174738b5`::moving from state preparing -> state finished >Thread-4956::DEBUG::2014-09-09 12:13:56,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4956::DEBUG::2014-09-09 12:13:56,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4956::DEBUG::2014-09-09 12:13:56,855::task::993::Storage.TaskManager.Task::(_decref) Task=`49112990-9416-4555-9b8a-1066174738b5`::ref 0 aborting False >Thread-4956::DEBUG::2014-09-09 12:13:56,855::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4956::DEBUG::2014-09-09 12:13:56,855::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:56,885::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:56,886::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4957::DEBUG::2014-09-09 12:13:56,886::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4957::DEBUG::2014-09-09 12:13:56,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb773f1-6dc9-44c2-8b24-e1b99ea0a3c1`::moving from state init -> state preparing >Thread-4957::INFO::2014-09-09 12:13:56,887::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4957::DEBUG::2014-09-09 12:13:56,887::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2e81f427-5feb-4fe0-9703-d166f95482b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4957::DEBUG::2014-09-09 12:13:56,887::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4957::DEBUG::2014-09-09 12:13:56,887::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4957::DEBUG::2014-09-09 12:13:56,887::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2e81f427-5feb-4fe0-9703-d166f95482b2`::Granted request >Thread-4957::DEBUG::2014-09-09 12:13:56,887::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`afb773f1-6dc9-44c2-8b24-e1b99ea0a3c1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4957::DEBUG::2014-09-09 12:13:56,888::task::993::Storage.TaskManager.Task::(_decref) Task=`afb773f1-6dc9-44c2-8b24-e1b99ea0a3c1`::ref 1 aborting False >Thread-4957::INFO::2014-09-09 12:13:56,889::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4957::DEBUG::2014-09-09 12:13:56,889::task::1191::Storage.TaskManager.Task::(prepare) Task=`afb773f1-6dc9-44c2-8b24-e1b99ea0a3c1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4957::DEBUG::2014-09-09 12:13:56,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb773f1-6dc9-44c2-8b24-e1b99ea0a3c1`::moving from state preparing -> state finished >Thread-4957::DEBUG::2014-09-09 12:13:56,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4957::DEBUG::2014-09-09 12:13:56,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4957::DEBUG::2014-09-09 12:13:56,890::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4957::DEBUG::2014-09-09 12:13:56,890::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4957::DEBUG::2014-09-09 12:13:56,890::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4957::DEBUG::2014-09-09 12:13:56,890::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4957::DEBUG::2014-09-09 12:13:56,890::task::993::Storage.TaskManager.Task::(_decref) Task=`afb773f1-6dc9-44c2-8b24-e1b99ea0a3c1`::ref 0 aborting False >Thread-4957::DEBUG::2014-09-09 12:13:56,890::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283540193280', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4957::DEBUG::2014-09-09 12:13:56,890::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:13:57,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:57,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896596 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:13:59,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:13:59,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895088 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:13:59,516::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:13:59,517::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4958::DEBUG::2014-09-09 12:13:59,518::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) (10458) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) (10458) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:00,085::__init__::225::IOProcess::(_processLogs) (10458) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:00,086::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:14:00,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:14:00,095::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00090613 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:00,095::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:00,095::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:00,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:00,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:00,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:00,096::__init__::225::IOProcess::(_processLogs) (10459) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:00,096::__init__::225::IOProcess::(_processLogs) (10459) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:00,096::__init__::225::IOProcess::(_processLogs) (10459) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:00,096::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:00,097::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) (10460) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) (10460) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) (10460) Building response >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) (10460) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:00,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) (10461) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) (10461) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) (10461) Building response >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) (10461) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:00,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:00,100::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:00,100::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:14:00,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) (10462) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) (10462) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) (10462) Building response >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) (10462) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:00,101::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:14:01,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:01,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896476 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) (10463) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) (10463) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:02,241::__init__::225::IOProcess::(_processLogs) (10463) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:02,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:14:02,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:14:02,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117397 s, 957 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) (10464) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:02,309::__init__::225::IOProcess::(_processLogs) (10464) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:02,310::__init__::225::IOProcess::(_processLogs) (10464) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:02,310::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:02,524::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:02,525::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4959::DEBUG::2014-09-09 12:14:02,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:03,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:03,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896789 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:05,531::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:05,531::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4960::DEBUG::2014-09-09 12:14:05,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`aee564d1-be6c-45cd-be69-1547d221ee36`::moving from state init -> state preparing >Thread-4960::INFO::2014-09-09 12:14:05,533::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4960::INFO::2014-09-09 12:14:05,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117397', 'lastCheck': '3.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00090613', 'lastCheck': '5.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000981789', 'lastCheck': '8.9', 'valid': True}} >Thread-4960::DEBUG::2014-09-09 12:14:05,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`aee564d1-be6c-45cd-be69-1547d221ee36`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00117397', 'lastCheck': '3.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00090613', 'lastCheck': '5.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000981789', 'lastCheck': '8.9', 'valid': True}} >Thread-4960::DEBUG::2014-09-09 12:14:05,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`aee564d1-be6c-45cd-be69-1547d221ee36`::moving from state preparing -> state finished >Thread-4960::DEBUG::2014-09-09 12:14:05,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4960::DEBUG::2014-09-09 12:14:05,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4960::DEBUG::2014-09-09 12:14:05,533::task::993::Storage.TaskManager.Task::(_decref) Task=`aee564d1-be6c-45cd-be69-1547d221ee36`::ref 0 aborting False >Thread-4960::DEBUG::2014-09-09 12:14:05,534::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:05,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:05,541::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4961::DEBUG::2014-09-09 12:14:05,542::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:05,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:05,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0905603 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:06,662::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:06,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:06,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:06,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:06,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:06,663::__init__::225::IOProcess::(_processLogs) (10465) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:06,663::__init__::225::IOProcess::(_processLogs) (10465) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:06,663::__init__::225::IOProcess::(_processLogs) (10465) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:06,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:14:06,664::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:06,664::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:14:06,672::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000920717 s, 386 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:06,672::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:06,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:06,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:06,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:06,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:06,673::__init__::225::IOProcess::(_processLogs) (10466) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:06,673::__init__::225::IOProcess::(_processLogs) (10466) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:06,673::__init__::225::IOProcess::(_processLogs) (10466) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:06,673::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:06,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:06,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4962::DEBUG::2014-09-09 12:14:06,931::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4962::DEBUG::2014-09-09 12:14:06,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce7e87ce-e038-4fe8-90bf-c50125b27cbf`::moving from state init -> state preparing >Thread-4962::INFO::2014-09-09 12:14:06,933::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4962::INFO::2014-09-09 12:14:06,933::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4962::DEBUG::2014-09-09 12:14:06,933::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce7e87ce-e038-4fe8-90bf-c50125b27cbf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4962::DEBUG::2014-09-09 12:14:06,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce7e87ce-e038-4fe8-90bf-c50125b27cbf`::moving from state preparing -> state finished >Thread-4962::DEBUG::2014-09-09 12:14:06,933::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4962::DEBUG::2014-09-09 12:14:06,933::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4962::DEBUG::2014-09-09 12:14:06,933::task::993::Storage.TaskManager.Task::(_decref) Task=`ce7e87ce-e038-4fe8-90bf-c50125b27cbf`::ref 0 aborting False >Thread-4962::DEBUG::2014-09-09 12:14:06,933::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4962::DEBUG::2014-09-09 12:14:06,933::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:06,961::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4963::DEBUG::2014-09-09 12:14:06,962::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:14:06,962::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4963::DEBUG::2014-09-09 12:14:06,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e35a88f-b884-4aa8-9909-b050fa6439c8`::moving from state init -> state preparing >Thread-4963::INFO::2014-09-09 12:14:06,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4963::DEBUG::2014-09-09 12:14:06,963::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`da898aec-d332-48d4-8e9f-e0b87de75908`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4963::DEBUG::2014-09-09 12:14:06,963::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4963::DEBUG::2014-09-09 12:14:06,963::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4963::DEBUG::2014-09-09 12:14:06,963::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`da898aec-d332-48d4-8e9f-e0b87de75908`::Granted request >Thread-4963::DEBUG::2014-09-09 12:14:06,963::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e35a88f-b884-4aa8-9909-b050fa6439c8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4963::DEBUG::2014-09-09 12:14:06,964::task::993::Storage.TaskManager.Task::(_decref) Task=`6e35a88f-b884-4aa8-9909-b050fa6439c8`::ref 1 aborting False >Thread-4963::INFO::2014-09-09 12:14:06,965::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4963::DEBUG::2014-09-09 12:14:06,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e35a88f-b884-4aa8-9909-b050fa6439c8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4963::DEBUG::2014-09-09 12:14:06,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e35a88f-b884-4aa8-9909-b050fa6439c8`::moving from state preparing -> state finished >Thread-4963::DEBUG::2014-09-09 12:14:06,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4963::DEBUG::2014-09-09 12:14:06,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4963::DEBUG::2014-09-09 12:14:06,966::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4963::DEBUG::2014-09-09 12:14:06,966::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4963::DEBUG::2014-09-09 12:14:06,966::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4963::DEBUG::2014-09-09 12:14:06,966::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4963::DEBUG::2014-09-09 12:14:06,966::task::993::Storage.TaskManager.Task::(_decref) Task=`6e35a88f-b884-4aa8-9909-b050fa6439c8`::ref 0 aborting False >Thread-4963::DEBUG::2014-09-09 12:14:06,966::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4963::DEBUG::2014-09-09 12:14:06,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:07,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:07,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896614 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:08,691::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:08,691::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4964::DEBUG::2014-09-09 12:14:08,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:09,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:09,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894707 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:10,101::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:10,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:10,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:10,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:10,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:10,102::__init__::225::IOProcess::(_processLogs) (10467) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:10,102::__init__::225::IOProcess::(_processLogs) (10467) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:10,102::__init__::225::IOProcess::(_processLogs) (10467) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:10,102::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:14:10,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:14:10,111::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000995199 s, 551 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) (10468) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) (10468) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) DEBUG|(10468) Building response >Thread-19::DEBUG::2014-09-09 12:14:10,112::__init__::225::IOProcess::(_processLogs) (10468) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:10,113::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:10,114::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:10,114::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:10,114::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:14:10,114::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:10,114::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) (10469) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) (10469) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) (10469) Building response >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) (10469) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:10,115::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:14:10,116::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:10,116::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:10,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:10,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:10,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:10,116::__init__::225::IOProcess::(_processLogs) (10470) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) (10470) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) (10470) Building response >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) (10470) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:10,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:10,118::__init__::225::IOProcess::(_processLogs) (10471) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:10,118::__init__::225::IOProcess::(_processLogs) (10471) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:10,118::__init__::225::IOProcess::(_processLogs) DEBUG|(10471) Building response >Thread-19::DEBUG::2014-09-09 12:14:10,118::__init__::225::IOProcess::(_processLogs) (10471) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:10,118::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:10,119::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:11,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:11,700::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4965::DEBUG::2014-09-09 12:14:11,701::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:11,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:12,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898311 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:12,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:12,312::__init__::225::IOProcess::(_processLogs) (10472) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:12,312::__init__::225::IOProcess::(_processLogs) (10472) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:12,313::__init__::225::IOProcess::(_processLogs) DEBUG|(10472) Building response >Thread-19::DEBUG::2014-09-09 12:14:12,313::__init__::225::IOProcess::(_processLogs) (10472) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:12,313::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:12,313::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:14:12,314::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:14:12,321::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114218 s, 983 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:12,322::__init__::225::IOProcess::(_processLogs) (10473) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:12,323::__init__::225::IOProcess::(_processLogs) (10473) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:12,323::__init__::225::IOProcess::(_processLogs) (10473) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:12,323::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:14:14,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:14,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895594 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:14,709::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:14,710::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4966::DEBUG::2014-09-09 12:14:14,711::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:16,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:16,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896114 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:16,674::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:16,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) (10474) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) (10474) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) (10474) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:16,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:14:16,675::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:14:16,683::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00104086 s, 341 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) (10475) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:16,684::__init__::225::IOProcess::(_processLogs) (10475) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:16,685::__init__::225::IOProcess::(_processLogs) (10475) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:16,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:16,685::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:17,004::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:17,004::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4967::DEBUG::2014-09-09 12:14:17,004::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4967::DEBUG::2014-09-09 12:14:17,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0393563-d41f-4ed2-8c60-6b0e0388e5fb`::moving from state init -> state preparing >Thread-4967::INFO::2014-09-09 12:14:17,006::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4967::INFO::2014-09-09 12:14:17,006::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4967::DEBUG::2014-09-09 12:14:17,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0393563-d41f-4ed2-8c60-6b0e0388e5fb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4967::DEBUG::2014-09-09 12:14:17,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0393563-d41f-4ed2-8c60-6b0e0388e5fb`::moving from state preparing -> state finished >Thread-4967::DEBUG::2014-09-09 12:14:17,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4967::DEBUG::2014-09-09 12:14:17,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4967::DEBUG::2014-09-09 12:14:17,006::task::993::Storage.TaskManager.Task::(_decref) Task=`a0393563-d41f-4ed2-8c60-6b0e0388e5fb`::ref 0 aborting False >Thread-4967::DEBUG::2014-09-09 12:14:17,006::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4967::DEBUG::2014-09-09 12:14:17,006::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:17,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4968::DEBUG::2014-09-09 12:14:17,068::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:14:17,068::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4968::DEBUG::2014-09-09 12:14:17,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`2de1689a-9fde-4d2c-b366-535b94104fba`::moving from state init -> state preparing >Thread-4968::INFO::2014-09-09 12:14:17,069::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4968::DEBUG::2014-09-09 12:14:17,069::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`05ba1faa-87af-47bd-a463-80d8f8dfaabb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4968::DEBUG::2014-09-09 12:14:17,069::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4968::DEBUG::2014-09-09 12:14:17,069::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4968::DEBUG::2014-09-09 12:14:17,069::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`05ba1faa-87af-47bd-a463-80d8f8dfaabb`::Granted request >Thread-4968::DEBUG::2014-09-09 12:14:17,070::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2de1689a-9fde-4d2c-b366-535b94104fba`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4968::DEBUG::2014-09-09 12:14:17,070::task::993::Storage.TaskManager.Task::(_decref) Task=`2de1689a-9fde-4d2c-b366-535b94104fba`::ref 1 aborting False >Thread-4968::INFO::2014-09-09 12:14:17,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4968::DEBUG::2014-09-09 12:14:17,071::task::1191::Storage.TaskManager.Task::(prepare) Task=`2de1689a-9fde-4d2c-b366-535b94104fba`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4968::DEBUG::2014-09-09 12:14:17,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`2de1689a-9fde-4d2c-b366-535b94104fba`::moving from state preparing -> state finished >Thread-4968::DEBUG::2014-09-09 12:14:17,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4968::DEBUG::2014-09-09 12:14:17,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4968::DEBUG::2014-09-09 12:14:17,072::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4968::DEBUG::2014-09-09 12:14:17,072::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4968::DEBUG::2014-09-09 12:14:17,072::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4968::DEBUG::2014-09-09 12:14:17,072::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4968::DEBUG::2014-09-09 12:14:17,072::task::993::Storage.TaskManager.Task::(_decref) Task=`2de1689a-9fde-4d2c-b366-535b94104fba`::ref 0 aborting False >Thread-4968::DEBUG::2014-09-09 12:14:17,072::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4968::DEBUG::2014-09-09 12:14:17,073::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:17,716::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:17,717::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4969::DEBUG::2014-09-09 12:14:17,718::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:18,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:18,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896687 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:20,120::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:20,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:20,121::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:20,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:20,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-24::DEBUG::2014-09-09 12:14:20,123::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:20,123::__init__::225::IOProcess::(_processLogs) (10476) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:20,130::__init__::225::IOProcess::(_processLogs) (10476) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:20,130::__init__::225::IOProcess::(_processLogs) (10476) Building response >Thread-19::DEBUG::2014-09-09 12:14:20,131::__init__::225::IOProcess::(_processLogs) (10476) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:20,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:20,132::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:14:20,133::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000952092 s, 576 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:20,134::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:20,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:20,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:20,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:20,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:20,138::__init__::225::IOProcess::(_processLogs) (10477) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:20,138::__init__::225::IOProcess::(_processLogs) (10477) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:20,139::__init__::225::IOProcess::(_processLogs) (10477) Building response >Thread-19::DEBUG::2014-09-09 12:14:20,139::__init__::225::IOProcess::(_processLogs) (10477) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:20,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:20,140::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:20,141::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:14:20,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:20,142::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:20,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:20,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:20,144::__init__::225::IOProcess::(_processLogs) (10478) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:20,144::__init__::225::IOProcess::(_processLogs) (10478) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:20,145::__init__::225::IOProcess::(_processLogs) (10478) Building response >Thread-19::DEBUG::2014-09-09 12:14:20,145::__init__::225::IOProcess::(_processLogs) (10478) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:20,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:20,146::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:20,147::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:14:20,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:20,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:20,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:20,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:20,150::__init__::225::IOProcess::(_processLogs) (10479) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:20,150::__init__::225::IOProcess::(_processLogs) (10479) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:20,151::__init__::225::IOProcess::(_processLogs) (10479) Building response >Thread-19::DEBUG::2014-09-09 12:14:20,151::__init__::225::IOProcess::(_processLogs) (10479) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:20,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:20,152::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:20,153::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:14:20,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:20,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:20,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:20,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:20,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:20,156::__init__::225::IOProcess::(_processLogs) (10480) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:20,157::__init__::225::IOProcess::(_processLogs) (10480) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:20,157::__init__::225::IOProcess::(_processLogs) (10480) Building response >Thread-19::DEBUG::2014-09-09 12:14:20,158::__init__::225::IOProcess::(_processLogs) (10480) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:20,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:20,159::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:14:20,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:20,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895263 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:20,726::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:20,727::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4970::DEBUG::2014-09-09 12:14:20,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`a00e450c-3007-4337-afbf-69c29210f3c4`::moving from state init -> state preparing >Thread-4970::INFO::2014-09-09 12:14:20,728::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4970::INFO::2014-09-09 12:14:20,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114218', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000952092', 'lastCheck': '0.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104086', 'lastCheck': '4.0', 'valid': True}} >Thread-4970::DEBUG::2014-09-09 12:14:20,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`a00e450c-3007-4337-afbf-69c29210f3c4`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114218', 'lastCheck': '8.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000952092', 'lastCheck': '0.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104086', 'lastCheck': '4.0', 'valid': True}} >Thread-4970::DEBUG::2014-09-09 12:14:20,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`a00e450c-3007-4337-afbf-69c29210f3c4`::moving from state preparing -> state finished >Thread-4970::DEBUG::2014-09-09 12:14:20,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4970::DEBUG::2014-09-09 12:14:20,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4970::DEBUG::2014-09-09 12:14:20,729::task::993::Storage.TaskManager.Task::(_decref) Task=`a00e450c-3007-4337-afbf-69c29210f3c4`::ref 0 aborting False >Thread-4970::DEBUG::2014-09-09 12:14:20,730::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:20,738::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:20,739::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4971::DEBUG::2014-09-09 12:14:20,740::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:14:22,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:22,324::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:22,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:22,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:22,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:22,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:22,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:22,325::__init__::225::IOProcess::(_processLogs) (10481) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:22,325::__init__::225::IOProcess::(_processLogs) (10481) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:22,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(10481) Building response >Thread-23::DEBUG::2014-09-09 12:14:22,326::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:22,326::__init__::225::IOProcess::(_processLogs) (10481) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:22,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:22,331::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:14:22,333::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107949 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:22,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:22,333::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:22,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:22,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) (10482) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) (10482) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(10482) Building response >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) (10482) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:22,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:22,335::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:14:22,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:22,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896759 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:23,863::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:23,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4972::DEBUG::2014-09-09 12:14:23,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:24,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:24,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894855 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:26,686::__init__::225::IOProcess::(_processLogs) (10483) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:26,687::__init__::225::IOProcess::(_processLogs) (10483) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:26,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(10483) Building response >Thread-19::DEBUG::2014-09-09 12:14:26,687::__init__::225::IOProcess::(_processLogs) (10483) Queuing response >Thread-3443::DEBUG::2014-09-09 12:14:26,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:26,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:26,694::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:14:26,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000864115 s, 411 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:26,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:26,695::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) (10484) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) (10484) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(10484) Building response >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) (10484) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:26,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:26,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:14:26,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:26,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895777 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:26,875::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:26,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4973::DEBUG::2014-09-09 12:14:26,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:27,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4974::DEBUG::2014-09-09 12:14:27,115::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:14:27,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4974::DEBUG::2014-09-09 12:14:27,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`3924e24f-ef29-48b7-b775-b3bd1a829a9d`::moving from state init -> state preparing >Thread-4974::INFO::2014-09-09 12:14:27,117::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4974::INFO::2014-09-09 12:14:27,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4974::DEBUG::2014-09-09 12:14:27,117::task::1191::Storage.TaskManager.Task::(prepare) Task=`3924e24f-ef29-48b7-b775-b3bd1a829a9d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4974::DEBUG::2014-09-09 12:14:27,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`3924e24f-ef29-48b7-b775-b3bd1a829a9d`::moving from state preparing -> state finished >Thread-4974::DEBUG::2014-09-09 12:14:27,117::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4974::DEBUG::2014-09-09 12:14:27,117::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4974::DEBUG::2014-09-09 12:14:27,118::task::993::Storage.TaskManager.Task::(_decref) Task=`3924e24f-ef29-48b7-b775-b3bd1a829a9d`::ref 0 aborting False >Thread-4974::DEBUG::2014-09-09 12:14:27,118::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4974::DEBUG::2014-09-09 12:14:27,118::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:27,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:27,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4975::DEBUG::2014-09-09 12:14:27,146::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4975::DEBUG::2014-09-09 12:14:27,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`75f8064d-97cd-4218-990f-ec550de50876`::moving from state init -> state preparing >Thread-4975::INFO::2014-09-09 12:14:27,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4975::DEBUG::2014-09-09 12:14:27,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d765a6d6-76ef-400e-ac87-ef1bdfce71ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4975::DEBUG::2014-09-09 12:14:27,148::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4975::DEBUG::2014-09-09 12:14:27,148::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4975::DEBUG::2014-09-09 12:14:27,148::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d765a6d6-76ef-400e-ac87-ef1bdfce71ad`::Granted request >Thread-4975::DEBUG::2014-09-09 12:14:27,148::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`75f8064d-97cd-4218-990f-ec550de50876`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4975::DEBUG::2014-09-09 12:14:27,148::task::993::Storage.TaskManager.Task::(_decref) Task=`75f8064d-97cd-4218-990f-ec550de50876`::ref 1 aborting False >Thread-4975::INFO::2014-09-09 12:14:27,150::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4975::DEBUG::2014-09-09 12:14:27,150::task::1191::Storage.TaskManager.Task::(prepare) Task=`75f8064d-97cd-4218-990f-ec550de50876`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4975::DEBUG::2014-09-09 12:14:27,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`75f8064d-97cd-4218-990f-ec550de50876`::moving from state preparing -> state finished >Thread-4975::DEBUG::2014-09-09 12:14:27,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4975::DEBUG::2014-09-09 12:14:27,150::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4975::DEBUG::2014-09-09 12:14:27,150::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4975::DEBUG::2014-09-09 12:14:27,150::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4975::DEBUG::2014-09-09 12:14:27,150::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4975::DEBUG::2014-09-09 12:14:27,150::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4975::DEBUG::2014-09-09 12:14:27,151::task::993::Storage.TaskManager.Task::(_decref) Task=`75f8064d-97cd-4218-990f-ec550de50876`::ref 0 aborting False >Thread-4975::DEBUG::2014-09-09 12:14:27,151::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4975::DEBUG::2014-09-09 12:14:27,151::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:28,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:28,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897538 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:29,882::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:29,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4976::DEBUG::2014-09-09 12:14:29,884::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:14:30,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:30,156::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:30,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:30,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:30,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:30,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:30,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:30,157::__init__::225::IOProcess::(_processLogs) (10485) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:30,157::__init__::225::IOProcess::(_processLogs) (10485) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:30,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(10485) Building response >Thread-19::DEBUG::2014-09-09 12:14:30,158::__init__::225::IOProcess::(_processLogs) (10485) Queuing response >Thread-24::DEBUG::2014-09-09 12:14:30,158::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:30,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:30,163::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:14:30,166::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000916438 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:30,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:30,166::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:30,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:30,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) (10486) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) (10486) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(10486) Building response >Thread-19::DEBUG::2014-09-09 12:14:30,167::__init__::225::IOProcess::(_processLogs) (10486) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:30,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:30,168::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:30,168::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:30,168::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:14:30,168::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) (10487) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) (10487) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) (10487) Building response >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) (10487) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:30,169::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:30,170::__init__::225::IOProcess::(_processLogs) (10488) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) (10488) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) (10488) Building response >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) (10488) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:14:30,171::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) (10489) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) (10489) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) (10489) Building response >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) (10489) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:30,172::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:14:30,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:31,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089566 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:32,335::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) (10490) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) (10490) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|(10490) Building response >Thread-19::DEBUG::2014-09-09 12:14:32,336::__init__::225::IOProcess::(_processLogs) (10490) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:32,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:32,337::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:14:32,337::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:14:32,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011097 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:32,345::__init__::225::IOProcess::(_processLogs) (10491) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:32,346::__init__::225::IOProcess::(_processLogs) (10491) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:32,346::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|(10491) Building response >Thread-19::DEBUG::2014-09-09 12:14:32,346::__init__::225::IOProcess::(_processLogs) (10491) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:32,346::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:32,347::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:32,892::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:32,892::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4977::DEBUG::2014-09-09 12:14:32,894::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:33,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:33,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896638 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:14:35,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:35,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896159 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:35,902::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:35,902::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4978::DEBUG::2014-09-09 12:14:35,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa11436a-e05d-4dd4-bfb6-222c0204c152`::moving from state init -> state preparing >Thread-4978::INFO::2014-09-09 12:14:35,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4978::INFO::2014-09-09 12:14:35,904::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011097', 'lastCheck': '3.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916438', 'lastCheck': '5.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000864115', 'lastCheck': '9.2', 'valid': True}} >Thread-4978::DEBUG::2014-09-09 12:14:35,904::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa11436a-e05d-4dd4-bfb6-222c0204c152`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011097', 'lastCheck': '3.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000916438', 'lastCheck': '5.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000864115', 'lastCheck': '9.2', 'valid': True}} >Thread-4978::DEBUG::2014-09-09 12:14:35,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa11436a-e05d-4dd4-bfb6-222c0204c152`::moving from state preparing -> state finished >Thread-4978::DEBUG::2014-09-09 12:14:35,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4978::DEBUG::2014-09-09 12:14:35,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4978::DEBUG::2014-09-09 12:14:35,904::task::993::Storage.TaskManager.Task::(_decref) Task=`aa11436a-e05d-4dd4-bfb6-222c0204c152`::ref 0 aborting False >Thread-4978::DEBUG::2014-09-09 12:14:35,905::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:35,918::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:35,918::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4979::DEBUG::2014-09-09 12:14:35,919::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) (10492) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:36,698::__init__::225::IOProcess::(_processLogs) (10492) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:36,700::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|(10492) Building response >Thread-19::DEBUG::2014-09-09 12:14:36,700::__init__::225::IOProcess::(_processLogs) (10492) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:36,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:36,700::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:14:36,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:14:36,708::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000936851 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) (10486) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:36,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:36,710::__init__::225::IOProcess::(_processLogs) (10493) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:36,710::__init__::225::IOProcess::(_processLogs) (10493) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:36,710::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10493) Building response >Thread-19::DEBUG::2014-09-09 12:14:36,711::__init__::225::IOProcess::(_processLogs) (10493) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:36,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:36,711::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:37,190::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:37,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4980::DEBUG::2014-09-09 12:14:37,191::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4980::DEBUG::2014-09-09 12:14:37,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa8151dc-e26f-4ea1-aed2-9855c8803d57`::moving from state init -> state preparing >Thread-4980::INFO::2014-09-09 12:14:37,192::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4980::INFO::2014-09-09 12:14:37,192::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4980::DEBUG::2014-09-09 12:14:37,192::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa8151dc-e26f-4ea1-aed2-9855c8803d57`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4980::DEBUG::2014-09-09 12:14:37,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa8151dc-e26f-4ea1-aed2-9855c8803d57`::moving from state preparing -> state finished >Thread-4980::DEBUG::2014-09-09 12:14:37,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4980::DEBUG::2014-09-09 12:14:37,193::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4980::DEBUG::2014-09-09 12:14:37,193::task::993::Storage.TaskManager.Task::(_decref) Task=`aa8151dc-e26f-4ea1-aed2-9855c8803d57`::ref 0 aborting False >Thread-4980::DEBUG::2014-09-09 12:14:37,193::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4980::DEBUG::2014-09-09 12:14:37,193::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:37,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:37,225::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4981::DEBUG::2014-09-09 12:14:37,225::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4981::DEBUG::2014-09-09 12:14:37,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`4343cf42-fd36-4d45-9e39-9d184d325d61`::moving from state init -> state preparing >Thread-4981::INFO::2014-09-09 12:14:37,225::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4981::DEBUG::2014-09-09 12:14:37,226::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b3d9b47e-ae94-4f82-9baf-6ad25115da59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4981::DEBUG::2014-09-09 12:14:37,226::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4981::DEBUG::2014-09-09 12:14:37,226::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4981::DEBUG::2014-09-09 12:14:37,226::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`b3d9b47e-ae94-4f82-9baf-6ad25115da59`::Granted request >Thread-4981::DEBUG::2014-09-09 12:14:37,226::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4343cf42-fd36-4d45-9e39-9d184d325d61`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4981::DEBUG::2014-09-09 12:14:37,226::task::993::Storage.TaskManager.Task::(_decref) Task=`4343cf42-fd36-4d45-9e39-9d184d325d61`::ref 1 aborting False >Thread-4981::INFO::2014-09-09 12:14:37,228::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4981::DEBUG::2014-09-09 12:14:37,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`4343cf42-fd36-4d45-9e39-9d184d325d61`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4981::DEBUG::2014-09-09 12:14:37,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`4343cf42-fd36-4d45-9e39-9d184d325d61`::moving from state preparing -> state finished >Thread-4981::DEBUG::2014-09-09 12:14:37,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4981::DEBUG::2014-09-09 12:14:37,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-97::DEBUG::2014-09-09 12:14:37,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-4981::DEBUG::2014-09-09 12:14:37,230::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4981::DEBUG::2014-09-09 12:14:37,235::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4981::DEBUG::2014-09-09 12:14:37,235::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4981::DEBUG::2014-09-09 12:14:37,235::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4981::DEBUG::2014-09-09 12:14:37,235::task::993::Storage.TaskManager.Task::(_decref) Task=`4343cf42-fd36-4d45-9e39-9d184d325d61`::ref 0 aborting False >Thread-4981::DEBUG::2014-09-09 12:14:37,235::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4981::DEBUG::2014-09-09 12:14:37,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:37,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896607 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:39,180::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:39,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4982::DEBUG::2014-09-09 12:14:39,182::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:39,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:39,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894359 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:40,172::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:40,172::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) (10494) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:40,173::__init__::225::IOProcess::(_processLogs) (10494) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:40,174::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10494) Building response >Thread-24::DEBUG::2014-09-09 12:14:40,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:40,174::__init__::225::IOProcess::(_processLogs) (10494) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:40,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:40,180::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:14:40,182::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000963022 s, 569 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:40,183::__init__::225::IOProcess::(_processLogs) (10495) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:40,184::__init__::225::IOProcess::(_processLogs) (10495) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:40,184::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10495) Building response >Thread-19::DEBUG::2014-09-09 12:14:40,184::__init__::225::IOProcess::(_processLogs) (10495) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:40,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:40,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) (10496) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) (10496) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) (10496) Building response >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) (10496) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:14:40,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) (10497) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) (10497) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) (10497) Building response >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) (10497) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:40,187::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:40,188::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:40,188::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:14:40,188::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:40,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:40,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) (10498) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) (10498) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) (10498) Building response >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) (10498) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:40,189::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:14:41,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:41,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895874 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:42,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:42,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4983::DEBUG::2014-09-09 12:14:42,190::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:14:42,347::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:42,347::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:42,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:42,347::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:42,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:42,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:42,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:42,348::__init__::225::IOProcess::(_processLogs) (10499) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:42,348::__init__::225::IOProcess::(_processLogs) (10499) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:42,349::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10499) Building response >Thread-19::DEBUG::2014-09-09 12:14:42,349::__init__::225::IOProcess::(_processLogs) (10499) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:42,349::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:14:42,349::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:42,350::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:14:42,358::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0011464 s, 980 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:42,358::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:42,358::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:42,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:42,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:42,358::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) (10500) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) (10500) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10500) Building response >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) (10500) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:42,359::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:42,360::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:14:43,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:43,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089642 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:45,195::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:45,196::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4984::DEBUG::2014-09-09 12:14:45,197::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:45,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:45,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895649 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:46,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:46,711::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:46,711::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) (10501) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) (10501) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:46,712::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10501) Building response >Thread-3443::DEBUG::2014-09-09 12:14:46,713::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:46,713::__init__::225::IOProcess::(_processLogs) (10501) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:46,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:46,719::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:14:46,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000939834 s, 378 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) (10502) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) (10502) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10502) Building response >Thread-19::DEBUG::2014-09-09 12:14:46,721::__init__::225::IOProcess::(_processLogs) (10502) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:46,722::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:46,722::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:47,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4985::DEBUG::2014-09-09 12:14:47,278::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:14:47,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4985::DEBUG::2014-09-09 12:14:47,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`daecaf42-e20a-4cef-a792-3049c5af55bd`::moving from state init -> state preparing >Thread-4985::INFO::2014-09-09 12:14:47,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4985::INFO::2014-09-09 12:14:47,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4985::DEBUG::2014-09-09 12:14:47,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`daecaf42-e20a-4cef-a792-3049c5af55bd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4985::DEBUG::2014-09-09 12:14:47,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`daecaf42-e20a-4cef-a792-3049c5af55bd`::moving from state preparing -> state finished >Thread-4985::DEBUG::2014-09-09 12:14:47,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4985::DEBUG::2014-09-09 12:14:47,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4985::DEBUG::2014-09-09 12:14:47,279::task::993::Storage.TaskManager.Task::(_decref) Task=`daecaf42-e20a-4cef-a792-3049c5af55bd`::ref 0 aborting False >Thread-4985::DEBUG::2014-09-09 12:14:47,280::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4985::DEBUG::2014-09-09 12:14:47,280::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:47,307::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:47,308::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4986::DEBUG::2014-09-09 12:14:47,308::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4986::DEBUG::2014-09-09 12:14:47,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`3510b1b5-5728-4992-acbe-eac2bf1efdc6`::moving from state init -> state preparing >Thread-4986::INFO::2014-09-09 12:14:47,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4986::DEBUG::2014-09-09 12:14:47,309::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`83ab935b-5e59-4850-aac4-af3b9ab0f7ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4986::DEBUG::2014-09-09 12:14:47,309::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4986::DEBUG::2014-09-09 12:14:47,309::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4986::DEBUG::2014-09-09 12:14:47,309::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`83ab935b-5e59-4850-aac4-af3b9ab0f7ef`::Granted request >Thread-4986::DEBUG::2014-09-09 12:14:47,310::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3510b1b5-5728-4992-acbe-eac2bf1efdc6`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4986::DEBUG::2014-09-09 12:14:47,310::task::993::Storage.TaskManager.Task::(_decref) Task=`3510b1b5-5728-4992-acbe-eac2bf1efdc6`::ref 1 aborting False >Thread-4986::INFO::2014-09-09 12:14:47,311::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4986::DEBUG::2014-09-09 12:14:47,312::task::1191::Storage.TaskManager.Task::(prepare) Task=`3510b1b5-5728-4992-acbe-eac2bf1efdc6`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4986::DEBUG::2014-09-09 12:14:47,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`3510b1b5-5728-4992-acbe-eac2bf1efdc6`::moving from state preparing -> state finished >Thread-4986::DEBUG::2014-09-09 12:14:47,312::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4986::DEBUG::2014-09-09 12:14:47,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4986::DEBUG::2014-09-09 12:14:47,312::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4986::DEBUG::2014-09-09 12:14:47,312::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4986::DEBUG::2014-09-09 12:14:47,312::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4986::DEBUG::2014-09-09 12:14:47,312::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4986::DEBUG::2014-09-09 12:14:47,312::task::993::Storage.TaskManager.Task::(_decref) Task=`3510b1b5-5728-4992-acbe-eac2bf1efdc6`::ref 0 aborting False >Thread-4986::DEBUG::2014-09-09 12:14:47,312::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4986::DEBUG::2014-09-09 12:14:47,313::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:47,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:47,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896338 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:48,202::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:48,203::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4987::DEBUG::2014-09-09 12:14:48,204::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:49,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:49,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0936395 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:50,189::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:50,190::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:50,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:50,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:50,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:50,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:50,193::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-24::DEBUG::2014-09-09 12:14:50,194::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:50,194::__init__::225::IOProcess::(_processLogs) (10503) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:50,201::__init__::225::IOProcess::(_processLogs) (10503) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:50,202::__init__::225::IOProcess::(_processLogs) (10503) Building response >Thread-19::DEBUG::2014-09-09 12:14:50,202::__init__::225::IOProcess::(_processLogs) (10503) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:50,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:14:50,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000886498 s, 618 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:50,204::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:50,206::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:50,206::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:14:50,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:50,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:50,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:50,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:50,209::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:50,210::__init__::225::IOProcess::(_processLogs) (10504) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:50,211::__init__::225::IOProcess::(_processLogs) (10504) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:50,211::__init__::225::IOProcess::(_processLogs) (10504) Building response >Thread-19::DEBUG::2014-09-09 12:14:50,212::__init__::225::IOProcess::(_processLogs) (10504) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:50,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:50,213::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:14:50,214::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:50,214::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:14:50,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:50,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:50,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:50,216::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:50,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:50,217::__init__::225::IOProcess::(_processLogs) (10505) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:50,217::__init__::225::IOProcess::(_processLogs) (10505) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:50,218::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10505) Building response >Thread-19::DEBUG::2014-09-09 12:14:50,219::__init__::225::IOProcess::(_processLogs) (10505) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:50,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:50,219::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:50,220::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:50,221::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:14:50,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:50,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:50,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:50,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:50,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:50,223::__init__::225::IOProcess::(_processLogs) (10506) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:50,224::__init__::225::IOProcess::(_processLogs) (10506) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:50,225::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10506) Building response >Thread-19::DEBUG::2014-09-09 12:14:50,225::__init__::225::IOProcess::(_processLogs) (10506) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:50,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:50,226::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:14:50,227::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:50,227::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:14:50,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:50,228::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:50,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:50,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:50,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:50,230::__init__::225::IOProcess::(_processLogs) (10507) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:14:50,230::__init__::225::IOProcess::(_processLogs) (10507) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:14:50,231::__init__::225::IOProcess::(_processLogs) (10507) Building response >Thread-19::DEBUG::2014-09-09 12:14:50,231::__init__::225::IOProcess::(_processLogs) (10507) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:50,232::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:50,233::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:51,210::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:51,211::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4988::DEBUG::2014-09-09 12:14:51,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e928cc2-3a1c-466a-bf08-20e2f1101776`::moving from state init -> state preparing >Thread-4988::INFO::2014-09-09 12:14:51,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4988::INFO::2014-09-09 12:14:51,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011464', 'lastCheck': '8.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000886498', 'lastCheck': '1.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939834', 'lastCheck': '4.5', 'valid': True}} >Thread-4988::DEBUG::2014-09-09 12:14:51,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e928cc2-3a1c-466a-bf08-20e2f1101776`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0011464', 'lastCheck': '8.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000886498', 'lastCheck': '1.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939834', 'lastCheck': '4.5', 'valid': True}} >Thread-4988::DEBUG::2014-09-09 12:14:51,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e928cc2-3a1c-466a-bf08-20e2f1101776`::moving from state preparing -> state finished >Thread-4988::DEBUG::2014-09-09 12:14:51,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4988::DEBUG::2014-09-09 12:14:51,213::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4988::DEBUG::2014-09-09 12:14:51,213::task::993::Storage.TaskManager.Task::(_decref) Task=`3e928cc2-3a1c-466a-bf08-20e2f1101776`::ref 0 aborting False >Thread-4988::DEBUG::2014-09-09 12:14:51,214::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:51,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:51,221::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4989::DEBUG::2014-09-09 12:14:51,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:52,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:52,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895503 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:52,360::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) (10508) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) (10508) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10508) Building response >Thread-19::DEBUG::2014-09-09 12:14:52,361::__init__::225::IOProcess::(_processLogs) (10508) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:52,362::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:14:52,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:52,362::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:14:52,370::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00118147 s, 951 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:52,370::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:52,370::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:14:52,370::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:52,370::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:52,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) (10509) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) (10509) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10509) Building response >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) (10509) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:52,371::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:52,372::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:14:54,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:54,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894961 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:54,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:54,400::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4990::DEBUG::2014-09-09 12:14:54,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:56,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:56,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896599 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:56,723::__init__::225::IOProcess::(_processLogs) (10510) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:56,724::__init__::225::IOProcess::(_processLogs) (10510) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:56,724::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10510) Building response >Thread-19::DEBUG::2014-09-09 12:14:56,724::__init__::225::IOProcess::(_processLogs) (10510) Queuing response >Thread-3443::DEBUG::2014-09-09 12:14:56,724::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:14:56,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:14:56,730::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:14:56,732::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000974885 s, 364 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:14:56,732::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:14:56,732::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:14:56,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) (10511) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) (10511) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10511) Building response >Thread-19::DEBUG::2014-09-09 12:14:56,733::__init__::225::IOProcess::(_processLogs) (10511) Queuing response >Thread-19::DEBUG::2014-09-09 12:14:56,734::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:14:56,734::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:57,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4991::DEBUG::2014-09-09 12:14:57,353::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:14:57,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4991::DEBUG::2014-09-09 12:14:57,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef1c3798-8771-45c3-82ab-c704e9956849`::moving from state init -> state preparing >Thread-4991::INFO::2014-09-09 12:14:57,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4991::INFO::2014-09-09 12:14:57,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4991::DEBUG::2014-09-09 12:14:57,355::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef1c3798-8771-45c3-82ab-c704e9956849`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4991::DEBUG::2014-09-09 12:14:57,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef1c3798-8771-45c3-82ab-c704e9956849`::moving from state preparing -> state finished >Thread-4991::DEBUG::2014-09-09 12:14:57,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4991::DEBUG::2014-09-09 12:14:57,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4991::DEBUG::2014-09-09 12:14:57,355::task::993::Storage.TaskManager.Task::(_decref) Task=`ef1c3798-8771-45c3-82ab-c704e9956849`::ref 0 aborting False >Thread-4991::DEBUG::2014-09-09 12:14:57,355::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4991::DEBUG::2014-09-09 12:14:57,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:57,383::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-4992::DEBUG::2014-09-09 12:14:57,384::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:14:57,384::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4992::DEBUG::2014-09-09 12:14:57,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e47f517-d2c5-4d0b-830c-fe5e24be80cd`::moving from state init -> state preparing >Thread-4992::INFO::2014-09-09 12:14:57,385::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4992::DEBUG::2014-09-09 12:14:57,385::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`25303d0d-bf0d-40e5-9015-22ce2f311cfb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4992::DEBUG::2014-09-09 12:14:57,385::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4992::DEBUG::2014-09-09 12:14:57,385::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4992::DEBUG::2014-09-09 12:14:57,385::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`25303d0d-bf0d-40e5-9015-22ce2f311cfb`::Granted request >Thread-4992::DEBUG::2014-09-09 12:14:57,385::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e47f517-d2c5-4d0b-830c-fe5e24be80cd`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4992::DEBUG::2014-09-09 12:14:57,386::task::993::Storage.TaskManager.Task::(_decref) Task=`3e47f517-d2c5-4d0b-830c-fe5e24be80cd`::ref 1 aborting False >Thread-4992::INFO::2014-09-09 12:14:57,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4992::DEBUG::2014-09-09 12:14:57,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e47f517-d2c5-4d0b-830c-fe5e24be80cd`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4992::DEBUG::2014-09-09 12:14:57,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e47f517-d2c5-4d0b-830c-fe5e24be80cd`::moving from state preparing -> state finished >Thread-4992::DEBUG::2014-09-09 12:14:57,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4992::DEBUG::2014-09-09 12:14:57,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4992::DEBUG::2014-09-09 12:14:57,388::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4992::DEBUG::2014-09-09 12:14:57,388::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4992::DEBUG::2014-09-09 12:14:57,388::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4992::DEBUG::2014-09-09 12:14:57,388::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4992::DEBUG::2014-09-09 12:14:57,388::task::993::Storage.TaskManager.Task::(_decref) Task=`3e47f517-d2c5-4d0b-830c-fe5e24be80cd`::ref 0 aborting False >Thread-4992::DEBUG::2014-09-09 12:14:57,388::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4992::DEBUG::2014-09-09 12:14:57,388::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:14:57,409::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:14:57,409::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4993::DEBUG::2014-09-09 12:14:57,410::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:14:58,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:14:58,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898063 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:00,233::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:00,234::__init__::225::IOProcess::(_processLogs) (10512) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:00,234::__init__::225::IOProcess::(_processLogs) (10512) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:00,234::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10512) Building response >Thread-19::DEBUG::2014-09-09 12:15:00,234::__init__::225::IOProcess::(_processLogs) (10512) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:00,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:00,234::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:15:00,235::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:15:00,243::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00101412 s, 540 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:00,244::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:00,244::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:00,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:00,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:00,244::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:00,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) (10513) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) (10513) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10513) Building response >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) (10513) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:00,245::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:15:00,246::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:00,246::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:15:00,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:00,246::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:00,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) (10514) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) (10514) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) (10514) Building response >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) (10514) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:15:00,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) (10515) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) (10515) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) (10515) Building response >Thread-19::DEBUG::2014-09-09 12:15:00,248::__init__::225::IOProcess::(_processLogs) (10515) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:00,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:00,249::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:00,249::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:00,249::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:15:00,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:00,249::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) (10516) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) (10516) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) (10516) Building response >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) (10516) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:00,250::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:15:00,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:00,510::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:00,510::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4994::DEBUG::2014-09-09 12:15:00,511::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:00,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896193 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:02,372::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) (10517) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) (10517) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:02,373::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10517) Building response >Thread-23::DEBUG::2014-09-09 12:15:02,374::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:02,374::__init__::225::IOProcess::(_processLogs) (10517) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:02,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:02,380::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:15:02,382::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113263 s, 992 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) (10518) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:02,383::__init__::225::IOProcess::(_processLogs) (10518) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:02,384::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10518) Building response >Thread-19::DEBUG::2014-09-09 12:15:02,384::__init__::225::IOProcess::(_processLogs) (10518) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:02,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:02,384::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:02,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:02,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089481 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:03,556::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:03,556::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4995::DEBUG::2014-09-09 12:15:03,557::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:04,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:04,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894999 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:06,564::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:06,565::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4996::DEBUG::2014-09-09 12:15:06,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cec93a2-eab0-4c5e-968f-84df1f75a0e2`::moving from state init -> state preparing >Thread-4996::INFO::2014-09-09 12:15:06,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-4996::INFO::2014-09-09 12:15:06,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113263', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101412', 'lastCheck': '6.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000974885', 'lastCheck': '9.8', 'valid': True}} >Thread-4996::DEBUG::2014-09-09 12:15:06,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`3cec93a2-eab0-4c5e-968f-84df1f75a0e2`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113263', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00101412', 'lastCheck': '6.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000974885', 'lastCheck': '9.8', 'valid': True}} >Thread-4996::DEBUG::2014-09-09 12:15:06,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`3cec93a2-eab0-4c5e-968f-84df1f75a0e2`::moving from state preparing -> state finished >Thread-4996::DEBUG::2014-09-09 12:15:06,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4996::DEBUG::2014-09-09 12:15:06,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4996::DEBUG::2014-09-09 12:15:06,568::task::993::Storage.TaskManager.Task::(_decref) Task=`3cec93a2-eab0-4c5e-968f-84df1f75a0e2`::ref 0 aborting False >Thread-4996::DEBUG::2014-09-09 12:15:06,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:06,576::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:06,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4997::DEBUG::2014-09-09 12:15:06,577::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:06,734::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) (10519) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) (10519) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10519) Building response >Thread-19::DEBUG::2014-09-09 12:15:06,735::__init__::225::IOProcess::(_processLogs) (10519) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:06,736::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:15:06,736::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:06,736::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:15:06,744::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000950007 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:06,745::__init__::225::IOProcess::(_processLogs) (10520) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:06,746::__init__::225::IOProcess::(_processLogs) (10520) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:06,746::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10520) Building response >Thread-19::DEBUG::2014-09-09 12:15:06,746::__init__::225::IOProcess::(_processLogs) (10520) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:06,746::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:06,747::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:06,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:06,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08953 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:07,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:07,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4998::DEBUG::2014-09-09 12:15:07,428::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4998::DEBUG::2014-09-09 12:15:07,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`30eaa182-b31e-4636-9ab4-08d5159cbfd9`::moving from state init -> state preparing >Thread-4998::INFO::2014-09-09 12:15:07,429::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4998::INFO::2014-09-09 12:15:07,430::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4998::DEBUG::2014-09-09 12:15:07,430::task::1191::Storage.TaskManager.Task::(prepare) Task=`30eaa182-b31e-4636-9ab4-08d5159cbfd9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-4998::DEBUG::2014-09-09 12:15:07,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`30eaa182-b31e-4636-9ab4-08d5159cbfd9`::moving from state preparing -> state finished >Thread-4998::DEBUG::2014-09-09 12:15:07,430::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-4998::DEBUG::2014-09-09 12:15:07,430::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4998::DEBUG::2014-09-09 12:15:07,430::task::993::Storage.TaskManager.Task::(_decref) Task=`30eaa182-b31e-4636-9ab4-08d5159cbfd9`::ref 0 aborting False >Thread-4998::DEBUG::2014-09-09 12:15:07,430::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-4998::DEBUG::2014-09-09 12:15:07,430::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:07,459::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:07,460::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-4999::DEBUG::2014-09-09 12:15:07,460::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-4999::DEBUG::2014-09-09 12:15:07,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`af48a3e0-1912-428b-90f3-ace1ab7e8991`::moving from state init -> state preparing >Thread-4999::INFO::2014-09-09 12:15:07,460::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-4999::DEBUG::2014-09-09 12:15:07,461::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d057eeb2-b4b8-4d08-b3df-f56da10cc9b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-4999::DEBUG::2014-09-09 12:15:07,461::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-4999::DEBUG::2014-09-09 12:15:07,461::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-4999::DEBUG::2014-09-09 12:15:07,461::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d057eeb2-b4b8-4d08-b3df-f56da10cc9b5`::Granted request >Thread-4999::DEBUG::2014-09-09 12:15:07,461::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af48a3e0-1912-428b-90f3-ace1ab7e8991`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-4999::DEBUG::2014-09-09 12:15:07,461::task::993::Storage.TaskManager.Task::(_decref) Task=`af48a3e0-1912-428b-90f3-ace1ab7e8991`::ref 1 aborting False >Thread-4999::INFO::2014-09-09 12:15:07,463::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4999::DEBUG::2014-09-09 12:15:07,463::task::1191::Storage.TaskManager.Task::(prepare) Task=`af48a3e0-1912-428b-90f3-ace1ab7e8991`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4999::DEBUG::2014-09-09 12:15:07,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`af48a3e0-1912-428b-90f3-ace1ab7e8991`::moving from state preparing -> state finished >Thread-4999::DEBUG::2014-09-09 12:15:07,463::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-4999::DEBUG::2014-09-09 12:15:07,463::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-4999::DEBUG::2014-09-09 12:15:07,463::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-4999::DEBUG::2014-09-09 12:15:07,464::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-4999::DEBUG::2014-09-09 12:15:07,464::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-4999::DEBUG::2014-09-09 12:15:07,464::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-4999::DEBUG::2014-09-09 12:15:07,464::task::993::Storage.TaskManager.Task::(_decref) Task=`af48a3e0-1912-428b-90f3-ace1ab7e8991`::ref 0 aborting False >Thread-4999::DEBUG::2014-09-09 12:15:07,464::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-4999::DEBUG::2014-09-09 12:15:07,464::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:08,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:08,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895367 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:09,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:09,907::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5000::DEBUG::2014-09-09 12:15:09,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:10,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:10,251::__init__::225::IOProcess::(_processLogs) (10521) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:10,251::__init__::225::IOProcess::(_processLogs) (10521) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:10,251::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10521) Building response >Thread-24::DEBUG::2014-09-09 12:15:10,251::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:10,252::__init__::225::IOProcess::(_processLogs) (10521) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:10,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:10,257::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:15:10,259::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000985513 s, 556 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:10,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:10,261::__init__::225::IOProcess::(_processLogs) (10522) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:10,261::__init__::225::IOProcess::(_processLogs) (10522) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:10,261::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10522) Building response >Thread-19::DEBUG::2014-09-09 12:15:10,261::__init__::225::IOProcess::(_processLogs) (10522) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:10,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) (10523) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) (10523) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) (10523) Building response >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) (10523) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:15:10,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) (10524) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) (10524) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) (10524) Building response >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) (10524) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:10,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) (10525) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:10,265::__init__::225::IOProcess::(_processLogs) (10525) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:10,266::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10525) Building response >Thread-19::DEBUG::2014-09-09 12:15:10,266::__init__::225::IOProcess::(_processLogs) (10525) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:10,266::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:10,266::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:15:10,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:11,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896166 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:12,385::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) (10526) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:12,386::__init__::225::IOProcess::(_processLogs) (10526) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:12,387::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10526) Building response >Thread-19::DEBUG::2014-09-09 12:15:12,387::__init__::225::IOProcess::(_processLogs) (10526) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:12,387::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:12,388::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:15:12,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:15:12,395::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109972 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:12,396::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:12,396::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:12,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:12,396::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:12,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:12,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:12,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:12,397::__init__::225::IOProcess::(_processLogs) (10527) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:12,397::__init__::225::IOProcess::(_processLogs) (10527) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:12,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10527) Building response >Thread-19::DEBUG::2014-09-09 12:15:12,398::__init__::225::IOProcess::(_processLogs) (10527) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:12,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:12,398::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:12,924::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:12,924::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5001::DEBUG::2014-09-09 12:15:12,925::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:13,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:13,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895012 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:15:15,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:15,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895202 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:15,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:15,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5002::DEBUG::2014-09-09 12:15:15,933::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:16,747::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:16,747::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:16,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) (10528) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) (10528) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10528) Building response >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) (10528) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:16,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:16,749::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:15:16,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:15:16,757::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000918437 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:16,757::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:16,757::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:16,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) (10529) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) (10529) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10529) Building response >Thread-19::DEBUG::2014-09-09 12:15:16,758::__init__::225::IOProcess::(_processLogs) (10529) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:16,759::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:16,759::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:17,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:17,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089542 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:17,502::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:17,503::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5003::DEBUG::2014-09-09 12:15:17,503::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5003::DEBUG::2014-09-09 12:15:17,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`226c24cf-a358-4cf3-ae98-321cf39c30da`::moving from state init -> state preparing >Thread-5003::INFO::2014-09-09 12:15:17,504::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5003::INFO::2014-09-09 12:15:17,505::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5003::DEBUG::2014-09-09 12:15:17,505::task::1191::Storage.TaskManager.Task::(prepare) Task=`226c24cf-a358-4cf3-ae98-321cf39c30da`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5003::DEBUG::2014-09-09 12:15:17,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`226c24cf-a358-4cf3-ae98-321cf39c30da`::moving from state preparing -> state finished >Thread-5003::DEBUG::2014-09-09 12:15:17,505::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5003::DEBUG::2014-09-09 12:15:17,505::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5003::DEBUG::2014-09-09 12:15:17,505::task::993::Storage.TaskManager.Task::(_decref) Task=`226c24cf-a358-4cf3-ae98-321cf39c30da`::ref 0 aborting False >Thread-5003::DEBUG::2014-09-09 12:15:17,505::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5003::DEBUG::2014-09-09 12:15:17,505::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:17,563::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5004::DEBUG::2014-09-09 12:15:17,563::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:15:17,563::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5004::DEBUG::2014-09-09 12:15:17,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`e427c5b5-aac3-42da-a825-bd059040aa09`::moving from state init -> state preparing >Thread-5004::INFO::2014-09-09 12:15:17,564::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5004::DEBUG::2014-09-09 12:15:17,565::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`aa29ad17-11e9-4e53-8421-ee4125204107`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5004::DEBUG::2014-09-09 12:15:17,566::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5004::DEBUG::2014-09-09 12:15:17,566::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5004::DEBUG::2014-09-09 12:15:17,566::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`aa29ad17-11e9-4e53-8421-ee4125204107`::Granted request >Thread-5004::DEBUG::2014-09-09 12:15:17,566::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e427c5b5-aac3-42da-a825-bd059040aa09`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5004::DEBUG::2014-09-09 12:15:17,566::task::993::Storage.TaskManager.Task::(_decref) Task=`e427c5b5-aac3-42da-a825-bd059040aa09`::ref 1 aborting False >Thread-5004::INFO::2014-09-09 12:15:17,568::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5004::DEBUG::2014-09-09 12:15:17,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`e427c5b5-aac3-42da-a825-bd059040aa09`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5004::DEBUG::2014-09-09 12:15:17,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`e427c5b5-aac3-42da-a825-bd059040aa09`::moving from state preparing -> state finished >Thread-5004::DEBUG::2014-09-09 12:15:17,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5004::DEBUG::2014-09-09 12:15:17,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5004::DEBUG::2014-09-09 12:15:17,568::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5004::DEBUG::2014-09-09 12:15:17,568::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5004::DEBUG::2014-09-09 12:15:17,569::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5004::DEBUG::2014-09-09 12:15:17,569::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5004::DEBUG::2014-09-09 12:15:17,569::task::993::Storage.TaskManager.Task::(_decref) Task=`e427c5b5-aac3-42da-a825-bd059040aa09`::ref 0 aborting False >Thread-5004::DEBUG::2014-09-09 12:15:17,569::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5004::DEBUG::2014-09-09 12:15:17,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:18,940::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:18,940::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5005::DEBUG::2014-09-09 12:15:18,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:19,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:19,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0944936 s, 10.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:20,267::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:20,268::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:20,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:20,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:20,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:20,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:20,272::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-24::DEBUG::2014-09-09 12:15:20,273::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:20,274::__init__::225::IOProcess::(_processLogs) (10530) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:20,280::__init__::225::IOProcess::(_processLogs) (10530) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:20,280::__init__::225::IOProcess::(_processLogs) (10530) Building response >Thread-19::DEBUG::2014-09-09 12:15:20,281::__init__::225::IOProcess::(_processLogs) (10530) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:20,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:20,282::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:15:20,283::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000909557 s, 602 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:20,285::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:20,285::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:20,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:20,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:20,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:20,288::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:20,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:20,289::__init__::225::IOProcess::(_processLogs) (10531) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:20,290::__init__::225::IOProcess::(_processLogs) (10531) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:20,290::__init__::225::IOProcess::(_processLogs) (10531) Building response >Thread-19::DEBUG::2014-09-09 12:15:20,291::__init__::225::IOProcess::(_processLogs) (10531) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:20,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:20,292::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:15:20,293::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:20,293::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:15:20,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:20,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:20,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:20,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:20,296::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:20,296::__init__::225::IOProcess::(_processLogs) (10532) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:20,297::__init__::225::IOProcess::(_processLogs) (10532) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:20,297::__init__::225::IOProcess::(_processLogs) (10532) Building response >Thread-19::DEBUG::2014-09-09 12:15:20,298::__init__::225::IOProcess::(_processLogs) (10532) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:20,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:20,299::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:20,300::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:20,300::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:15:20,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:20,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:20,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:20,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:20,303::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:20,304::__init__::225::IOProcess::(_processLogs) (10533) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:20,304::__init__::225::IOProcess::(_processLogs) (10533) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:20,304::__init__::225::IOProcess::(_processLogs) (10533) Building response >Thread-19::DEBUG::2014-09-09 12:15:20,304::__init__::225::IOProcess::(_processLogs) (10533) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:20,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:20,304::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:20,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:20,306::__init__::225::IOProcess::(_processLogs) (10534) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:20,306::__init__::225::IOProcess::(_processLogs) (10534) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:20,306::__init__::225::IOProcess::(_processLogs) (10534) Building response >Thread-19::DEBUG::2014-09-09 12:15:20,306::__init__::225::IOProcess::(_processLogs) (10534) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:20,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:20,306::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:15:21,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:21,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895989 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:21,947::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:21,948::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5006::DEBUG::2014-09-09 12:15:21,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`27aa08bc-ce3c-48a5-8f42-2c2b5a923459`::moving from state init -> state preparing >Thread-5006::INFO::2014-09-09 12:15:21,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5006::INFO::2014-09-09 12:15:21,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109972', 'lastCheck': '9.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000909557', 'lastCheck': '1.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000918437', 'lastCheck': '5.2', 'valid': True}} >Thread-5006::DEBUG::2014-09-09 12:15:21,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`27aa08bc-ce3c-48a5-8f42-2c2b5a923459`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109972', 'lastCheck': '9.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000909557', 'lastCheck': '1.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000918437', 'lastCheck': '5.2', 'valid': True}} >Thread-5006::DEBUG::2014-09-09 12:15:21,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`27aa08bc-ce3c-48a5-8f42-2c2b5a923459`::moving from state preparing -> state finished >Thread-5006::DEBUG::2014-09-09 12:15:21,949::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5006::DEBUG::2014-09-09 12:15:21,949::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5006::DEBUG::2014-09-09 12:15:21,949::task::993::Storage.TaskManager.Task::(_decref) Task=`27aa08bc-ce3c-48a5-8f42-2c2b5a923459`::ref 0 aborting False >Thread-5006::DEBUG::2014-09-09 12:15:21,950::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:21,956::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:21,956::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5007::DEBUG::2014-09-09 12:15:21,957::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:22,398::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:22,398::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:22,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:22,398::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) (10535) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) (10535) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10535) Building response >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) (10535) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:22,399::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:15:22,400::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:15:22,406::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109779 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:22,407::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:22,407::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:22,407::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:22,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:22,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) (10536) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) (10536) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10536) Building response >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) (10536) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:22,408::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:23,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:23,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895506 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:25,083::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:25,084::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5008::DEBUG::2014-09-09 12:15:25,084::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:25,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:25,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894496 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) (10537) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:26,760::__init__::225::IOProcess::(_processLogs) (10537) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:26,761::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10537) Building response >Thread-19::DEBUG::2014-09-09 12:15:26,761::__init__::225::IOProcess::(_processLogs) (10537) Queuing response >Thread-3443::DEBUG::2014-09-09 12:15:26,761::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:26,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:26,767::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:15:26,769::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00099539 s, 357 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:26,769::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:26,769::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:26,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:26,769::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) (10538) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) (10538) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10538) Building response >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) (10538) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:26,770::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:26,771::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:27,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5009::DEBUG::2014-09-09 12:15:27,613::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:15:27,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5009::DEBUG::2014-09-09 12:15:27,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb0fb498-09e7-4953-8990-ecb367078aeb`::moving from state init -> state preparing >Thread-5009::INFO::2014-09-09 12:15:27,614::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5009::INFO::2014-09-09 12:15:27,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5009::DEBUG::2014-09-09 12:15:27,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb0fb498-09e7-4953-8990-ecb367078aeb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5009::DEBUG::2014-09-09 12:15:27,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb0fb498-09e7-4953-8990-ecb367078aeb`::moving from state preparing -> state finished >Thread-5009::DEBUG::2014-09-09 12:15:27,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5009::DEBUG::2014-09-09 12:15:27,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5009::DEBUG::2014-09-09 12:15:27,615::task::993::Storage.TaskManager.Task::(_decref) Task=`eb0fb498-09e7-4953-8990-ecb367078aeb`::ref 0 aborting False >Thread-5009::DEBUG::2014-09-09 12:15:27,615::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5009::DEBUG::2014-09-09 12:15:27,615::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:27,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:27,644::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5010::DEBUG::2014-09-09 12:15:27,645::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5010::DEBUG::2014-09-09 12:15:27,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`3efd5e2c-b41a-4af5-b57f-332f9dc7e2d9`::moving from state init -> state preparing >Thread-5010::INFO::2014-09-09 12:15:27,645::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5010::DEBUG::2014-09-09 12:15:27,646::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2086fb16-f37c-46e8-a49a-7acc20440a16`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5010::DEBUG::2014-09-09 12:15:27,646::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5010::DEBUG::2014-09-09 12:15:27,646::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5010::DEBUG::2014-09-09 12:15:27,646::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`2086fb16-f37c-46e8-a49a-7acc20440a16`::Granted request >Thread-5010::DEBUG::2014-09-09 12:15:27,646::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3efd5e2c-b41a-4af5-b57f-332f9dc7e2d9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5010::DEBUG::2014-09-09 12:15:27,646::task::993::Storage.TaskManager.Task::(_decref) Task=`3efd5e2c-b41a-4af5-b57f-332f9dc7e2d9`::ref 1 aborting False >Thread-5010::INFO::2014-09-09 12:15:27,648::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5010::DEBUG::2014-09-09 12:15:27,648::task::1191::Storage.TaskManager.Task::(prepare) Task=`3efd5e2c-b41a-4af5-b57f-332f9dc7e2d9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5010::DEBUG::2014-09-09 12:15:27,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`3efd5e2c-b41a-4af5-b57f-332f9dc7e2d9`::moving from state preparing -> state finished >Thread-5010::DEBUG::2014-09-09 12:15:27,648::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5010::DEBUG::2014-09-09 12:15:27,648::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5010::DEBUG::2014-09-09 12:15:27,648::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5010::DEBUG::2014-09-09 12:15:27,648::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5010::DEBUG::2014-09-09 12:15:27,649::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5010::DEBUG::2014-09-09 12:15:27,649::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5010::DEBUG::2014-09-09 12:15:27,649::task::993::Storage.TaskManager.Task::(_decref) Task=`3efd5e2c-b41a-4af5-b57f-332f9dc7e2d9`::ref 0 aborting False >Thread-5010::DEBUG::2014-09-09 12:15:27,649::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5010::DEBUG::2014-09-09 12:15:27,649::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:27,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:27,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895136 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:28,090::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:28,091::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5011::DEBUG::2014-09-09 12:15:28,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:29,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:30,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897509 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) (10539) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) (10539) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:30,306::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10539) Building response >Thread-19::DEBUG::2014-09-09 12:15:30,307::__init__::225::IOProcess::(_processLogs) (10539) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:30,307::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:30,307::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:15:30,307::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:15:30,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100089 s, 548 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:30,316::__init__::225::IOProcess::(_processLogs) (10540) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:30,317::__init__::225::IOProcess::(_processLogs) (10540) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:30,317::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10540) Building response >Thread-19::DEBUG::2014-09-09 12:15:30,317::__init__::225::IOProcess::(_processLogs) (10540) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:30,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:30,317::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:15:30,318::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:30,318::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:15:30,318::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:30,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) (10541) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) (10541) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) (10541) Building response >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) (10541) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:30,319::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) (10542) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:30,320::__init__::225::IOProcess::(_processLogs) (10542) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) (10542) Building response >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) (10542) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:15:30,321::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) (10543) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) (10543) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) (10543) Building response >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) (10543) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:30,322::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:31,099::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:31,101::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5012::DEBUG::2014-09-09 12:15:31,101::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:32,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:32,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895846 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:32,409::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) (10544) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) (10544) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:32,410::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10544) Building response >Thread-19::DEBUG::2014-09-09 12:15:32,411::__init__::225::IOProcess::(_processLogs) (10544) Queuing response >Thread-23::DEBUG::2014-09-09 12:15:32,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:32,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:32,416::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:15:32,418::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108455 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) (10545) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:32,419::__init__::225::IOProcess::(_processLogs) (10545) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:32,420::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10545) Building response >Thread-19::DEBUG::2014-09-09 12:15:32,420::__init__::225::IOProcess::(_processLogs) (10545) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:32,420::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:32,420::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:34,109::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:34,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5013::DEBUG::2014-09-09 12:15:34,110::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:34,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:34,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896451 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:15:36,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:36,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896249 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:36,771::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) (10546) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:36,772::__init__::225::IOProcess::(_processLogs) (10546) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:36,774::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10546) Building response >Thread-19::DEBUG::2014-09-09 12:15:36,774::__init__::225::IOProcess::(_processLogs) (10546) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:36,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:36,774::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:15:36,775::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:15:36,783::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000986953 s, 360 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:36,783::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:36,783::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:36,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) (10547) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) (10547) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10547) Building response >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) (10547) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:36,784::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:15:36,785::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:37,116::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:37,117::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5014::DEBUG::2014-09-09 12:15:37,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`07176658-175d-42bb-b92c-164ac959d29b`::moving from state init -> state preparing >Thread-5014::INFO::2014-09-09 12:15:37,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5014::INFO::2014-09-09 12:15:37,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108455', 'lastCheck': '4.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100089', 'lastCheck': '6.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986953', 'lastCheck': '0.3', 'valid': True}} >Thread-5014::DEBUG::2014-09-09 12:15:37,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`07176658-175d-42bb-b92c-164ac959d29b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108455', 'lastCheck': '4.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100089', 'lastCheck': '6.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986953', 'lastCheck': '0.3', 'valid': True}} >Thread-5014::DEBUG::2014-09-09 12:15:37,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`07176658-175d-42bb-b92c-164ac959d29b`::moving from state preparing -> state finished >Thread-5014::DEBUG::2014-09-09 12:15:37,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5014::DEBUG::2014-09-09 12:15:37,119::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5014::DEBUG::2014-09-09 12:15:37,119::task::993::Storage.TaskManager.Task::(_decref) Task=`07176658-175d-42bb-b92c-164ac959d29b`::ref 0 aborting False >Thread-5014::DEBUG::2014-09-09 12:15:37,120::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:37,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:37,128::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5015::DEBUG::2014-09-09 12:15:37,128::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:37,764::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:37,764::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5016::DEBUG::2014-09-09 12:15:37,764::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5016::DEBUG::2014-09-09 12:15:37,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`8aba887e-94bd-4860-90e1-42264ce193a9`::moving from state init -> state preparing >Thread-5016::INFO::2014-09-09 12:15:37,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5016::INFO::2014-09-09 12:15:37,766::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5016::DEBUG::2014-09-09 12:15:37,766::task::1191::Storage.TaskManager.Task::(prepare) Task=`8aba887e-94bd-4860-90e1-42264ce193a9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5016::DEBUG::2014-09-09 12:15:37,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`8aba887e-94bd-4860-90e1-42264ce193a9`::moving from state preparing -> state finished >Thread-5016::DEBUG::2014-09-09 12:15:37,766::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5016::DEBUG::2014-09-09 12:15:37,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5016::DEBUG::2014-09-09 12:15:37,766::task::993::Storage.TaskManager.Task::(_decref) Task=`8aba887e-94bd-4860-90e1-42264ce193a9`::ref 0 aborting False >Thread-5016::DEBUG::2014-09-09 12:15:37,766::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5016::DEBUG::2014-09-09 12:15:37,766::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:38,038::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5017::DEBUG::2014-09-09 12:15:38,038::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:15:38,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5017::DEBUG::2014-09-09 12:15:38,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`57896a95-5772-49ed-9ef4-227f3e94f692`::moving from state init -> state preparing >Thread-5017::INFO::2014-09-09 12:15:38,039::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5017::DEBUG::2014-09-09 12:15:38,040::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ae4799f7-48a7-4d3c-96c0-5a921f79a0a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5017::DEBUG::2014-09-09 12:15:38,040::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5017::DEBUG::2014-09-09 12:15:38,040::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5017::DEBUG::2014-09-09 12:15:38,040::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ae4799f7-48a7-4d3c-96c0-5a921f79a0a9`::Granted request >Thread-5017::DEBUG::2014-09-09 12:15:38,040::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`57896a95-5772-49ed-9ef4-227f3e94f692`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5017::DEBUG::2014-09-09 12:15:38,040::task::993::Storage.TaskManager.Task::(_decref) Task=`57896a95-5772-49ed-9ef4-227f3e94f692`::ref 1 aborting False >Thread-5017::INFO::2014-09-09 12:15:38,042::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5017::DEBUG::2014-09-09 12:15:38,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`57896a95-5772-49ed-9ef4-227f3e94f692`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5017::DEBUG::2014-09-09 12:15:38,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`57896a95-5772-49ed-9ef4-227f3e94f692`::moving from state preparing -> state finished >Thread-5017::DEBUG::2014-09-09 12:15:38,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5017::DEBUG::2014-09-09 12:15:38,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5017::DEBUG::2014-09-09 12:15:38,042::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5017::DEBUG::2014-09-09 12:15:38,042::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5017::DEBUG::2014-09-09 12:15:38,043::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5017::DEBUG::2014-09-09 12:15:38,043::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5017::DEBUG::2014-09-09 12:15:38,043::task::993::Storage.TaskManager.Task::(_decref) Task=`57896a95-5772-49ed-9ef4-227f3e94f692`::ref 0 aborting False >Thread-5017::DEBUG::2014-09-09 12:15:38,043::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5017::DEBUG::2014-09-09 12:15:38,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:38,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:38,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897343 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:40,227::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:40,228::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5018::DEBUG::2014-09-09 12:15:40,229::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:40,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:40,323::__init__::225::IOProcess::(_processLogs) (10548) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:40,323::__init__::225::IOProcess::(_processLogs) (10548) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:40,323::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10548) Building response >Thread-24::DEBUG::2014-09-09 12:15:40,323::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:15:40,324::__init__::225::IOProcess::(_processLogs) (10548) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:40,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:40,329::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:15:40,331::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000911398 s, 601 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:40,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:40,333::__init__::225::IOProcess::(_processLogs) (10549) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:40,333::__init__::225::IOProcess::(_processLogs) (10549) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:40,333::__init__::225::IOProcess::(_processLogs) (10549) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:40,333::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:15:40,334::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:15:40,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:40,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:40,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:40,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:40,334::__init__::225::IOProcess::(_processLogs) (10550) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) (10550) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) (10550) Building response >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) (10550) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:40,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) (10551) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) (10551) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) (10551) Building response >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) (10551) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:15:40,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) (10552) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) (10552) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) (10552) Building response >Thread-19::DEBUG::2014-09-09 12:15:40,337::__init__::225::IOProcess::(_processLogs) (10552) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:40,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:40,338::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:15:40,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:40,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895642 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:42,421::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:42,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:42,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:42,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:42,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:42,422::__init__::225::IOProcess::(_processLogs) (10553) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:42,422::__init__::225::IOProcess::(_processLogs) (10553) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:42,423::__init__::225::IOProcess::(_processLogs) (10553) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:42,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:15:42,423::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:15:42,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00118472 s, 948 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:42,431::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:42,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:42,431::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:42,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:42,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:42,432::__init__::225::IOProcess::(_processLogs) (10554) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:42,432::__init__::225::IOProcess::(_processLogs) (10554) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:42,432::__init__::225::IOProcess::(_processLogs) (10554) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:42,432::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:15:42,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:42,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896293 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:43,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:43,239::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5019::DEBUG::2014-09-09 12:15:43,239::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:44,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:44,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896525 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:46,248::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:46,248::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5020::DEBUG::2014-09-09 12:15:46,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:46,786::__init__::225::IOProcess::(_processLogs) (10555) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:46,787::__init__::225::IOProcess::(_processLogs) (10555) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:46,787::__init__::225::IOProcess::(_processLogs) DEBUG|(10555) Building response >Thread-19::DEBUG::2014-09-09 12:15:46,787::__init__::225::IOProcess::(_processLogs) (10555) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:46,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:46,787::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:15:46,788::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:15:46,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000932445 s, 381 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:46,795::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:15:46,795::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:46,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:46,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:46,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:46,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:46,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:46,796::__init__::225::IOProcess::(_processLogs) (10556) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:46,796::__init__::225::IOProcess::(_processLogs) (10556) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:46,796::__init__::225::IOProcess::(_processLogs) (10556) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:46,796::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:46,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:46,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896006 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:48,103::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5021::DEBUG::2014-09-09 12:15:48,104::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:15:48,104::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5021::DEBUG::2014-09-09 12:15:48,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`41c806c2-a869-4147-b34a-da677658fe18`::moving from state init -> state preparing >Thread-5021::INFO::2014-09-09 12:15:48,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5021::INFO::2014-09-09 12:15:48,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5021::DEBUG::2014-09-09 12:15:48,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`41c806c2-a869-4147-b34a-da677658fe18`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5021::DEBUG::2014-09-09 12:15:48,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`41c806c2-a869-4147-b34a-da677658fe18`::moving from state preparing -> state finished >Thread-5021::DEBUG::2014-09-09 12:15:48,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5021::DEBUG::2014-09-09 12:15:48,106::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5021::DEBUG::2014-09-09 12:15:48,106::task::993::Storage.TaskManager.Task::(_decref) Task=`41c806c2-a869-4147-b34a-da677658fe18`::ref 0 aborting False >Thread-5021::DEBUG::2014-09-09 12:15:48,106::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5021::DEBUG::2014-09-09 12:15:48,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:48,130::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:48,131::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5022::DEBUG::2014-09-09 12:15:48,131::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5022::DEBUG::2014-09-09 12:15:48,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`82850cc1-3150-454b-9984-63f4c9202b2a`::moving from state init -> state preparing >Thread-5022::INFO::2014-09-09 12:15:48,132::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5022::DEBUG::2014-09-09 12:15:48,132::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fb4f1e0a-a604-4589-9030-18a1265fabc2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5022::DEBUG::2014-09-09 12:15:48,132::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5022::DEBUG::2014-09-09 12:15:48,133::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5022::DEBUG::2014-09-09 12:15:48,133::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fb4f1e0a-a604-4589-9030-18a1265fabc2`::Granted request >Thread-5022::DEBUG::2014-09-09 12:15:48,133::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82850cc1-3150-454b-9984-63f4c9202b2a`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5022::DEBUG::2014-09-09 12:15:48,133::task::993::Storage.TaskManager.Task::(_decref) Task=`82850cc1-3150-454b-9984-63f4c9202b2a`::ref 1 aborting False >Thread-5022::INFO::2014-09-09 12:15:48,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5022::DEBUG::2014-09-09 12:15:48,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`82850cc1-3150-454b-9984-63f4c9202b2a`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5022::DEBUG::2014-09-09 12:15:48,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`82850cc1-3150-454b-9984-63f4c9202b2a`::moving from state preparing -> state finished >Thread-5022::DEBUG::2014-09-09 12:15:48,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5022::DEBUG::2014-09-09 12:15:48,135::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5022::DEBUG::2014-09-09 12:15:48,135::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5022::DEBUG::2014-09-09 12:15:48,135::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5022::DEBUG::2014-09-09 12:15:48,135::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5022::DEBUG::2014-09-09 12:15:48,135::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5022::DEBUG::2014-09-09 12:15:48,136::task::993::Storage.TaskManager.Task::(_decref) Task=`82850cc1-3150-454b-9984-63f4c9202b2a`::ref 0 aborting False >Thread-5022::DEBUG::2014-09-09 12:15:48,136::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283539144704', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5022::DEBUG::2014-09-09 12:15:48,136::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:48,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:49,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895684 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:49,259::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:49,260::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5023::DEBUG::2014-09-09 12:15:49,261::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:50,337::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:50,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:50,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:50,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:50,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:50,338::__init__::225::IOProcess::(_processLogs) (10557) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:50,338::__init__::225::IOProcess::(_processLogs) (10557) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:50,339::__init__::225::IOProcess::(_processLogs) (10557) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:50,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:15:50,339::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:15:50,347::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0010272 s, 533 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) (10558) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:50,348::__init__::225::IOProcess::(_processLogs) (10558) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:50,349::__init__::225::IOProcess::(_processLogs) (10558) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:50,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:50,349::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:15:50,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) (10559) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) (10559) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) (10559) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:50,350::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) (10560) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:50,351::__init__::225::IOProcess::(_processLogs) (10560) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:50,352::__init__::225::IOProcess::(_processLogs) (10560) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:50,352::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:15:50,352::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:15:50,352::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) (10561) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) (10561) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) (10561) Building response >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) (10561) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:50,353::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:15:51,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:51,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895498 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:52,269::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:52,270::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5024::DEBUG::2014-09-09 12:15:52,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c1caef0-aaa3-44a3-85da-890d13de0f52`::moving from state init -> state preparing >Thread-5024::INFO::2014-09-09 12:15:52,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5024::INFO::2014-09-09 12:15:52,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00118472', 'lastCheck': '9.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010272', 'lastCheck': '1.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000932445', 'lastCheck': '5.5', 'valid': True}} >Thread-5024::DEBUG::2014-09-09 12:15:52,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c1caef0-aaa3-44a3-85da-890d13de0f52`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00118472', 'lastCheck': '9.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010272', 'lastCheck': '1.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000932445', 'lastCheck': '5.5', 'valid': True}} >Thread-5024::DEBUG::2014-09-09 12:15:52,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c1caef0-aaa3-44a3-85da-890d13de0f52`::moving from state preparing -> state finished >Thread-5024::DEBUG::2014-09-09 12:15:52,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5024::DEBUG::2014-09-09 12:15:52,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5024::DEBUG::2014-09-09 12:15:52,272::task::993::Storage.TaskManager.Task::(_decref) Task=`4c1caef0-aaa3-44a3-85da-890d13de0f52`::ref 0 aborting False >Thread-5024::DEBUG::2014-09-09 12:15:52,272::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:52,297::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:52,298::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5025::DEBUG::2014-09-09 12:15:52,298::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:52,433::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:52,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) (10562) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) (10562) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) (10562) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:52,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:15:52,435::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:15:52,441::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115601 s, 971 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:52,442::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:15:52,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:52,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:52,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:52,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:52,442::__init__::225::IOProcess::(_processLogs) (10563) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:52,443::__init__::225::IOProcess::(_processLogs) (10563) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:52,443::__init__::225::IOProcess::(_processLogs) (10563) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:52,443::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:53,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:53,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895674 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:15:55,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:55,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089678 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:55,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:55,490::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5026::DEBUG::2014-09-09 12:15:55,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:15:56,797::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:56,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:56,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:56,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:15:56,798::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:56,798::__init__::225::IOProcess::(_processLogs) (10564) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:56,798::__init__::225::IOProcess::(_processLogs) (10564) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:56,798::__init__::225::IOProcess::(_processLogs) (10564) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:56,798::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:15:56,799::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:15:56,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000937189 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) (10565) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:15:56,806::__init__::225::IOProcess::(_processLogs) (10565) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:15:56,807::__init__::225::IOProcess::(_processLogs) (10565) Queuing response >Thread-19::DEBUG::2014-09-09 12:15:56,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:15:56,807::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:15:57,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:57,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896335 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:58,175::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:58,176::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5027::DEBUG::2014-09-09 12:15:58,176::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5027::DEBUG::2014-09-09 12:15:58,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeb88742-9e08-4f75-a18d-17d3af1a15c6`::moving from state init -> state preparing >Thread-5027::INFO::2014-09-09 12:15:58,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5027::INFO::2014-09-09 12:15:58,177::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5027::DEBUG::2014-09-09 12:15:58,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`eeb88742-9e08-4f75-a18d-17d3af1a15c6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5027::DEBUG::2014-09-09 12:15:58,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeb88742-9e08-4f75-a18d-17d3af1a15c6`::moving from state preparing -> state finished >Thread-5027::DEBUG::2014-09-09 12:15:58,178::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5027::DEBUG::2014-09-09 12:15:58,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5027::DEBUG::2014-09-09 12:15:58,178::task::993::Storage.TaskManager.Task::(_decref) Task=`eeb88742-9e08-4f75-a18d-17d3af1a15c6`::ref 0 aborting False >Thread-5027::DEBUG::2014-09-09 12:15:58,178::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5027::DEBUG::2014-09-09 12:15:58,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:58,206::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:58,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5028::DEBUG::2014-09-09 12:15:58,207::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5028::DEBUG::2014-09-09 12:15:58,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`edeb14ae-d0e8-4d07-9c7d-0fdc2ab35907`::moving from state init -> state preparing >Thread-5028::INFO::2014-09-09 12:15:58,208::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5028::DEBUG::2014-09-09 12:15:58,208::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c49c0685-15ae-49ce-b450-817226704241`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5028::DEBUG::2014-09-09 12:15:58,208::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5028::DEBUG::2014-09-09 12:15:58,208::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5028::DEBUG::2014-09-09 12:15:58,208::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c49c0685-15ae-49ce-b450-817226704241`::Granted request >Thread-5028::DEBUG::2014-09-09 12:15:58,209::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`edeb14ae-d0e8-4d07-9c7d-0fdc2ab35907`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5028::DEBUG::2014-09-09 12:15:58,209::task::993::Storage.TaskManager.Task::(_decref) Task=`edeb14ae-d0e8-4d07-9c7d-0fdc2ab35907`::ref 1 aborting False >Thread-5028::INFO::2014-09-09 12:15:58,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5028::DEBUG::2014-09-09 12:15:58,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`edeb14ae-d0e8-4d07-9c7d-0fdc2ab35907`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5028::DEBUG::2014-09-09 12:15:58,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`edeb14ae-d0e8-4d07-9c7d-0fdc2ab35907`::moving from state preparing -> state finished >Thread-5028::DEBUG::2014-09-09 12:15:58,210::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5028::DEBUG::2014-09-09 12:15:58,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5028::DEBUG::2014-09-09 12:15:58,211::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5028::DEBUG::2014-09-09 12:15:58,211::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5028::DEBUG::2014-09-09 12:15:58,211::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5028::DEBUG::2014-09-09 12:15:58,211::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5028::DEBUG::2014-09-09 12:15:58,211::task::993::Storage.TaskManager.Task::(_decref) Task=`edeb14ae-d0e8-4d07-9c7d-0fdc2ab35907`::ref 0 aborting False >Thread-5028::DEBUG::2014-09-09 12:15:58,211::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5028::DEBUG::2014-09-09 12:15:58,211::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:15:58,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:15:58,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5029::DEBUG::2014-09-09 12:15:58,503::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:15:59,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:15:59,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896755 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:00,353::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:00,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) (10566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) (10566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) (10566) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:00,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:16:00,355::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:16:00,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00109113 s, 502 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) (10567) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:00,364::__init__::225::IOProcess::(_processLogs) (10567) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:00,365::__init__::225::IOProcess::(_processLogs) (10567) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:00,365::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:16:00,366::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:16:00,366::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:00,366::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:00,366::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) (10568) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) (10568) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) (10568) Building response >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) (10568) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:16:00,367::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) (10569) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) (10569) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) (10569) Building response >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) (10569) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:00,368::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:00,369::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:16:00,369::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:00,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:00,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:00,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:00,369::__init__::225::IOProcess::(_processLogs) (10570) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:00,370::__init__::225::IOProcess::(_processLogs) (10570) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:00,370::__init__::225::IOProcess::(_processLogs) (10570) Building response >Thread-19::DEBUG::2014-09-09 12:16:00,370::__init__::225::IOProcess::(_processLogs) (10570) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:00,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:00,370::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:01,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:01,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5030::DEBUG::2014-09-09 12:16:01,514::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:01,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:01,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896366 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:02,444::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) (10571) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) (10571) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) (10571) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:02,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:16:02,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:16:02,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00124352 s, 903 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:02,454::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:02,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:02,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:02,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:02,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:02,454::__init__::225::IOProcess::(_processLogs) (10572) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:02,455::__init__::225::IOProcess::(_processLogs) (10572) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:02,455::__init__::225::IOProcess::(_processLogs) (10572) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:02,455::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:16:03,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:03,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895764 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:04,524::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:04,525::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5031::DEBUG::2014-09-09 12:16:04,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:05,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:05,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895183 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) (10573) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:06,808::__init__::225::IOProcess::(_processLogs) (10573) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:06,809::__init__::225::IOProcess::(_processLogs) (10573) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:06,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:16:06,809::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:16:06,817::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000987359 s, 360 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:06,817::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) (10574) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) (10574) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:06,818::__init__::225::IOProcess::(_processLogs) (10574) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:06,819::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:07,536::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:07,537::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5032::DEBUG::2014-09-09 12:16:07,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`b13157ca-2a6c-4dca-9d6c-e778af271c95`::moving from state init -> state preparing >Thread-5032::INFO::2014-09-09 12:16:07,539::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5032::INFO::2014-09-09 12:16:07,539::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00124352', 'lastCheck': '5.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109113', 'lastCheck': '7.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987359', 'lastCheck': '0.7', 'valid': True}} >Thread-5032::DEBUG::2014-09-09 12:16:07,539::task::1191::Storage.TaskManager.Task::(prepare) Task=`b13157ca-2a6c-4dca-9d6c-e778af271c95`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00124352', 'lastCheck': '5.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109113', 'lastCheck': '7.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000987359', 'lastCheck': '0.7', 'valid': True}} >Thread-5032::DEBUG::2014-09-09 12:16:07,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`b13157ca-2a6c-4dca-9d6c-e778af271c95`::moving from state preparing -> state finished >Thread-5032::DEBUG::2014-09-09 12:16:07,539::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5032::DEBUG::2014-09-09 12:16:07,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5032::DEBUG::2014-09-09 12:16:07,539::task::993::Storage.TaskManager.Task::(_decref) Task=`b13157ca-2a6c-4dca-9d6c-e778af271c95`::ref 0 aborting False >Thread-5032::DEBUG::2014-09-09 12:16:07,540::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:07,552::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:07,553::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5033::DEBUG::2014-09-09 12:16:07,553::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:07,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:07,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895731 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:08,274::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:08,275::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5034::DEBUG::2014-09-09 12:16:08,275::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5034::DEBUG::2014-09-09 12:16:08,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`459c7d08-73e1-45ae-ae29-d8e5f497bd18`::moving from state init -> state preparing >Thread-5034::INFO::2014-09-09 12:16:08,276::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5034::INFO::2014-09-09 12:16:08,276::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5034::DEBUG::2014-09-09 12:16:08,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`459c7d08-73e1-45ae-ae29-d8e5f497bd18`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5034::DEBUG::2014-09-09 12:16:08,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`459c7d08-73e1-45ae-ae29-d8e5f497bd18`::moving from state preparing -> state finished >Thread-5034::DEBUG::2014-09-09 12:16:08,276::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5034::DEBUG::2014-09-09 12:16:08,276::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5034::DEBUG::2014-09-09 12:16:08,277::task::993::Storage.TaskManager.Task::(_decref) Task=`459c7d08-73e1-45ae-ae29-d8e5f497bd18`::ref 0 aborting False >Thread-5034::DEBUG::2014-09-09 12:16:08,277::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5034::DEBUG::2014-09-09 12:16:08,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:08,290::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:08,291::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5035::DEBUG::2014-09-09 12:16:08,291::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5035::DEBUG::2014-09-09 12:16:08,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`b022f907-cc86-4157-a198-a50b38688f62`::moving from state init -> state preparing >Thread-5035::INFO::2014-09-09 12:16:08,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5035::DEBUG::2014-09-09 12:16:08,292::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`63fd081d-1cc9-4af4-b6d1-07d7a319a6f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5035::DEBUG::2014-09-09 12:16:08,292::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5035::DEBUG::2014-09-09 12:16:08,292::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5035::DEBUG::2014-09-09 12:16:08,292::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`63fd081d-1cc9-4af4-b6d1-07d7a319a6f5`::Granted request >Thread-5035::DEBUG::2014-09-09 12:16:08,293::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b022f907-cc86-4157-a198-a50b38688f62`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5035::DEBUG::2014-09-09 12:16:08,293::task::993::Storage.TaskManager.Task::(_decref) Task=`b022f907-cc86-4157-a198-a50b38688f62`::ref 1 aborting False >Thread-5035::INFO::2014-09-09 12:16:08,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5035::DEBUG::2014-09-09 12:16:08,294::task::1191::Storage.TaskManager.Task::(prepare) Task=`b022f907-cc86-4157-a198-a50b38688f62`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5035::DEBUG::2014-09-09 12:16:08,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`b022f907-cc86-4157-a198-a50b38688f62`::moving from state preparing -> state finished >Thread-5035::DEBUG::2014-09-09 12:16:08,295::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5035::DEBUG::2014-09-09 12:16:08,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5035::DEBUG::2014-09-09 12:16:08,295::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5035::DEBUG::2014-09-09 12:16:08,295::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5035::DEBUG::2014-09-09 12:16:08,295::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5035::DEBUG::2014-09-09 12:16:08,295::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5035::DEBUG::2014-09-09 12:16:08,295::task::993::Storage.TaskManager.Task::(_decref) Task=`b022f907-cc86-4157-a198-a50b38688f62`::ref 0 aborting False >Thread-5035::DEBUG::2014-09-09 12:16:08,295::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5035::DEBUG::2014-09-09 12:16:08,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:09,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:10,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897747 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) (10575) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) (10575) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:10,370::__init__::225::IOProcess::(_processLogs) (10575) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:10,371::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:16:10,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:16:10,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0009228 s, 594 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:10,379::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) (10576) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) (10576) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) (10576) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:10,380::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:16:10,381::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:16:10,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) (10577) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) (10577) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) (10577) Building response >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) (10577) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:10,382::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) (10578) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) (10578) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) (10578) Building response >Thread-19::DEBUG::2014-09-09 12:16:10,383::__init__::225::IOProcess::(_processLogs) (10578) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) (10579) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:10,384::__init__::225::IOProcess::(_processLogs) (10579) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:10,385::__init__::225::IOProcess::(_processLogs) (10579) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:10,385::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:10,385::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:10,657::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:10,658::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5036::DEBUG::2014-09-09 12:16:10,659::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:12,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:12,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896736 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:12,456::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:12,456::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:12,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:12,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:12,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:12,457::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:12,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:12,457::__init__::225::IOProcess::(_processLogs) (10580) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:12,457::__init__::225::IOProcess::(_processLogs) (10580) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:12,458::__init__::225::IOProcess::(_processLogs) DEBUG|(10580) Building response >Thread-19::DEBUG::2014-09-09 12:16:12,458::__init__::225::IOProcess::(_processLogs) (10580) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:12,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:12,458::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:16:12,459::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:16:12,466::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114318 s, 982 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) (10581) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:12,467::__init__::225::IOProcess::(_processLogs) (10581) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:12,468::__init__::225::IOProcess::(_processLogs) DEBUG|(10581) Building response >Thread-19::DEBUG::2014-09-09 12:16:12,468::__init__::225::IOProcess::(_processLogs) (10581) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:12,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:12,468::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:13,670::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:13,671::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5037::DEBUG::2014-09-09 12:16:13,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:14,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:14,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896123 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:16:16,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:16,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896299 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:16,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:16,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5038::DEBUG::2014-09-09 12:16:16,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:16:16,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:16,819::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) (10582) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) (10582) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) DEBUG|(10582) Building response >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) (10582) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:16,820::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:16:16,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:16:16,821::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:16:16,829::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000915773 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) (10583) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) (10583) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) DEBUG|(10583) Building response >Thread-19::DEBUG::2014-09-09 12:16:16,830::__init__::225::IOProcess::(_processLogs) (10583) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:16,831::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:16,831::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:18,335::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:18,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5039::DEBUG::2014-09-09 12:16:18,337::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5039::DEBUG::2014-09-09 12:16:18,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`cac7d151-a9eb-4133-be6c-92ef5b65e64a`::moving from state init -> state preparing >Thread-5039::INFO::2014-09-09 12:16:18,338::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5039::INFO::2014-09-09 12:16:18,338::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5039::DEBUG::2014-09-09 12:16:18,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`cac7d151-a9eb-4133-be6c-92ef5b65e64a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5039::DEBUG::2014-09-09 12:16:18,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`cac7d151-a9eb-4133-be6c-92ef5b65e64a`::moving from state preparing -> state finished >Thread-5039::DEBUG::2014-09-09 12:16:18,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5039::DEBUG::2014-09-09 12:16:18,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5039::DEBUG::2014-09-09 12:16:18,338::task::993::Storage.TaskManager.Task::(_decref) Task=`cac7d151-a9eb-4133-be6c-92ef5b65e64a`::ref 0 aborting False >Thread-5039::DEBUG::2014-09-09 12:16:18,338::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5039::DEBUG::2014-09-09 12:16:18,339::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:18,366::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:18,367::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5040::DEBUG::2014-09-09 12:16:18,367::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5040::DEBUG::2014-09-09 12:16:18,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2ddf28e-699c-420c-ba1f-5f8c3c2602d1`::moving from state init -> state preparing >Thread-5040::INFO::2014-09-09 12:16:18,368::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5040::DEBUG::2014-09-09 12:16:18,368::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f23dce34-c9b1-4a8a-a0b3-8bd251e041bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5040::DEBUG::2014-09-09 12:16:18,368::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5040::DEBUG::2014-09-09 12:16:18,368::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5040::DEBUG::2014-09-09 12:16:18,368::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f23dce34-c9b1-4a8a-a0b3-8bd251e041bb`::Granted request >Thread-5040::DEBUG::2014-09-09 12:16:18,369::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a2ddf28e-699c-420c-ba1f-5f8c3c2602d1`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5040::DEBUG::2014-09-09 12:16:18,369::task::993::Storage.TaskManager.Task::(_decref) Task=`a2ddf28e-699c-420c-ba1f-5f8c3c2602d1`::ref 1 aborting False >Thread-5040::INFO::2014-09-09 12:16:18,370::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5040::DEBUG::2014-09-09 12:16:18,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2ddf28e-699c-420c-ba1f-5f8c3c2602d1`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5040::DEBUG::2014-09-09 12:16:18,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2ddf28e-699c-420c-ba1f-5f8c3c2602d1`::moving from state preparing -> state finished >Thread-5040::DEBUG::2014-09-09 12:16:18,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5040::DEBUG::2014-09-09 12:16:18,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5040::DEBUG::2014-09-09 12:16:18,371::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5040::DEBUG::2014-09-09 12:16:18,371::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5040::DEBUG::2014-09-09 12:16:18,371::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5040::DEBUG::2014-09-09 12:16:18,371::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5040::DEBUG::2014-09-09 12:16:18,371::task::993::Storage.TaskManager.Task::(_decref) Task=`a2ddf28e-699c-420c-ba1f-5f8c3c2602d1`::ref 0 aborting False >Thread-5040::DEBUG::2014-09-09 12:16:18,371::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5040::DEBUG::2014-09-09 12:16:18,372::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:18,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:18,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897524 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:19,694::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:19,695::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5041::DEBUG::2014-09-09 12:16:19,698::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) (10584) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:20,386::__init__::225::IOProcess::(_processLogs) (10584) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:20,387::__init__::225::IOProcess::(_processLogs) DEBUG|(10584) Building response >Thread-19::DEBUG::2014-09-09 12:16:20,387::__init__::225::IOProcess::(_processLogs) (10584) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:20,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:20,387::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:16:20,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:16:20,397::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000979881 s, 559 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:20,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:20,399::__init__::225::IOProcess::(_processLogs) (10585) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:20,399::__init__::225::IOProcess::(_processLogs) (10585) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:20,399::__init__::225::IOProcess::(_processLogs) DEBUG|(10585) Building response >Thread-19::DEBUG::2014-09-09 12:16:20,399::__init__::225::IOProcess::(_processLogs) (10585) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:20,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:20,399::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:16:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:20,400::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:16:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) (10586) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) (10586) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) (10586) Building response >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) (10586) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:20,401::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) (10587) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:20,402::__init__::225::IOProcess::(_processLogs) (10587) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) (10587) Building response >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) (10587) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:16:20,403::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) (10588) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) (10588) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) (10588) Building response >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) (10588) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:20,404::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:16:20,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:20,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895122 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:22,469::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) (10589) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) (10589) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:22,470::__init__::225::IOProcess::(_processLogs) DEBUG|(10589) Building response >Thread-23::DEBUG::2014-09-09 12:16:22,471::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:16:22,471::__init__::225::IOProcess::(_processLogs) (10589) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:22,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:22,476::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:16:22,478::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112639 s, 997 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:22,478::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) (10590) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) (10590) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) DEBUG|(10590) Building response >Thread-19::DEBUG::2014-09-09 12:16:22,479::__init__::225::IOProcess::(_processLogs) (10590) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:22,480::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:22,480::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:16:22,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:22,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897283 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:22,705::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:22,706::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5042::DEBUG::2014-09-09 12:16:22,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`0479ad87-e245-4df4-b157-e2f12a451afa`::moving from state init -> state preparing >Thread-5042::INFO::2014-09-09 12:16:22,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5042::INFO::2014-09-09 12:16:22,708::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112639', 'lastCheck': '0.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000979881', 'lastCheck': '2.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000915773', 'lastCheck': '5.9', 'valid': True}} >Thread-5042::DEBUG::2014-09-09 12:16:22,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`0479ad87-e245-4df4-b157-e2f12a451afa`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112639', 'lastCheck': '0.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000979881', 'lastCheck': '2.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000915773', 'lastCheck': '5.9', 'valid': True}} >Thread-5042::DEBUG::2014-09-09 12:16:22,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`0479ad87-e245-4df4-b157-e2f12a451afa`::moving from state preparing -> state finished >Thread-5042::DEBUG::2014-09-09 12:16:22,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5042::DEBUG::2014-09-09 12:16:22,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5042::DEBUG::2014-09-09 12:16:22,708::task::993::Storage.TaskManager.Task::(_decref) Task=`0479ad87-e245-4df4-b157-e2f12a451afa`::ref 0 aborting False >Thread-5042::DEBUG::2014-09-09 12:16:22,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:22,719::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:22,720::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5043::DEBUG::2014-09-09 12:16:22,720::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:24,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:24,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894936 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:25,856::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:25,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5044::DEBUG::2014-09-09 12:16:25,858::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:26,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:16:26,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:26,832::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:26,832::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:26,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:26,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:26,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:26,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:26,833::__init__::225::IOProcess::(_processLogs) (10591) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:26,833::__init__::225::IOProcess::(_processLogs) (10591) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:26,888::__init__::225::IOProcess::(_processLogs) DEBUG|(10591) Building response >Thread-19::DEBUG::2014-09-09 12:16:26,889::__init__::225::IOProcess::(_processLogs) (10591) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:26,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:26,890::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:16:26,891::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:26,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0974447 s, 10.5 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 12:16:26,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000902156 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:26,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:26,900::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:26,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:26,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:26,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:26,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:26,903::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:26,903::__init__::225::IOProcess::(_processLogs) (10592) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:26,904::__init__::225::IOProcess::(_processLogs) (10592) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:26,904::__init__::225::IOProcess::(_processLogs) (10592) Building response >Thread-19::DEBUG::2014-09-09 12:16:26,905::__init__::225::IOProcess::(_processLogs) (10592) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:26,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:26,906::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:28,412::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:28,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5045::DEBUG::2014-09-09 12:16:28,413::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5045::DEBUG::2014-09-09 12:16:28,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`02f68912-dbf2-45ee-9ba7-da5a967381ff`::moving from state init -> state preparing >Thread-5045::INFO::2014-09-09 12:16:28,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5045::INFO::2014-09-09 12:16:28,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5045::DEBUG::2014-09-09 12:16:28,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`02f68912-dbf2-45ee-9ba7-da5a967381ff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5045::DEBUG::2014-09-09 12:16:28,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`02f68912-dbf2-45ee-9ba7-da5a967381ff`::moving from state preparing -> state finished >Thread-5045::DEBUG::2014-09-09 12:16:28,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5045::DEBUG::2014-09-09 12:16:28,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5045::DEBUG::2014-09-09 12:16:28,415::task::993::Storage.TaskManager.Task::(_decref) Task=`02f68912-dbf2-45ee-9ba7-da5a967381ff`::ref 0 aborting False >Thread-5045::DEBUG::2014-09-09 12:16:28,415::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5045::DEBUG::2014-09-09 12:16:28,415::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:28,442::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:28,443::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5046::DEBUG::2014-09-09 12:16:28,443::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5046::DEBUG::2014-09-09 12:16:28,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce887407-8c1e-426f-98ee-fb6170d11859`::moving from state init -> state preparing >Thread-5046::INFO::2014-09-09 12:16:28,443::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5046::DEBUG::2014-09-09 12:16:28,444::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca64f105-6e99-4ab4-ad97-cc2fc38dfa88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5046::DEBUG::2014-09-09 12:16:28,445::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5046::DEBUG::2014-09-09 12:16:28,445::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5046::DEBUG::2014-09-09 12:16:28,445::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca64f105-6e99-4ab4-ad97-cc2fc38dfa88`::Granted request >Thread-5046::DEBUG::2014-09-09 12:16:28,445::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce887407-8c1e-426f-98ee-fb6170d11859`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5046::DEBUG::2014-09-09 12:16:28,445::task::993::Storage.TaskManager.Task::(_decref) Task=`ce887407-8c1e-426f-98ee-fb6170d11859`::ref 1 aborting False >Thread-5046::INFO::2014-09-09 12:16:28,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5046::DEBUG::2014-09-09 12:16:28,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce887407-8c1e-426f-98ee-fb6170d11859`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5046::DEBUG::2014-09-09 12:16:28,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce887407-8c1e-426f-98ee-fb6170d11859`::moving from state preparing -> state finished >Thread-5046::DEBUG::2014-09-09 12:16:28,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5046::DEBUG::2014-09-09 12:16:28,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5046::DEBUG::2014-09-09 12:16:28,447::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5046::DEBUG::2014-09-09 12:16:28,447::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5046::DEBUG::2014-09-09 12:16:28,448::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5046::DEBUG::2014-09-09 12:16:28,448::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5046::DEBUG::2014-09-09 12:16:28,448::task::993::Storage.TaskManager.Task::(_decref) Task=`ce887407-8c1e-426f-98ee-fb6170d11859`::ref 0 aborting False >Thread-5046::DEBUG::2014-09-09 12:16:28,448::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5046::DEBUG::2014-09-09 12:16:28,448::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:28,866::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:28,867::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5047::DEBUG::2014-09-09 12:16:28,868::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:28,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:29,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895811 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:30,404::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:30,404::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:30,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) (10593) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) (10593) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) DEBUG|(10593) Building response >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) (10593) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:30,405::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:16:30,406::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:16:30,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00109831 s, 499 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:30,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:30,415::__init__::225::IOProcess::(_processLogs) (10594) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:30,415::__init__::225::IOProcess::(_processLogs) (10594) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:30,415::__init__::225::IOProcess::(_processLogs) DEBUG|(10594) Building response >Thread-19::DEBUG::2014-09-09 12:16:30,415::__init__::225::IOProcess::(_processLogs) (10594) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:30,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:30,415::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:16:30,416::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:30,416::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:16:30,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:30,416::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) (10595) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) (10595) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) (10595) Building response >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) (10595) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:30,417::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:30,418::__init__::225::IOProcess::(_processLogs) (10596) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) (10596) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) (10596) Building response >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) (10596) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:16:30,419::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) (10597) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) (10597) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) (10597) Building response >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) (10597) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:30,420::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:30,421::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:16:31,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:31,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895802 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:31,876::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:31,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5048::DEBUG::2014-09-09 12:16:31,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:16:32,481::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) (10598) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) (10598) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:32,482::__init__::225::IOProcess::(_processLogs) DEBUG|(10598) Building response >Thread-23::DEBUG::2014-09-09 12:16:32,483::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:16:32,483::__init__::225::IOProcess::(_processLogs) (10598) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:32,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:32,489::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:16:32,490::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112589 s, 997 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) (10599) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) (10599) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:32,491::__init__::225::IOProcess::(_processLogs) DEBUG|(10599) Building response >Thread-19::DEBUG::2014-09-09 12:16:32,492::__init__::225::IOProcess::(_processLogs) (10599) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:32,492::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:32,492::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:16:33,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:33,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897045 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:34,887::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:34,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5049::DEBUG::2014-09-09 12:16:34,889::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:35,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:35,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08951 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:36,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:36,905::__init__::225::IOProcess::(_processLogs) (10600) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:36,905::__init__::225::IOProcess::(_processLogs) (10600) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:36,906::__init__::225::IOProcess::(_processLogs) DEBUG|(10600) Building response >Thread-19::DEBUG::2014-09-09 12:16:36,906::__init__::225::IOProcess::(_processLogs) (10600) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:36,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:36,907::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:16:36,907::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:16:36,915::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000872937 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:36,915::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:36,915::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:36,915::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) (10601) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) (10601) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) DEBUG|(10601) Building response >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) (10601) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:36,916::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:36,917::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:16:37,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:37,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896076 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:37,898::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:37,899::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5050::DEBUG::2014-09-09 12:16:37,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`4441d870-1866-4753-9977-e19b14643c5f`::moving from state init -> state preparing >Thread-5050::INFO::2014-09-09 12:16:37,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5050::INFO::2014-09-09 12:16:37,901::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112589', 'lastCheck': '5.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109831', 'lastCheck': '7.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000872937', 'lastCheck': '1.0', 'valid': True}} >Thread-5050::DEBUG::2014-09-09 12:16:37,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`4441d870-1866-4753-9977-e19b14643c5f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112589', 'lastCheck': '5.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109831', 'lastCheck': '7.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000872937', 'lastCheck': '1.0', 'valid': True}} >Thread-5050::DEBUG::2014-09-09 12:16:37,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`4441d870-1866-4753-9977-e19b14643c5f`::moving from state preparing -> state finished >Thread-5050::DEBUG::2014-09-09 12:16:37,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5050::DEBUG::2014-09-09 12:16:37,901::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5050::DEBUG::2014-09-09 12:16:37,901::task::993::Storage.TaskManager.Task::(_decref) Task=`4441d870-1866-4753-9977-e19b14643c5f`::ref 0 aborting False >Thread-5050::DEBUG::2014-09-09 12:16:37,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:37,921::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:37,922::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5051::DEBUG::2014-09-09 12:16:37,922::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:38,511::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5052::DEBUG::2014-09-09 12:16:38,512::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:16:38,512::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5052::DEBUG::2014-09-09 12:16:38,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`67a7ca6e-5ba6-4c34-be9b-fbc417413e1b`::moving from state init -> state preparing >Thread-5052::INFO::2014-09-09 12:16:38,513::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5052::INFO::2014-09-09 12:16:38,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5052::DEBUG::2014-09-09 12:16:38,513::task::1191::Storage.TaskManager.Task::(prepare) Task=`67a7ca6e-5ba6-4c34-be9b-fbc417413e1b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5052::DEBUG::2014-09-09 12:16:38,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`67a7ca6e-5ba6-4c34-be9b-fbc417413e1b`::moving from state preparing -> state finished >Thread-5052::DEBUG::2014-09-09 12:16:38,513::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5052::DEBUG::2014-09-09 12:16:38,514::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5052::DEBUG::2014-09-09 12:16:38,514::task::993::Storage.TaskManager.Task::(_decref) Task=`67a7ca6e-5ba6-4c34-be9b-fbc417413e1b`::ref 0 aborting False >Thread-5052::DEBUG::2014-09-09 12:16:38,514::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5052::DEBUG::2014-09-09 12:16:38,514::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:38,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5053::DEBUG::2014-09-09 12:16:38,528::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:16:38,528::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5053::DEBUG::2014-09-09 12:16:38,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb035995-b752-47cf-ad57-97e58842bb13`::moving from state init -> state preparing >Thread-5053::INFO::2014-09-09 12:16:38,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5053::DEBUG::2014-09-09 12:16:38,530::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eff615f8-d1f2-4dd2-8431-acb0df206007`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5053::DEBUG::2014-09-09 12:16:38,530::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5053::DEBUG::2014-09-09 12:16:38,530::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5053::DEBUG::2014-09-09 12:16:38,530::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eff615f8-d1f2-4dd2-8431-acb0df206007`::Granted request >Thread-5053::DEBUG::2014-09-09 12:16:38,530::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fb035995-b752-47cf-ad57-97e58842bb13`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5053::DEBUG::2014-09-09 12:16:38,530::task::993::Storage.TaskManager.Task::(_decref) Task=`fb035995-b752-47cf-ad57-97e58842bb13`::ref 1 aborting False >Thread-5053::INFO::2014-09-09 12:16:38,532::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5053::DEBUG::2014-09-09 12:16:38,532::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb035995-b752-47cf-ad57-97e58842bb13`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5053::DEBUG::2014-09-09 12:16:38,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb035995-b752-47cf-ad57-97e58842bb13`::moving from state preparing -> state finished >Thread-5053::DEBUG::2014-09-09 12:16:38,532::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5053::DEBUG::2014-09-09 12:16:38,532::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5053::DEBUG::2014-09-09 12:16:38,532::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5053::DEBUG::2014-09-09 12:16:38,533::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5053::DEBUG::2014-09-09 12:16:38,533::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5053::DEBUG::2014-09-09 12:16:38,533::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5053::DEBUG::2014-09-09 12:16:38,533::task::993::Storage.TaskManager.Task::(_decref) Task=`fb035995-b752-47cf-ad57-97e58842bb13`::ref 0 aborting False >Thread-5053::DEBUG::2014-09-09 12:16:38,533::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5053::DEBUG::2014-09-09 12:16:38,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:39,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:39,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895623 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:40,420::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:40,420::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) (10602) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:40,421::__init__::225::IOProcess::(_processLogs) (10602) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:40,422::__init__::225::IOProcess::(_processLogs) DEBUG|(10602) Building response >Thread-19::DEBUG::2014-09-09 12:16:40,422::__init__::225::IOProcess::(_processLogs) (10602) Queuing response >Thread-24::DEBUG::2014-09-09 12:16:40,422::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:16:40,423::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:40,428::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:16:40,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00103825 s, 528 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:40,431::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:40,431::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:40,431::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:40,431::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:40,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:40,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:40,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:40,432::__init__::225::IOProcess::(_processLogs) (10603) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:40,432::__init__::225::IOProcess::(_processLogs) (10603) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:40,432::__init__::225::IOProcess::(_processLogs) DEBUG|(10603) Building response >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) (10603) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:40,433::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) (10604) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) (10604) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) (10604) Building response >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) (10604) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:40,434::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) (10605) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:40,435::__init__::225::IOProcess::(_processLogs) (10605) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) (10605) Building response >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) (10605) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:40,436::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) (10606) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) (10606) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) (10606) Building response >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) (10606) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:40,437::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:41,026::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:41,026::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5054::DEBUG::2014-09-09 12:16:41,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:41,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:41,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895607 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:42,493::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:42,493::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:42,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:42,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:42,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:42,494::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:42,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:42,494::__init__::225::IOProcess::(_processLogs) (10607) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:42,494::__init__::225::IOProcess::(_processLogs) (10607) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:42,495::__init__::225::IOProcess::(_processLogs) DEBUG|(10607) Building response >Thread-19::DEBUG::2014-09-09 12:16:42,495::__init__::225::IOProcess::(_processLogs) (10607) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:42,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:42,495::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:16:42,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:16:42,503::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114858 s, 978 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:42,504::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:42,504::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:42,504::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:42,504::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:42,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:42,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) (10608) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) (10608) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) DEBUG|(10608) Building response >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) (10608) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:42,505::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:16:43,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:43,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894985 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:44,038::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:44,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5055::DEBUG::2014-09-09 12:16:44,039::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:45,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:45,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896435 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:46,918::__init__::225::IOProcess::(_processLogs) (10609) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:46,919::__init__::225::IOProcess::(_processLogs) (10609) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:46,919::__init__::225::IOProcess::(_processLogs) DEBUG|(10609) Building response >Thread-19::DEBUG::2014-09-09 12:16:46,919::__init__::225::IOProcess::(_processLogs) (10609) Queuing response >Thread-3443::DEBUG::2014-09-09 12:16:46,919::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:16:46,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:46,925::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:16:46,927::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000914216 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:46,927::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:46,927::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:46,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) (10610) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) (10610) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:46,928::__init__::225::IOProcess::(_processLogs) DEBUG|(10610) Building response >Thread-19::DEBUG::2014-09-09 12:16:46,929::__init__::225::IOProcess::(_processLogs) (10610) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:46,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:46,929::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:47,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:47,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5056::DEBUG::2014-09-09 12:16:47,050::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:47,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:47,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896234 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:48,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:48,574::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5057::DEBUG::2014-09-09 12:16:48,575::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5057::DEBUG::2014-09-09 12:16:48,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9608aae-c41f-48b8-910b-95170fd55d09`::moving from state init -> state preparing >Thread-5057::INFO::2014-09-09 12:16:48,576::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5057::INFO::2014-09-09 12:16:48,576::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5057::DEBUG::2014-09-09 12:16:48,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9608aae-c41f-48b8-910b-95170fd55d09`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5057::DEBUG::2014-09-09 12:16:48,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9608aae-c41f-48b8-910b-95170fd55d09`::moving from state preparing -> state finished >Thread-5057::DEBUG::2014-09-09 12:16:48,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5057::DEBUG::2014-09-09 12:16:48,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5057::DEBUG::2014-09-09 12:16:48,576::task::993::Storage.TaskManager.Task::(_decref) Task=`d9608aae-c41f-48b8-910b-95170fd55d09`::ref 0 aborting False >Thread-5057::DEBUG::2014-09-09 12:16:48,576::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5057::DEBUG::2014-09-09 12:16:48,577::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:48,604::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:48,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5058::DEBUG::2014-09-09 12:16:48,604::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5058::DEBUG::2014-09-09 12:16:48,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee0080a1-6440-48b2-bb9f-ea9ebfa77603`::moving from state init -> state preparing >Thread-5058::INFO::2014-09-09 12:16:48,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5058::DEBUG::2014-09-09 12:16:48,605::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`beab0542-6d20-4c76-b9b6-9fe00b694ad8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5058::DEBUG::2014-09-09 12:16:48,606::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5058::DEBUG::2014-09-09 12:16:48,606::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5058::DEBUG::2014-09-09 12:16:48,606::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`beab0542-6d20-4c76-b9b6-9fe00b694ad8`::Granted request >Thread-5058::DEBUG::2014-09-09 12:16:48,606::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ee0080a1-6440-48b2-bb9f-ea9ebfa77603`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5058::DEBUG::2014-09-09 12:16:48,606::task::993::Storage.TaskManager.Task::(_decref) Task=`ee0080a1-6440-48b2-bb9f-ea9ebfa77603`::ref 1 aborting False >Thread-5058::INFO::2014-09-09 12:16:48,608::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5058::DEBUG::2014-09-09 12:16:48,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee0080a1-6440-48b2-bb9f-ea9ebfa77603`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5058::DEBUG::2014-09-09 12:16:48,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee0080a1-6440-48b2-bb9f-ea9ebfa77603`::moving from state preparing -> state finished >Thread-5058::DEBUG::2014-09-09 12:16:48,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5058::DEBUG::2014-09-09 12:16:48,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5058::DEBUG::2014-09-09 12:16:48,608::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5058::DEBUG::2014-09-09 12:16:48,608::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5058::DEBUG::2014-09-09 12:16:48,608::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5058::DEBUG::2014-09-09 12:16:48,609::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5058::DEBUG::2014-09-09 12:16:48,609::task::993::Storage.TaskManager.Task::(_decref) Task=`ee0080a1-6440-48b2-bb9f-ea9ebfa77603`::ref 0 aborting False >Thread-5058::DEBUG::2014-09-09 12:16:48,609::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5058::DEBUG::2014-09-09 12:16:48,609::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:49,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:50,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0939593 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:50,061::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:50,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5059::DEBUG::2014-09-09 12:16:50,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:16:50,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:50,437::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) (10611) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) (10611) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) DEBUG|(10611) Building response >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) (10611) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:50,438::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:50,439::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:16:50,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:16:50,447::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.0010702 s, 512 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:50,448::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:50,448::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:16:50,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:50,448::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:50,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:50,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:50,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:50,449::__init__::225::IOProcess::(_processLogs) (10612) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:50,449::__init__::225::IOProcess::(_processLogs) (10612) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:50,449::__init__::225::IOProcess::(_processLogs) DEBUG|(10612) Building response >Thread-19::DEBUG::2014-09-09 12:16:50,449::__init__::225::IOProcess::(_processLogs) (10612) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:50,449::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:50,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:50,451::__init__::225::IOProcess::(_processLogs) (10613) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:50,451::__init__::225::IOProcess::(_processLogs) (10613) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:50,451::__init__::225::IOProcess::(_processLogs) DEBUG|(10613) Building response >Thread-19::DEBUG::2014-09-09 12:16:50,451::__init__::225::IOProcess::(_processLogs) (10613) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:50,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:50,451::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) (10613) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) (10613) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) (10614) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) (10614) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:50,452::__init__::225::IOProcess::(_processLogs) (10613) Queuing responseDEBUG|(10614) Building response >Thread-19::DEBUG::2014-09-09 12:16:50,453::__init__::225::IOProcess::(_processLogs) (10614) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:50,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:50,453::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:16:50,453::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:16:50,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:50,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) (10615) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) (10615) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) (10615) Building response >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) (10615) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:16:50,454::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:16:52,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:52,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896042 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:52,506::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) (10616) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) (10616) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:52,507::__init__::225::IOProcess::(_processLogs) (10616) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:52,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:16:52,508::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:16:52,515::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00121073 s, 928 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) (10617) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) (10617) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:52,516::__init__::225::IOProcess::(_processLogs) (10617) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:52,517::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:53,079::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:53,080::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5060::DEBUG::2014-09-09 12:16:53,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`efe1fde7-e8b6-4a23-b4ad-dc032de64ea2`::moving from state init -> state preparing >Thread-5060::INFO::2014-09-09 12:16:53,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5060::INFO::2014-09-09 12:16:53,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00121073', 'lastCheck': '0.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010702', 'lastCheck': '2.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000914216', 'lastCheck': '6.2', 'valid': True}} >Thread-5060::DEBUG::2014-09-09 12:16:53,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`efe1fde7-e8b6-4a23-b4ad-dc032de64ea2`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00121073', 'lastCheck': '0.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010702', 'lastCheck': '2.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000914216', 'lastCheck': '6.2', 'valid': True}} >Thread-5060::DEBUG::2014-09-09 12:16:53,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`efe1fde7-e8b6-4a23-b4ad-dc032de64ea2`::moving from state preparing -> state finished >Thread-5060::DEBUG::2014-09-09 12:16:53,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5060::DEBUG::2014-09-09 12:16:53,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5060::DEBUG::2014-09-09 12:16:53,083::task::993::Storage.TaskManager.Task::(_decref) Task=`efe1fde7-e8b6-4a23-b4ad-dc032de64ea2`::ref 0 aborting False >Thread-5060::DEBUG::2014-09-09 12:16:53,084::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:53,094::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:53,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5061::DEBUG::2014-09-09 12:16:53,095::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:54,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:54,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895412 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:56,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:56,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5062::DEBUG::2014-09-09 12:16:56,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:16:56,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:56,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896873 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:56,929::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) (10618) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) (10618) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) (10618) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:56,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:16:56,931::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:16:56,938::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00105832 s, 335 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:16:56,938::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:16:56,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:16:56,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:16:56,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:16:56,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:16:56,939::__init__::225::IOProcess::(_processLogs) (10619) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:16:56,939::__init__::225::IOProcess::(_processLogs) (10619) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:16:56,939::__init__::225::IOProcess::(_processLogs) (10619) Queuing response >Thread-19::DEBUG::2014-09-09 12:16:56,939::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:16:58,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:16:58,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897688 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:58,649::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:58,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5063::DEBUG::2014-09-09 12:16:58,650::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5063::DEBUG::2014-09-09 12:16:58,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`38461871-20fc-4eaf-9c43-ecbf87bdc605`::moving from state init -> state preparing >Thread-5063::INFO::2014-09-09 12:16:58,651::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5063::INFO::2014-09-09 12:16:58,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5063::DEBUG::2014-09-09 12:16:58,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`38461871-20fc-4eaf-9c43-ecbf87bdc605`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5063::DEBUG::2014-09-09 12:16:58,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`38461871-20fc-4eaf-9c43-ecbf87bdc605`::moving from state preparing -> state finished >Thread-5063::DEBUG::2014-09-09 12:16:58,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5063::DEBUG::2014-09-09 12:16:58,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5063::DEBUG::2014-09-09 12:16:58,652::task::993::Storage.TaskManager.Task::(_decref) Task=`38461871-20fc-4eaf-9c43-ecbf87bdc605`::ref 0 aborting False >Thread-5063::DEBUG::2014-09-09 12:16:58,652::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5063::DEBUG::2014-09-09 12:16:58,652::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:58,706::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:58,707::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5064::DEBUG::2014-09-09 12:16:58,707::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5064::DEBUG::2014-09-09 12:16:58,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`f558e384-d802-4433-bf11-d2bead97f70f`::moving from state init -> state preparing >Thread-5064::INFO::2014-09-09 12:16:58,708::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5064::DEBUG::2014-09-09 12:16:58,708::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`43191b6a-20c7-490b-9d20-8b5ba4ac0a5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5064::DEBUG::2014-09-09 12:16:58,708::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5064::DEBUG::2014-09-09 12:16:58,708::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5064::DEBUG::2014-09-09 12:16:58,708::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`43191b6a-20c7-490b-9d20-8b5ba4ac0a5f`::Granted request >Thread-5064::DEBUG::2014-09-09 12:16:58,709::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f558e384-d802-4433-bf11-d2bead97f70f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5064::DEBUG::2014-09-09 12:16:58,709::task::993::Storage.TaskManager.Task::(_decref) Task=`f558e384-d802-4433-bf11-d2bead97f70f`::ref 1 aborting False >Thread-5064::INFO::2014-09-09 12:16:58,710::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5064::DEBUG::2014-09-09 12:16:58,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`f558e384-d802-4433-bf11-d2bead97f70f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5064::DEBUG::2014-09-09 12:16:58,711::task::595::Storage.TaskManager.Task::(_updateState) Task=`f558e384-d802-4433-bf11-d2bead97f70f`::moving from state preparing -> state finished >Thread-5064::DEBUG::2014-09-09 12:16:58,711::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5064::DEBUG::2014-09-09 12:16:58,711::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5064::DEBUG::2014-09-09 12:16:58,711::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5064::DEBUG::2014-09-09 12:16:58,711::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5064::DEBUG::2014-09-09 12:16:58,711::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5064::DEBUG::2014-09-09 12:16:58,711::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5064::DEBUG::2014-09-09 12:16:58,711::task::993::Storage.TaskManager.Task::(_decref) Task=`f558e384-d802-4433-bf11-d2bead97f70f`::ref 0 aborting False >Thread-5064::DEBUG::2014-09-09 12:16:58,711::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5064::DEBUG::2014-09-09 12:16:58,712::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:16:59,197::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:16:59,198::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5065::DEBUG::2014-09-09 12:16:59,199::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) (10620) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:00,455::__init__::225::IOProcess::(_processLogs) (10620) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:00,456::__init__::225::IOProcess::(_processLogs) (10620) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:00,456::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:17:00,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:17:00,465::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000988346 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) (10621) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) (10621) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:00,466::__init__::225::IOProcess::(_processLogs) (10621) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:00,467::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:17:00,467::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) (10622) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) (10622) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) (10622) Building response >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) (10622) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:00,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:00,469::__init__::225::IOProcess::(_processLogs) (10623) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) (10623) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) (10623) Building response >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) (10623) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:17:00,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) (10624) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) (10624) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) (10624) Building response >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) (10624) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:00,471::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:17:00,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:00,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089894 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:02,207::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:02,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5066::DEBUG::2014-09-09 12:17:02,208::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:02,517::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) (10625) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) (10625) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:02,518::__init__::225::IOProcess::(_processLogs) (10625) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:02,519::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:17:02,519::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:17:02,527::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00118208 s, 950 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:02,527::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:02,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:02,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:02,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:02,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:02,528::__init__::225::IOProcess::(_processLogs) (10626) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:02,528::__init__::225::IOProcess::(_processLogs) (10626) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:02,528::__init__::225::IOProcess::(_processLogs) (10626) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:02,528::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:17:02,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:02,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894424 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:17:04,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:04,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895152 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:05,216::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:05,217::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5067::DEBUG::2014-09-09 12:17:05,218::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:06,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:17:06,940::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:06,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:06,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:06,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:06,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:06,941::__init__::225::IOProcess::(_processLogs) (10627) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:06,941::__init__::225::IOProcess::(_processLogs) (10627) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:06,960::__init__::225::IOProcess::(_processLogs) (10627) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:06,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:06,961::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:17:06,962::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:06,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0969189 s, 10.6 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 12:17:06,970::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000885463 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:06,971::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:06,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:06,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:06,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:06,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:06,974::__init__::225::IOProcess::(_processLogs) (10628) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:06,975::__init__::225::IOProcess::(_processLogs) (10628) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:06,975::__init__::225::IOProcess::(_processLogs) (10628) Building response >Thread-19::DEBUG::2014-09-09 12:17:06,976::__init__::225::IOProcess::(_processLogs) (10628) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:06,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:06,977::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:08,225::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:08,226::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5068::DEBUG::2014-09-09 12:17:08,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff25ec9f-7291-47a1-a1bd-87208876ce29`::moving from state init -> state preparing >Thread-5068::INFO::2014-09-09 12:17:08,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5068::INFO::2014-09-09 12:17:08,228::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00118208', 'lastCheck': '5.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000988346', 'lastCheck': '7.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000885463', 'lastCheck': '1.3', 'valid': True}} >Thread-5068::DEBUG::2014-09-09 12:17:08,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff25ec9f-7291-47a1-a1bd-87208876ce29`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00118208', 'lastCheck': '5.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000988346', 'lastCheck': '7.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000885463', 'lastCheck': '1.3', 'valid': True}} >Thread-5068::DEBUG::2014-09-09 12:17:08,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff25ec9f-7291-47a1-a1bd-87208876ce29`::moving from state preparing -> state finished >Thread-5068::DEBUG::2014-09-09 12:17:08,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5068::DEBUG::2014-09-09 12:17:08,228::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5068::DEBUG::2014-09-09 12:17:08,228::task::993::Storage.TaskManager.Task::(_decref) Task=`ff25ec9f-7291-47a1-a1bd-87208876ce29`::ref 0 aborting False >Thread-5068::DEBUG::2014-09-09 12:17:08,229::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:08,240::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:08,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5069::DEBUG::2014-09-09 12:17:08,244::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:08,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5070::DEBUG::2014-09-09 12:17:08,759::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:17:08,759::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5070::DEBUG::2014-09-09 12:17:08,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a84814f-8c82-40c6-9b0c-9924dbbfcaca`::moving from state init -> state preparing >Thread-5070::INFO::2014-09-09 12:17:08,760::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5070::INFO::2014-09-09 12:17:08,761::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5070::DEBUG::2014-09-09 12:17:08,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a84814f-8c82-40c6-9b0c-9924dbbfcaca`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5070::DEBUG::2014-09-09 12:17:08,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a84814f-8c82-40c6-9b0c-9924dbbfcaca`::moving from state preparing -> state finished >Thread-5070::DEBUG::2014-09-09 12:17:08,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5070::DEBUG::2014-09-09 12:17:08,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5070::DEBUG::2014-09-09 12:17:08,761::task::993::Storage.TaskManager.Task::(_decref) Task=`3a84814f-8c82-40c6-9b0c-9924dbbfcaca`::ref 0 aborting False >Thread-5070::DEBUG::2014-09-09 12:17:08,761::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5070::DEBUG::2014-09-09 12:17:08,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:08,789::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:08,789::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5071::DEBUG::2014-09-09 12:17:08,789::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5071::DEBUG::2014-09-09 12:17:08,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`b390d441-f839-4640-b2f8-38dc1eba86a5`::moving from state init -> state preparing >Thread-5071::INFO::2014-09-09 12:17:08,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5071::DEBUG::2014-09-09 12:17:08,790::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a86ff762-a7e6-4a78-83ba-be48bdde051c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5071::DEBUG::2014-09-09 12:17:08,791::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5071::DEBUG::2014-09-09 12:17:08,791::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5071::DEBUG::2014-09-09 12:17:08,791::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a86ff762-a7e6-4a78-83ba-be48bdde051c`::Granted request >Thread-5071::DEBUG::2014-09-09 12:17:08,791::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b390d441-f839-4640-b2f8-38dc1eba86a5`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5071::DEBUG::2014-09-09 12:17:08,791::task::993::Storage.TaskManager.Task::(_decref) Task=`b390d441-f839-4640-b2f8-38dc1eba86a5`::ref 1 aborting False >Thread-5071::INFO::2014-09-09 12:17:08,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5071::DEBUG::2014-09-09 12:17:08,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`b390d441-f839-4640-b2f8-38dc1eba86a5`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5071::DEBUG::2014-09-09 12:17:08,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`b390d441-f839-4640-b2f8-38dc1eba86a5`::moving from state preparing -> state finished >Thread-5071::DEBUG::2014-09-09 12:17:08,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5071::DEBUG::2014-09-09 12:17:08,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5071::DEBUG::2014-09-09 12:17:08,793::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5071::DEBUG::2014-09-09 12:17:08,793::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5071::DEBUG::2014-09-09 12:17:08,793::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5071::DEBUG::2014-09-09 12:17:08,793::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5071::DEBUG::2014-09-09 12:17:08,794::task::993::Storage.TaskManager.Task::(_decref) Task=`b390d441-f839-4640-b2f8-38dc1eba86a5`::ref 0 aborting False >Thread-5071::DEBUG::2014-09-09 12:17:08,794::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5071::DEBUG::2014-09-09 12:17:08,794::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:08,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:09,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895654 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:10,471::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:10,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:10,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:10,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:10,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:10,473::__init__::225::IOProcess::(_processLogs) (10629) Finding callback 'statvfs'... >Thread-24::DEBUG::2014-09-09 12:17:10,473::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:17:10,473::__init__::225::IOProcess::(_processLogs) (10629) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:10,479::__init__::225::IOProcess::(_processLogs) (10629) Building response >Thread-19::DEBUG::2014-09-09 12:17:10,479::__init__::225::IOProcess::(_processLogs) (10629) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:10,479::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:10,479::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:17:10,481::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000965909 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:10,481::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) (10630) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) (10630) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:10,482::__init__::225::IOProcess::(_processLogs) (10630) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:10,483::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:17:10,483::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:17:10,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) (10631) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) (10631) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) (10631) Building response >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) (10631) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:10,484::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) (10632) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) (10632) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:10,485::__init__::225::IOProcess::(_processLogs) (10632) Building response >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) (10632) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) (10633) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:10,486::__init__::225::IOProcess::(_processLogs) (10633) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:10,487::__init__::225::IOProcess::(_processLogs) (10633) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:10,487::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:17:11,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:11,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895341 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:11,370::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:11,371::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5072::DEBUG::2014-09-09 12:17:11,372::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) (10634) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:12,530::__init__::225::IOProcess::(_processLogs) (10634) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:12,531::__init__::225::IOProcess::(_processLogs) (10634) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:12,532::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:17:12,532::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:17:12,540::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108294 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:12,540::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) (10635) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) (10635) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:12,541::__init__::225::IOProcess::(_processLogs) (10635) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:12,542::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:17:13,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:13,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895992 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:14,380::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:14,381::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5073::DEBUG::2014-09-09 12:17:14,382::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:15,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:15,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897148 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:16,975::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:16,975::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) (10636) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) (10636) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) (10636) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:16,976::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:17:16,977::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:17:16,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000937651 s, 379 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:16,985::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) (10637) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) (10637) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:16,986::__init__::225::IOProcess::(_processLogs) (10637) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:16,987::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:17,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:17,391::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5074::DEBUG::2014-09-09 12:17:17,392::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:17,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:17,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896678 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:18,833::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5075::DEBUG::2014-09-09 12:17:18,834::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:17:18,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5075::DEBUG::2014-09-09 12:17:18,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f0f1382-64b4-40a4-8e43-784107482a4e`::moving from state init -> state preparing >Thread-5075::INFO::2014-09-09 12:17:18,835::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5075::INFO::2014-09-09 12:17:18,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5075::DEBUG::2014-09-09 12:17:18,836::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f0f1382-64b4-40a4-8e43-784107482a4e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5075::DEBUG::2014-09-09 12:17:18,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f0f1382-64b4-40a4-8e43-784107482a4e`::moving from state preparing -> state finished >Thread-5075::DEBUG::2014-09-09 12:17:18,836::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5075::DEBUG::2014-09-09 12:17:18,836::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5075::DEBUG::2014-09-09 12:17:18,836::task::993::Storage.TaskManager.Task::(_decref) Task=`8f0f1382-64b4-40a4-8e43-784107482a4e`::ref 0 aborting False >Thread-5075::DEBUG::2014-09-09 12:17:18,836::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5075::DEBUG::2014-09-09 12:17:18,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:18,864::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:18,865::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5076::DEBUG::2014-09-09 12:17:18,865::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5076::DEBUG::2014-09-09 12:17:18,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`87116288-1e52-4c50-9d0e-2b63946ff79c`::moving from state init -> state preparing >Thread-5076::INFO::2014-09-09 12:17:18,866::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5076::DEBUG::2014-09-09 12:17:18,866::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4735b49b-20ad-44c3-8f83-83bb658ff76e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5076::DEBUG::2014-09-09 12:17:18,866::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5076::DEBUG::2014-09-09 12:17:18,867::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5076::DEBUG::2014-09-09 12:17:18,867::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4735b49b-20ad-44c3-8f83-83bb658ff76e`::Granted request >Thread-5076::DEBUG::2014-09-09 12:17:18,867::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`87116288-1e52-4c50-9d0e-2b63946ff79c`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5076::DEBUG::2014-09-09 12:17:18,867::task::993::Storage.TaskManager.Task::(_decref) Task=`87116288-1e52-4c50-9d0e-2b63946ff79c`::ref 1 aborting False >Thread-5076::INFO::2014-09-09 12:17:18,869::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5076::DEBUG::2014-09-09 12:17:18,869::task::1191::Storage.TaskManager.Task::(prepare) Task=`87116288-1e52-4c50-9d0e-2b63946ff79c`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5076::DEBUG::2014-09-09 12:17:18,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`87116288-1e52-4c50-9d0e-2b63946ff79c`::moving from state preparing -> state finished >Thread-5076::DEBUG::2014-09-09 12:17:18,869::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5076::DEBUG::2014-09-09 12:17:18,869::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5076::DEBUG::2014-09-09 12:17:18,869::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5076::DEBUG::2014-09-09 12:17:18,869::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5076::DEBUG::2014-09-09 12:17:18,869::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5076::DEBUG::2014-09-09 12:17:18,869::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5076::DEBUG::2014-09-09 12:17:18,870::task::993::Storage.TaskManager.Task::(_decref) Task=`87116288-1e52-4c50-9d0e-2b63946ff79c`::ref 0 aborting False >Thread-5076::DEBUG::2014-09-09 12:17:18,870::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5076::DEBUG::2014-09-09 12:17:18,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:19,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:19,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938747 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:20,402::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:20,403::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5077::DEBUG::2014-09-09 12:17:20,404::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) (10638) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:20,488::__init__::225::IOProcess::(_processLogs) (10638) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:20,489::__init__::225::IOProcess::(_processLogs) (10638) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:20,489::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:17:20,490::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:17:20,499::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000948896 s, 578 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) (10639) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:20,500::__init__::225::IOProcess::(_processLogs) (10639) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:20,501::__init__::225::IOProcess::(_processLogs) (10639) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:20,501::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:20,501::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:17:20,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) (10640) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) (10640) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) (10640) Building response >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) (10640) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:20,502::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) (10641) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:20,503::__init__::225::IOProcess::(_processLogs) (10641) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:20,504::__init__::225::IOProcess::(_processLogs) (10641) Building response >Thread-19::DEBUG::2014-09-09 12:17:20,504::__init__::225::IOProcess::(_processLogs) (10641) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:20,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:20,504::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:20,504::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:17:20,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) (10642) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) (10642) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) (10642) Building response >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) (10642) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:20,505::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:17:21,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:21,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896047 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:22,543::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:22,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:22,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:22,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:22,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:22,544::__init__::225::IOProcess::(_processLogs) (10643) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:22,544::__init__::225::IOProcess::(_processLogs) (10643) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:22,544::__init__::225::IOProcess::(_processLogs) (10643) Building response >Thread-19::DEBUG::2014-09-09 12:17:22,544::__init__::225::IOProcess::(_processLogs) (10643) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:22,544::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:17:22,545::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:17:22,551::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00110026 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:22,552::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:22,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:22,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:22,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:22,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:22,553::__init__::225::IOProcess::(_processLogs) (10644) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:22,553::__init__::225::IOProcess::(_processLogs) (10644) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:22,553::__init__::225::IOProcess::(_processLogs) (10644) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:22,553::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:23,411::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:23,412::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5078::DEBUG::2014-09-09 12:17:23,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`7630311f-4475-4b1f-bb1d-38ffe866edfc`::moving from state init -> state preparing >Thread-5078::INFO::2014-09-09 12:17:23,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5078::INFO::2014-09-09 12:17:23,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110026', 'lastCheck': '0.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948896', 'lastCheck': '2.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000937651', 'lastCheck': '6.4', 'valid': True}} >Thread-5078::DEBUG::2014-09-09 12:17:23,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`7630311f-4475-4b1f-bb1d-38ffe866edfc`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110026', 'lastCheck': '0.9', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000948896', 'lastCheck': '2.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000937651', 'lastCheck': '6.4', 'valid': True}} >Thread-5078::DEBUG::2014-09-09 12:17:23,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`7630311f-4475-4b1f-bb1d-38ffe866edfc`::moving from state preparing -> state finished >Thread-5078::DEBUG::2014-09-09 12:17:23,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5078::DEBUG::2014-09-09 12:17:23,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5078::DEBUG::2014-09-09 12:17:23,414::task::993::Storage.TaskManager.Task::(_decref) Task=`7630311f-4475-4b1f-bb1d-38ffe866edfc`::ref 0 aborting False >Thread-5078::DEBUG::2014-09-09 12:17:23,415::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:23,425::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:23,426::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5079::DEBUG::2014-09-09 12:17:23,426::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:23,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:23,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0943886 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:17:25,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:26,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896555 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:26,515::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:26,515::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5080::DEBUG::2014-09-09 12:17:26,516::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) (10645) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:26,988::__init__::225::IOProcess::(_processLogs) (10645) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:26,989::__init__::225::IOProcess::(_processLogs) (10645) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:26,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:17:26,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:17:26,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00100775 s, 352 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:26,996::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) (10646) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) (10646) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:26,997::__init__::225::IOProcess::(_processLogs) (10646) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:26,998::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:17:28,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:28,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896567 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:28,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:28,910::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5081::DEBUG::2014-09-09 12:17:28,910::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5081::DEBUG::2014-09-09 12:17:28,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`b358b21a-28ac-4b52-a1be-cace236dba29`::moving from state init -> state preparing >Thread-5081::INFO::2014-09-09 12:17:28,911::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5081::INFO::2014-09-09 12:17:28,911::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5081::DEBUG::2014-09-09 12:17:28,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`b358b21a-28ac-4b52-a1be-cace236dba29`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5081::DEBUG::2014-09-09 12:17:28,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`b358b21a-28ac-4b52-a1be-cace236dba29`::moving from state preparing -> state finished >Thread-5081::DEBUG::2014-09-09 12:17:28,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5081::DEBUG::2014-09-09 12:17:28,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5081::DEBUG::2014-09-09 12:17:28,912::task::993::Storage.TaskManager.Task::(_decref) Task=`b358b21a-28ac-4b52-a1be-cace236dba29`::ref 0 aborting False >Thread-5081::DEBUG::2014-09-09 12:17:28,912::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5081::DEBUG::2014-09-09 12:17:28,912::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:28,962::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5082::DEBUG::2014-09-09 12:17:28,962::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:17:28,962::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5082::DEBUG::2014-09-09 12:17:28,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`50984db1-5c8c-426e-b098-892dc58add89`::moving from state init -> state preparing >Thread-5082::INFO::2014-09-09 12:17:28,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5082::DEBUG::2014-09-09 12:17:28,964::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4af9524a-cff4-4835-aa18-5f0b8713b643`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5082::DEBUG::2014-09-09 12:17:28,964::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5082::DEBUG::2014-09-09 12:17:28,964::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5082::DEBUG::2014-09-09 12:17:28,964::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`4af9524a-cff4-4835-aa18-5f0b8713b643`::Granted request >Thread-5082::DEBUG::2014-09-09 12:17:28,964::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`50984db1-5c8c-426e-b098-892dc58add89`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5082::DEBUG::2014-09-09 12:17:28,964::task::993::Storage.TaskManager.Task::(_decref) Task=`50984db1-5c8c-426e-b098-892dc58add89`::ref 1 aborting False >Thread-5082::INFO::2014-09-09 12:17:28,966::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5082::DEBUG::2014-09-09 12:17:28,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`50984db1-5c8c-426e-b098-892dc58add89`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5082::DEBUG::2014-09-09 12:17:28,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`50984db1-5c8c-426e-b098-892dc58add89`::moving from state preparing -> state finished >Thread-5082::DEBUG::2014-09-09 12:17:28,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5082::DEBUG::2014-09-09 12:17:28,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5082::DEBUG::2014-09-09 12:17:28,966::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5082::DEBUG::2014-09-09 12:17:28,966::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5082::DEBUG::2014-09-09 12:17:28,967::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5082::DEBUG::2014-09-09 12:17:28,967::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5082::DEBUG::2014-09-09 12:17:28,967::task::993::Storage.TaskManager.Task::(_decref) Task=`50984db1-5c8c-426e-b098-892dc58add89`::ref 0 aborting False >Thread-5082::DEBUG::2014-09-09 12:17:28,967::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283538096128', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5082::DEBUG::2014-09-09 12:17:28,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:29,525::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:29,526::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5083::DEBUG::2014-09-09 12:17:29,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:30,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:30,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089588 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:30,505::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:30,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:30,505::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:30,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:30,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:30,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:30,506::__init__::225::IOProcess::(_processLogs) (10647) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:30,506::__init__::225::IOProcess::(_processLogs) (10647) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:30,506::__init__::225::IOProcess::(_processLogs) (10647) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:30,506::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:17:30,507::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:17:30,514::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000989897 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) (10648) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:30,515::__init__::225::IOProcess::(_processLogs) (10648) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:30,516::__init__::225::IOProcess::(_processLogs) (10648) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:30,516::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:30,516::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) (10649) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) (10649) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:30,517::__init__::225::IOProcess::(_processLogs) (10649) Building response >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) (10649) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:30,518::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) (10650) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) (10650) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) (10650) Building response >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) (10650) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:17:30,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) (10651) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) (10651) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) (10651) Building response >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) (10651) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:30,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:30,521::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:17:32,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:32,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896289 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:32,536::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:32,536::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5084::DEBUG::2014-09-09 12:17:32,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:32,554::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:32,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:32,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:32,554::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:32,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:32,555::__init__::225::IOProcess::(_processLogs) (10652) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:32,555::__init__::225::IOProcess::(_processLogs) (10652) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:32,555::__init__::225::IOProcess::(_processLogs) (10652) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:32,555::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:17:32,556::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:17:32,563::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106125 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:32,563::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:32,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:32,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:32,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:32,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:32,564::__init__::225::IOProcess::(_processLogs) (10653) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:32,564::__init__::225::IOProcess::(_processLogs) (10653) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:32,564::__init__::225::IOProcess::(_processLogs) (10653) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:32,564::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:17:34,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:34,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897111 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:35,547::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:35,548::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5085::DEBUG::2014-09-09 12:17:35,549::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:36,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:36,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895637 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) (10654) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:36,999::__init__::225::IOProcess::(_processLogs) (10654) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:37,001::__init__::225::IOProcess::(_processLogs) (10654) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:37,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:17:37,002::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:17:37,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000971383 s, 365 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) (10655) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:37,010::__init__::225::IOProcess::(_processLogs) (10655) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:37,011::__init__::225::IOProcess::(_processLogs) (10655) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:37,011::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:17:38,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:38,563::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:38,564::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5086::DEBUG::2014-09-09 12:17:38,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`adeeb2aa-4454-46c5-9112-4c4afd244ec3`::moving from state init -> state preparing >Thread-5086::INFO::2014-09-09 12:17:38,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5086::INFO::2014-09-09 12:17:38,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106125', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989897', 'lastCheck': '8.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971383', 'lastCheck': '1.6', 'valid': True}} >Thread-5086::DEBUG::2014-09-09 12:17:38,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`adeeb2aa-4454-46c5-9112-4c4afd244ec3`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106125', 'lastCheck': '6.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000989897', 'lastCheck': '8.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000971383', 'lastCheck': '1.6', 'valid': True}} >Thread-5086::DEBUG::2014-09-09 12:17:38,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`adeeb2aa-4454-46c5-9112-4c4afd244ec3`::moving from state preparing -> state finished >Thread-5086::DEBUG::2014-09-09 12:17:38,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5086::DEBUG::2014-09-09 12:17:38,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5086::DEBUG::2014-09-09 12:17:38,566::task::993::Storage.TaskManager.Task::(_decref) Task=`adeeb2aa-4454-46c5-9112-4c4afd244ec3`::ref 0 aborting False >Thread-5086::DEBUG::2014-09-09 12:17:38,567::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:38,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:38,585::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5087::DEBUG::2014-09-09 12:17:38,586::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:38,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895828 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:39,033::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:39,033::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5088::DEBUG::2014-09-09 12:17:39,033::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5088::DEBUG::2014-09-09 12:17:39,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`42979c9b-b530-467c-bebc-f33dc7a02b28`::moving from state init -> state preparing >Thread-5088::INFO::2014-09-09 12:17:39,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5088::INFO::2014-09-09 12:17:39,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5088::DEBUG::2014-09-09 12:17:39,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`42979c9b-b530-467c-bebc-f33dc7a02b28`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5088::DEBUG::2014-09-09 12:17:39,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`42979c9b-b530-467c-bebc-f33dc7a02b28`::moving from state preparing -> state finished >Thread-5088::DEBUG::2014-09-09 12:17:39,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5088::DEBUG::2014-09-09 12:17:39,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5088::DEBUG::2014-09-09 12:17:39,035::task::993::Storage.TaskManager.Task::(_decref) Task=`42979c9b-b530-467c-bebc-f33dc7a02b28`::ref 0 aborting False >Thread-5088::DEBUG::2014-09-09 12:17:39,035::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5088::DEBUG::2014-09-09 12:17:39,035::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:39,049::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:39,050::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5089::DEBUG::2014-09-09 12:17:39,050::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5089::DEBUG::2014-09-09 12:17:39,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8486518-cedc-4c2a-b192-4131289dce9b`::moving from state init -> state preparing >Thread-5089::INFO::2014-09-09 12:17:39,051::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5089::DEBUG::2014-09-09 12:17:39,051::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e48b576f-7270-4b04-b72a-5d1d77814a2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5089::DEBUG::2014-09-09 12:17:39,051::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5089::DEBUG::2014-09-09 12:17:39,051::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5089::DEBUG::2014-09-09 12:17:39,051::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e48b576f-7270-4b04-b72a-5d1d77814a2b`::Granted request >Thread-5089::DEBUG::2014-09-09 12:17:39,051::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c8486518-cedc-4c2a-b192-4131289dce9b`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5089::DEBUG::2014-09-09 12:17:39,051::task::993::Storage.TaskManager.Task::(_decref) Task=`c8486518-cedc-4c2a-b192-4131289dce9b`::ref 1 aborting False >Thread-5089::INFO::2014-09-09 12:17:39,053::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5089::DEBUG::2014-09-09 12:17:39,053::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8486518-cedc-4c2a-b192-4131289dce9b`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5089::DEBUG::2014-09-09 12:17:39,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8486518-cedc-4c2a-b192-4131289dce9b`::moving from state preparing -> state finished >Thread-5089::DEBUG::2014-09-09 12:17:39,053::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5089::DEBUG::2014-09-09 12:17:39,053::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5089::DEBUG::2014-09-09 12:17:39,054::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5089::DEBUG::2014-09-09 12:17:39,054::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5089::DEBUG::2014-09-09 12:17:39,054::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5089::DEBUG::2014-09-09 12:17:39,054::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5089::DEBUG::2014-09-09 12:17:39,054::task::993::Storage.TaskManager.Task::(_decref) Task=`c8486518-cedc-4c2a-b192-4131289dce9b`::ref 0 aborting False >Thread-5089::DEBUG::2014-09-09 12:17:39,054::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5089::DEBUG::2014-09-09 12:17:39,054::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:40,520::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:40,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) (10656) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) (10656) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) (10656) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:40,521::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:17:40,522::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:17:40,530::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104646 s, 524 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:40,530::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:40,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) (10657) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) (10657) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) (10657) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:40,531::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:17:40,532::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:17:40,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) (10658) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) (10658) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) (10658) Building response >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) (10658) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:40,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:40,534::__init__::225::IOProcess::(_processLogs) (10659) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) (10659) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) (10659) Building response >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) (10659) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:40,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) (10660) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) (10660) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) (10660) Building response >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) (10660) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:40,536::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:17:40,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:40,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897073 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:41,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:41,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5090::DEBUG::2014-09-09 12:17:41,700::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:42,565::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:42,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:42,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:42,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:42,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:42,566::__init__::225::IOProcess::(_processLogs) (10661) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:42,566::__init__::225::IOProcess::(_processLogs) (10661) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:42,567::__init__::225::IOProcess::(_processLogs) (10661) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:42,567::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:17:42,568::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:17:42,575::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109569 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:42,576::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:42,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:42,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:42,576::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:42,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:42,577::__init__::225::IOProcess::(_processLogs) (10662) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:42,577::__init__::225::IOProcess::(_processLogs) (10662) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:42,577::__init__::225::IOProcess::(_processLogs) (10662) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:42,577::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:17:42,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:42,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894608 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:44,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:44,708::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5091::DEBUG::2014-09-09 12:17:44,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:44,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:44,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897003 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:17:46,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:17:47,012::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:47,012::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:47,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:47,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:47,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:47,013::__init__::225::IOProcess::(_processLogs) (10663) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:47,013::__init__::225::IOProcess::(_processLogs) (10663) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:47,058::__init__::225::IOProcess::(_processLogs) (10663) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:47,059::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:47,059::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:17:47,061::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0973972 s, 10.5 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 12:17:47,068::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000892064 s, 398 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:47,069::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:47,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:47,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:47,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:47,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:47,072::__init__::225::IOProcess::(_processLogs) (10664) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:47,073::__init__::225::IOProcess::(_processLogs) (10664) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:47,073::__init__::225::IOProcess::(_processLogs) (10664) Building response >Thread-19::DEBUG::2014-09-09 12:17:47,073::__init__::225::IOProcess::(_processLogs) (10664) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:47,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:47,074::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:47,717::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:47,718::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5092::DEBUG::2014-09-09 12:17:47,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:49,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:49,102::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5093::DEBUG::2014-09-09 12:17:49,103::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:17:49,103::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5093::DEBUG::2014-09-09 12:17:49,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`35e91d75-941b-49ff-9b3c-3df0cdecd34c`::moving from state init -> state preparing >Thread-5093::INFO::2014-09-09 12:17:49,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5093::INFO::2014-09-09 12:17:49,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5093::DEBUG::2014-09-09 12:17:49,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`35e91d75-941b-49ff-9b3c-3df0cdecd34c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5093::DEBUG::2014-09-09 12:17:49,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`35e91d75-941b-49ff-9b3c-3df0cdecd34c`::moving from state preparing -> state finished >Thread-5093::DEBUG::2014-09-09 12:17:49,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5093::DEBUG::2014-09-09 12:17:49,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5093::DEBUG::2014-09-09 12:17:49,105::task::993::Storage.TaskManager.Task::(_decref) Task=`35e91d75-941b-49ff-9b3c-3df0cdecd34c`::ref 0 aborting False >Thread-5093::DEBUG::2014-09-09 12:17:49,105::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5093::DEBUG::2014-09-09 12:17:49,105::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:49,178::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:49,179::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5094::DEBUG::2014-09-09 12:17:49,179::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5094::DEBUG::2014-09-09 12:17:49,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`5197432b-ef64-4fec-b663-97336ab25fde`::moving from state init -> state preparing >Thread-5094::INFO::2014-09-09 12:17:49,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5094::DEBUG::2014-09-09 12:17:49,185::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e2ea26d7-196c-4b59-a409-0ba5c66a4fed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5094::DEBUG::2014-09-09 12:17:49,186::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5094::DEBUG::2014-09-09 12:17:49,187::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5094::DEBUG::2014-09-09 12:17:49,188::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e2ea26d7-196c-4b59-a409-0ba5c66a4fed`::Granted request >Thread-5094::DEBUG::2014-09-09 12:17:49,189::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5197432b-ef64-4fec-b663-97336ab25fde`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5094::DEBUG::2014-09-09 12:17:49,190::task::993::Storage.TaskManager.Task::(_decref) Task=`5197432b-ef64-4fec-b663-97336ab25fde`::ref 1 aborting False >Dummy-97::DEBUG::2014-09-09 12:17:49,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.101541 s, 10.1 MB/s\n'; <rc> = 0 >Thread-5094::INFO::2014-09-09 12:17:49,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5094::DEBUG::2014-09-09 12:17:49,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`5197432b-ef64-4fec-b663-97336ab25fde`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5094::DEBUG::2014-09-09 12:17:49,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`5197432b-ef64-4fec-b663-97336ab25fde`::moving from state preparing -> state finished >Thread-5094::DEBUG::2014-09-09 12:17:49,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5094::DEBUG::2014-09-09 12:17:49,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5094::DEBUG::2014-09-09 12:17:49,205::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5094::DEBUG::2014-09-09 12:17:49,206::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5094::DEBUG::2014-09-09 12:17:49,206::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5094::DEBUG::2014-09-09 12:17:49,206::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5094::DEBUG::2014-09-09 12:17:49,207::task::993::Storage.TaskManager.Task::(_decref) Task=`5197432b-ef64-4fec-b663-97336ab25fde`::ref 0 aborting False >Thread-5094::DEBUG::2014-09-09 12:17:49,208::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5094::DEBUG::2014-09-09 12:17:49,208::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:50,536::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:50,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:50,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:50,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:50,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:50,537::__init__::225::IOProcess::(_processLogs) (10665) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:50,537::__init__::225::IOProcess::(_processLogs) (10665) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:50,538::__init__::225::IOProcess::(_processLogs) (10665) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:50,538::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:17:50,539::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:17:50,546::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000962111 s, 570 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) (10666) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:50,547::__init__::225::IOProcess::(_processLogs) (10666) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:50,548::__init__::225::IOProcess::(_processLogs) (10666) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:50,548::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:50,548::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) (10667) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) (10667) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:50,549::__init__::225::IOProcess::(_processLogs) (10667) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) (10668) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:50,550::__init__::225::IOProcess::(_processLogs) (10668) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:50,551::__init__::225::IOProcess::(_processLogs) (10668) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:50,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:50,551::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:17:50,552::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:50,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:50,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:50,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:50,552::__init__::225::IOProcess::(_processLogs) (10669) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:17:50,552::__init__::225::IOProcess::(_processLogs) (10669) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:17:50,553::__init__::225::IOProcess::(_processLogs) (10669) Building response >Thread-19::DEBUG::2014-09-09 12:17:50,553::__init__::225::IOProcess::(_processLogs) (10669) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:50,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:17:50,553::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:50,727::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:50,727::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5095::DEBUG::2014-09-09 12:17:50,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:51,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:51,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895268 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) (10670) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:52,578::__init__::225::IOProcess::(_processLogs) (10670) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:52,579::__init__::225::IOProcess::(_processLogs) (10670) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:52,579::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:17:52,580::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:17:52,586::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00103274 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:52,587::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:17:52,587::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:52,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:52,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:52,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:52,587::__init__::225::IOProcess::(_processLogs) (10671) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:52,588::__init__::225::IOProcess::(_processLogs) (10671) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:52,588::__init__::225::IOProcess::(_processLogs) (10671) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:52,588::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:17:53,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:53,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895313 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:53,733::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:53,734::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5096::DEBUG::2014-09-09 12:17:53,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeda5486-f294-4d77-8502-5201b5f0e59f`::moving from state init -> state preparing >Thread-5096::INFO::2014-09-09 12:17:53,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5096::INFO::2014-09-09 12:17:53,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103274', 'lastCheck': '1.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000962111', 'lastCheck': '3.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000892064', 'lastCheck': '6.7', 'valid': True}} >Thread-5096::DEBUG::2014-09-09 12:17:53,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`eeda5486-f294-4d77-8502-5201b5f0e59f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103274', 'lastCheck': '1.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000962111', 'lastCheck': '3.2', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000892064', 'lastCheck': '6.7', 'valid': True}} >Thread-5096::DEBUG::2014-09-09 12:17:53,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeda5486-f294-4d77-8502-5201b5f0e59f`::moving from state preparing -> state finished >Thread-5096::DEBUG::2014-09-09 12:17:53,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5096::DEBUG::2014-09-09 12:17:53,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5096::DEBUG::2014-09-09 12:17:53,736::task::993::Storage.TaskManager.Task::(_decref) Task=`eeda5486-f294-4d77-8502-5201b5f0e59f`::ref 0 aborting False >Thread-5096::DEBUG::2014-09-09 12:17:53,736::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:53,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:53,744::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5097::DEBUG::2014-09-09 12:17:53,745::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:55,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:55,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895953 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:56,849::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:56,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5098::DEBUG::2014-09-09 12:17:56,851::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:17:57,073::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:57,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:17:57,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:57,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:57,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:57,074::__init__::225::IOProcess::(_processLogs) (10672) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:57,074::__init__::225::IOProcess::(_processLogs) (10672) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:57,074::__init__::225::IOProcess::(_processLogs) (10672) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:57,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:17:57,074::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:17:57,081::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00096963 s, 366 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) (10673) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:17:57,082::__init__::225::IOProcess::(_processLogs) (10673) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:17:57,083::__init__::225::IOProcess::(_processLogs) (10673) Queuing response >Thread-19::DEBUG::2014-09-09 12:17:57,083::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:17:57,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:57,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896538 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:59,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5099::DEBUG::2014-09-09 12:17:59,244::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:17:59,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5099::DEBUG::2014-09-09 12:17:59,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1668611-c154-4b4b-8d7f-2e796d9aee4d`::moving from state init -> state preparing >Thread-5099::INFO::2014-09-09 12:17:59,245::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5099::INFO::2014-09-09 12:17:59,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5099::DEBUG::2014-09-09 12:17:59,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1668611-c154-4b4b-8d7f-2e796d9aee4d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5099::DEBUG::2014-09-09 12:17:59,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1668611-c154-4b4b-8d7f-2e796d9aee4d`::moving from state preparing -> state finished >Thread-5099::DEBUG::2014-09-09 12:17:59,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5099::DEBUG::2014-09-09 12:17:59,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5099::DEBUG::2014-09-09 12:17:59,245::task::993::Storage.TaskManager.Task::(_decref) Task=`a1668611-c154-4b4b-8d7f-2e796d9aee4d`::ref 0 aborting False >Thread-5099::DEBUG::2014-09-09 12:17:59,246::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5099::DEBUG::2014-09-09 12:17:59,246::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:59,276::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:59,277::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5100::DEBUG::2014-09-09 12:17:59,277::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5100::DEBUG::2014-09-09 12:17:59,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff364965-c9e6-40b4-951c-44bc845b055f`::moving from state init -> state preparing >Thread-5100::INFO::2014-09-09 12:17:59,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5100::DEBUG::2014-09-09 12:17:59,278::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fc8e8e4e-4bb5-46ca-ae54-f4f50bfa6d25`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5100::DEBUG::2014-09-09 12:17:59,278::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5100::DEBUG::2014-09-09 12:17:59,278::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5100::DEBUG::2014-09-09 12:17:59,278::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`fc8e8e4e-4bb5-46ca-ae54-f4f50bfa6d25`::Granted request >Thread-5100::DEBUG::2014-09-09 12:17:59,278::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff364965-c9e6-40b4-951c-44bc845b055f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5100::DEBUG::2014-09-09 12:17:59,278::task::993::Storage.TaskManager.Task::(_decref) Task=`ff364965-c9e6-40b4-951c-44bc845b055f`::ref 1 aborting False >Thread-5100::INFO::2014-09-09 12:17:59,280::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5100::DEBUG::2014-09-09 12:17:59,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff364965-c9e6-40b4-951c-44bc845b055f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5100::DEBUG::2014-09-09 12:17:59,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff364965-c9e6-40b4-951c-44bc845b055f`::moving from state preparing -> state finished >Thread-5100::DEBUG::2014-09-09 12:17:59,280::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5100::DEBUG::2014-09-09 12:17:59,280::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5100::DEBUG::2014-09-09 12:17:59,280::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5100::DEBUG::2014-09-09 12:17:59,281::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5100::DEBUG::2014-09-09 12:17:59,281::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5100::DEBUG::2014-09-09 12:17:59,281::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5100::DEBUG::2014-09-09 12:17:59,281::task::993::Storage.TaskManager.Task::(_decref) Task=`ff364965-c9e6-40b4-951c-44bc845b055f`::ref 0 aborting False >Thread-5100::DEBUG::2014-09-09 12:17:59,281::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5100::DEBUG::2014-09-09 12:17:59,281::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:17:59,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:17:59,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894498 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:17:59,858::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:17:59,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5101::DEBUG::2014-09-09 12:17:59,859::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) (10674) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) (10674) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:00,553::__init__::225::IOProcess::(_processLogs) (10674) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:00,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:18:00,554::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:00,554::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:18:00,563::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00100849 s, 543 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) (10675) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) (10675) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:00,564::__init__::225::IOProcess::(_processLogs) (10675) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:00,565::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:18:00,565::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:18:00,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) (10676) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) (10676) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) (10676) Building response >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) (10676) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:00,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:00,567::__init__::225::IOProcess::(_processLogs) (10677) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) (10677) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) (10677) Building response >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) (10677) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:18:00,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) (10678) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) (10678) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) (10678) Building response >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) (10678) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:00,569::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:18:01,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:01,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896344 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:02,589::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:02,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:02,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:02,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:02,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:02,589::__init__::225::IOProcess::(_processLogs) (10679) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:02,590::__init__::225::IOProcess::(_processLogs) (10679) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:02,590::__init__::225::IOProcess::(_processLogs) (10679) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:02,590::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:18:02,591::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:18:02,598::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108902 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:02,599::__init__::225::IOProcess::(_processLogs) (10680) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:02,600::__init__::225::IOProcess::(_processLogs) (10680) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:02,600::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10680) Building response >Thread-19::DEBUG::2014-09-09 12:18:02,600::__init__::225::IOProcess::(_processLogs) (10680) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:02,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:02,600::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:02,867::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:02,868::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5102::DEBUG::2014-09-09 12:18:02,869::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:03,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:03,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089528 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:05,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:05,878::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5103::DEBUG::2014-09-09 12:18:05,879::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:05,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:06,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896681 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) (10681) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:07,084::__init__::225::IOProcess::(_processLogs) (10681) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:07,085::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10681) Building response >Thread-19::DEBUG::2014-09-09 12:18:07,085::__init__::225::IOProcess::(_processLogs) (10681) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:07,085::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:07,085::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:18:07,085::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:18:07,093::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000882683 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:07,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:07,095::__init__::225::IOProcess::(_processLogs) (10682) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:07,095::__init__::225::IOProcess::(_processLogs) (10682) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:07,095::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10682) Building response >Thread-19::DEBUG::2014-09-09 12:18:07,095::__init__::225::IOProcess::(_processLogs) (10682) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:07,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:07,095::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:08,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:08,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896264 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:08,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:08,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5104::DEBUG::2014-09-09 12:18:08,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb504459-08ee-4277-8317-6ffca6a9fc69`::moving from state init -> state preparing >Thread-5104::INFO::2014-09-09 12:18:08,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5104::INFO::2014-09-09 12:18:08,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108902', 'lastCheck': '6.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100849', 'lastCheck': '8.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882683', 'lastCheck': '1.8', 'valid': True}} >Thread-5104::DEBUG::2014-09-09 12:18:08,890::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb504459-08ee-4277-8317-6ffca6a9fc69`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00108902', 'lastCheck': '6.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00100849', 'lastCheck': '8.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000882683', 'lastCheck': '1.8', 'valid': True}} >Thread-5104::DEBUG::2014-09-09 12:18:08,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb504459-08ee-4277-8317-6ffca6a9fc69`::moving from state preparing -> state finished >Thread-5104::DEBUG::2014-09-09 12:18:08,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5104::DEBUG::2014-09-09 12:18:08,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5104::DEBUG::2014-09-09 12:18:08,890::task::993::Storage.TaskManager.Task::(_decref) Task=`eb504459-08ee-4277-8317-6ffca6a9fc69`::ref 0 aborting False >Thread-5104::DEBUG::2014-09-09 12:18:08,891::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:08,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:08,901::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5105::DEBUG::2014-09-09 12:18:08,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:09,319::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5106::DEBUG::2014-09-09 12:18:09,319::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:18:09,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5106::DEBUG::2014-09-09 12:18:09,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`b95af9b8-62f7-45ec-99d7-c7fc743b76d9`::moving from state init -> state preparing >Thread-5106::INFO::2014-09-09 12:18:09,320::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5106::INFO::2014-09-09 12:18:09,321::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5106::DEBUG::2014-09-09 12:18:09,321::task::1191::Storage.TaskManager.Task::(prepare) Task=`b95af9b8-62f7-45ec-99d7-c7fc743b76d9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5106::DEBUG::2014-09-09 12:18:09,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`b95af9b8-62f7-45ec-99d7-c7fc743b76d9`::moving from state preparing -> state finished >Thread-5106::DEBUG::2014-09-09 12:18:09,321::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5106::DEBUG::2014-09-09 12:18:09,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5106::DEBUG::2014-09-09 12:18:09,321::task::993::Storage.TaskManager.Task::(_decref) Task=`b95af9b8-62f7-45ec-99d7-c7fc743b76d9`::ref 0 aborting False >Thread-5106::DEBUG::2014-09-09 12:18:09,321::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5106::DEBUG::2014-09-09 12:18:09,321::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:09,352::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:09,352::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5107::DEBUG::2014-09-09 12:18:09,352::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5107::DEBUG::2014-09-09 12:18:09,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`87d0cad6-1ef6-4aeb-a41a-44f2df98c5b9`::moving from state init -> state preparing >Thread-5107::INFO::2014-09-09 12:18:09,353::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5107::DEBUG::2014-09-09 12:18:09,353::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9cb54a74-6842-4399-8967-f0c5c609c6ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5107::DEBUG::2014-09-09 12:18:09,353::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5107::DEBUG::2014-09-09 12:18:09,354::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5107::DEBUG::2014-09-09 12:18:09,354::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9cb54a74-6842-4399-8967-f0c5c609c6ea`::Granted request >Thread-5107::DEBUG::2014-09-09 12:18:09,354::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`87d0cad6-1ef6-4aeb-a41a-44f2df98c5b9`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5107::DEBUG::2014-09-09 12:18:09,354::task::993::Storage.TaskManager.Task::(_decref) Task=`87d0cad6-1ef6-4aeb-a41a-44f2df98c5b9`::ref 1 aborting False >Thread-5107::INFO::2014-09-09 12:18:09,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5107::DEBUG::2014-09-09 12:18:09,356::task::1191::Storage.TaskManager.Task::(prepare) Task=`87d0cad6-1ef6-4aeb-a41a-44f2df98c5b9`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5107::DEBUG::2014-09-09 12:18:09,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`87d0cad6-1ef6-4aeb-a41a-44f2df98c5b9`::moving from state preparing -> state finished >Thread-5107::DEBUG::2014-09-09 12:18:09,356::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5107::DEBUG::2014-09-09 12:18:09,356::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5107::DEBUG::2014-09-09 12:18:09,356::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5107::DEBUG::2014-09-09 12:18:09,356::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5107::DEBUG::2014-09-09 12:18:09,356::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5107::DEBUG::2014-09-09 12:18:09,356::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5107::DEBUG::2014-09-09 12:18:09,356::task::993::Storage.TaskManager.Task::(_decref) Task=`87d0cad6-1ef6-4aeb-a41a-44f2df98c5b9`::ref 0 aborting False >Thread-5107::DEBUG::2014-09-09 12:18:09,357::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5107::DEBUG::2014-09-09 12:18:09,357::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:10,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:10,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897657 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:10,569::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:10,569::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:10,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:10,569::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:10,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:10,570::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:10,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:10,570::__init__::225::IOProcess::(_processLogs) (10683) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:10,570::__init__::225::IOProcess::(_processLogs) (10683) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:10,570::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10683) Building response >Thread-19::DEBUG::2014-09-09 12:18:10,571::__init__::225::IOProcess::(_processLogs) (10683) Queuing response >Thread-24::DEBUG::2014-09-09 12:18:10,571::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:10,571::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:10,576::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:18:10,579::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000949538 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:10,579::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:10,579::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:10,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) (10684) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) (10684) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10684) Building response >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) (10684) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:10,580::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:18:10,581::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:10,581::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:18:10,581::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:10,581::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) (10685) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) (10685) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) (10685) Building response >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) (10685) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:10,582::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) (10686) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) (10686) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:10,583::__init__::225::IOProcess::(_processLogs) (10686) Building response >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) (10686) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:10,584::__init__::225::IOProcess::(_processLogs) (10687) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:10,585::__init__::225::IOProcess::(_processLogs) (10687) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:10,585::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10687) Building response >Thread-19::DEBUG::2014-09-09 12:18:10,585::__init__::225::IOProcess::(_processLogs) (10687) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:10,585::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:10,585::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:12,035::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:12,036::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5108::DEBUG::2014-09-09 12:18:12,037::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:12,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:12,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896153 s, 11.4 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-09-09 12:18:12,602::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:18:12,604::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,604::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:18:12,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) (10688) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) (10688) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:12,605::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10688) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) (10688) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) (10689) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) (10689) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Message size is 128 >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) (10690) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:12,607::__init__::225::IOProcess::(_processLogs) (10690) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:12,608::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10690) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,608::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10689) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,609::__init__::225::IOProcess::(_processLogs) (10690) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,610::__init__::225::IOProcess::(_processLogs) (10689) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:12,611::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:18:12,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:12,613::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-23::DEBUG::2014-09-09 12:18:12,614::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:18:12,614::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,614::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 12:18:12,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,614::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,615::__init__::225::IOProcess::(_processLogs) (10691) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:18:12,615::__init__::225::IOProcess::(_processLogs) (10691) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:18:12,663::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10691) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,664::__init__::225::IOProcess::(_processLogs) (10691) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,664::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:18:12,664::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:18:12,664::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,665::__init__::225::IOProcess::(_processLogs) (10692) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:18:12,666::__init__::225::IOProcess::(_processLogs) (10692) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:18:12,668::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10692) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,668::__init__::225::IOProcess::(_processLogs) (10692) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,668::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:18:12,668::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 12:18:12,668::__init__::225::IOProcess::(_processLogs) Sending response sized 1555 >Thread-19::DEBUG::2014-09-09 12:18:12,669::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) (10693) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:12,670::__init__::225::IOProcess::(_processLogs) (10693) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) (10693) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) (10693) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,672::__init__::225::IOProcess::(_processLogs) (10694) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:12,672::__init__::225::IOProcess::(_processLogs) (10694) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:12,673::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10694) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,673::__init__::225::IOProcess::(_processLogs) (10694) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,673::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:18:12,673::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:18:12,673::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-23::INFO::2014-09-09 12:18:12,673::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 12:18:12,674::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:18:12,674::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,674::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:12,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,674::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) (10695) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) (10695) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10695) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) (10695) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,675::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:18:12,676::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:12,676::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:18:12,683::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108973 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) (10696) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) (10696) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:12,684::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10696) Building response >Thread-19::DEBUG::2014-09-09 12:18:12,685::__init__::225::IOProcess::(_processLogs) (10696) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:12,685::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:12,685::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:14,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:14,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896423 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:15,047::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:15,048::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5112::DEBUG::2014-09-09 12:18:15,049::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:16,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:16,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.08957 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:17,096::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:17,097::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:17,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:17,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:17,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:17,097::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:17,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:17,098::__init__::225::IOProcess::(_processLogs) (10697) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:17,098::__init__::225::IOProcess::(_processLogs) (10697) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:17,098::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10697) Building response >Thread-19::DEBUG::2014-09-09 12:18:17,098::__init__::225::IOProcess::(_processLogs) (10697) Queuing response >Thread-3443::DEBUG::2014-09-09 12:18:17,098::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:17,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:17,104::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:18:17,106::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000912496 s, 389 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:17,107::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:17,108::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10698) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:17,108::__init__::225::IOProcess::(_processLogs) (10698) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:17,108::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10698) Building response >Thread-19::DEBUG::2014-09-09 12:18:17,108::__init__::225::IOProcess::(_processLogs) (10698) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:17,108::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:17,109::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:18,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:18,060::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5113::DEBUG::2014-09-09 12:18:18,061::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:18,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:18,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896026 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:19,397::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:19,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5114::DEBUG::2014-09-09 12:18:19,399::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5114::DEBUG::2014-09-09 12:18:19,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee765a06-98dc-4f46-ab7d-159acad2d834`::moving from state init -> state preparing >Thread-5114::INFO::2014-09-09 12:18:19,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5114::INFO::2014-09-09 12:18:19,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5114::DEBUG::2014-09-09 12:18:19,403::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee765a06-98dc-4f46-ab7d-159acad2d834`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5114::DEBUG::2014-09-09 12:18:19,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee765a06-98dc-4f46-ab7d-159acad2d834`::moving from state preparing -> state finished >Thread-5114::DEBUG::2014-09-09 12:18:19,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5114::DEBUG::2014-09-09 12:18:19,404::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5114::DEBUG::2014-09-09 12:18:19,405::task::993::Storage.TaskManager.Task::(_decref) Task=`ee765a06-98dc-4f46-ab7d-159acad2d834`::ref 0 aborting False >Thread-5114::DEBUG::2014-09-09 12:18:19,405::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5114::DEBUG::2014-09-09 12:18:19,406::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:19,436::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:19,437::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5115::DEBUG::2014-09-09 12:18:19,437::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5115::DEBUG::2014-09-09 12:18:19,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1461cbb-586f-4caf-864a-4b3c6ce06c63`::moving from state init -> state preparing >Thread-5115::INFO::2014-09-09 12:18:19,440::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5115::DEBUG::2014-09-09 12:18:19,441::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`05d5aebc-5a8b-4c6e-a1d0-efd34ca8f482`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5115::DEBUG::2014-09-09 12:18:19,442::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5115::DEBUG::2014-09-09 12:18:19,442::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5115::DEBUG::2014-09-09 12:18:19,443::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`05d5aebc-5a8b-4c6e-a1d0-efd34ca8f482`::Granted request >Thread-5115::DEBUG::2014-09-09 12:18:19,444::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d1461cbb-586f-4caf-864a-4b3c6ce06c63`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5115::DEBUG::2014-09-09 12:18:19,444::task::993::Storage.TaskManager.Task::(_decref) Task=`d1461cbb-586f-4caf-864a-4b3c6ce06c63`::ref 1 aborting False >Thread-5115::INFO::2014-09-09 12:18:19,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5115::DEBUG::2014-09-09 12:18:19,453::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1461cbb-586f-4caf-864a-4b3c6ce06c63`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5115::DEBUG::2014-09-09 12:18:19,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1461cbb-586f-4caf-864a-4b3c6ce06c63`::moving from state preparing -> state finished >Thread-5115::DEBUG::2014-09-09 12:18:19,454::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5115::DEBUG::2014-09-09 12:18:19,454::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5115::DEBUG::2014-09-09 12:18:19,455::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5115::DEBUG::2014-09-09 12:18:19,455::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5115::DEBUG::2014-09-09 12:18:19,456::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5115::DEBUG::2014-09-09 12:18:19,456::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5115::DEBUG::2014-09-09 12:18:19,457::task::993::Storage.TaskManager.Task::(_decref) Task=`d1461cbb-586f-4caf-864a-4b3c6ce06c63`::ref 0 aborting False >Thread-5115::DEBUG::2014-09-09 12:18:19,458::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5115::DEBUG::2014-09-09 12:18:19,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-24::DEBUG::2014-09-09 12:18:20,586::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:18:20,587::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,588::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:18:20,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,588::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,589::__init__::225::IOProcess::(_processLogs) (10699) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:20,589::__init__::225::IOProcess::(_processLogs) (10699) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:20,589::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10699) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,589::__init__::225::IOProcess::(_processLogs) (10699) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,590::__init__::225::IOProcess::(_processLogs) (10700) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) (10700) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) (10701) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) (10701) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:20,591::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10701) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,592::__init__::225::IOProcess::(_processLogs) (10701) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,592::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:18:20,592::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10700) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,592::__init__::225::IOProcess::(_processLogs) (10700) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,593::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,593::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-24::DEBUG::2014-09-09 12:18:20,595::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:18:20,595::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,595::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 12:18:20,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,595::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,596::__init__::225::IOProcess::(_processLogs) (10702) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:18:20,596::__init__::225::IOProcess::(_processLogs) (10702) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:18:20,657::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10702) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,657::__init__::225::IOProcess::(_processLogs) (10702) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,657::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:18:20,657::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:18:20,658::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:20,658::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,658::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 12:18:20,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,659::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,659::__init__::225::IOProcess::(_processLogs) (10703) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:18:20,659::__init__::225::IOProcess::(_processLogs) (10703) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:18:20,662::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10703) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,663::__init__::225::IOProcess::(_processLogs) (10703) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,663::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:18:20,663::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=a6453cf7d4e24fcded0442c25c41a52c24fb3650'] >Thread-19::DEBUG::2014-09-09 12:18:20,663::__init__::225::IOProcess::(_processLogs) Sending response sized 787 >Thread-19::DEBUG::2014-09-09 12:18:20,664::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,664::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 12:18:20,664::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) (10704) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) (10704) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10704) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) (10704) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) (10705) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:20,666::__init__::225::IOProcess::(_processLogs) (10705) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:20,667::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(10705) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,668::__init__::225::IOProcess::(_processLogs) (10705) Queuing response >Thread-24::DEBUG::2014-09-09 12:18:20,668::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:18:20,668::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-24::INFO::2014-09-09 12:18:20,668::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-19::DEBUG::2014-09-09 12:18:20,668::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-24::INFO::2014-09-09 12:18:20,669::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:18:20,669::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,669::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:20,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,669::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) (10706) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) (10706) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) DEBUG|(10706) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) (10706) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,670::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-24::DEBUG::2014-09-09 12:18:20,671::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:20,671::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:18:20,679::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000986326 s, 556 kB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:18:20,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:20,680::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,685::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:20,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,686::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) (10707) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) (10707) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) (10707) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) (10707) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:18:20,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) (10708) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) (10708) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) (10708) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) (10708) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,688::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) (10709) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) (10709) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) (10709) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) (10709) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:18:20,690::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) (10710) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) (10710) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) (10710) Building response >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) (10710) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:20,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:20,692::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:18:20,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894992 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:21,070::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:21,071::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5119::DEBUG::2014-09-09 12:18:21,072::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:18:22,686::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:22,686::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:22,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:22,687::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:22,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:22,687::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-23::DEBUG::2014-09-09 12:18:22,687::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:22,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:22,693::__init__::225::IOProcess::(_processLogs) (10711) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:22,693::__init__::225::IOProcess::(_processLogs) (10711) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:22,693::__init__::225::IOProcess::(_processLogs) (10711) Building response >Thread-19::DEBUG::2014-09-09 12:18:22,693::__init__::225::IOProcess::(_processLogs) (10711) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:22,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:22,693::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:18:22,695::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112089 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:22,695::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:22,695::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:22,695::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) (10712) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) (10712) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) DEBUG|(10712) Building response >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) (10712) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:22,696::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:22,697::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:22,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:22,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896077 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:24,080::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:24,080::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5120::DEBUG::2014-09-09 12:18:24,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`7936b01f-8d8e-44bf-ba30-69a752ecb414`::moving from state init -> state preparing >Thread-5120::INFO::2014-09-09 12:18:24,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5120::INFO::2014-09-09 12:18:24,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112089', 'lastCheck': '1.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986326', 'lastCheck': '3.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000912496', 'lastCheck': '7.0', 'valid': True}} >Thread-5120::DEBUG::2014-09-09 12:18:24,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`7936b01f-8d8e-44bf-ba30-69a752ecb414`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112089', 'lastCheck': '1.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000986326', 'lastCheck': '3.4', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000912496', 'lastCheck': '7.0', 'valid': True}} >Thread-5120::DEBUG::2014-09-09 12:18:24,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`7936b01f-8d8e-44bf-ba30-69a752ecb414`::moving from state preparing -> state finished >Thread-5120::DEBUG::2014-09-09 12:18:24,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5120::DEBUG::2014-09-09 12:18:24,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5120::DEBUG::2014-09-09 12:18:24,082::task::993::Storage.TaskManager.Task::(_decref) Task=`7936b01f-8d8e-44bf-ba30-69a752ecb414`::ref 0 aborting False >Thread-5120::DEBUG::2014-09-09 12:18:24,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:24,093::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:24,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5121::DEBUG::2014-09-09 12:18:24,095::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:24,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:24,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896775 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:18:26,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:27,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896076 s, 11.4 MB/s\n'; <rc> = 0 >Thread-3443::DEBUG::2014-09-09 12:18:27,109::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:18:27,111::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,111::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:18:27,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,111::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,111::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,112::__init__::225::IOProcess::(_processLogs) (10713) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:27,112::__init__::225::IOProcess::(_processLogs) (10713) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:27,112::__init__::225::IOProcess::(_processLogs) DEBUG|(10713) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,113::__init__::225::IOProcess::(_processLogs) (10713) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:27,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:27,114::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:18:27,115::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,116::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:18:27,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-3443::DEBUG::2014-09-09 12:18:27,118::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:18:27,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,119::__init__::225::IOProcess::(_processLogs) (10714) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:27,119::__init__::225::IOProcess::(_processLogs) (10714) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:27,119::__init__::225::IOProcess::(_processLogs) DEBUG|(10714) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) (10714) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) (10715) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) (10715) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) (10715) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) (10715) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:18:27,121::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) Message size is 159 >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) (10716) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:18:27,122::__init__::225::IOProcess::(_processLogs) (10716) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:18:27,175::__init__::225::IOProcess::(_processLogs) DEBUG|(10716) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,175::__init__::225::IOProcess::(_processLogs) (10716) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:27,175::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:18:27,176::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:18:27,176::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:27,176::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) (10717) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:18:27,177::__init__::225::IOProcess::(_processLogs) (10717) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:18:27,179::__init__::225::IOProcess::(_processLogs) DEBUG|(10717) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,179::__init__::225::IOProcess::(_processLogs) (10717) Queuing response >Thread-3443::DEBUG::2014-09-09 12:18:27,179::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 12:18:27,179::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:27,180::__init__::225::IOProcess::(_processLogs) Sending response sized 531 >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,181::__init__::225::IOProcess::(_processLogs) (10718) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) (10718) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) (10718) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) (10718) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,183::__init__::225::IOProcess::(_processLogs) (10719) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:18:27,183::__init__::225::IOProcess::(_processLogs) (10719) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:18:27,184::__init__::225::IOProcess::(_processLogs) DEBUG|(10719) Building response >Thread-19::DEBUG::2014-09-09 12:18:27,184::__init__::225::IOProcess::(_processLogs) (10719) Queuing response >Thread-3443::DEBUG::2014-09-09 12:18:27,184::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:18:27,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::INFO::2014-09-09 12:18:27,184::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-19::DEBUG::2014-09-09 12:18:27,185::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-3443::INFO::2014-09-09 12:18:27,185::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:18:27,185::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) (10720) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) (10720) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:27,186::__init__::225::IOProcess::(_processLogs) (10720) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:27,187::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-19::DEBUG::2014-09-09 12:18:27,187::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpcServer::DEBUG::2014-09-09 12:18:27,188::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-3443::DEBUG::2014-09-09 12:18:27,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-5125::DEBUG::2014-09-09 12:18:27,196::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-3443::DEBUG::2014-09-09 12:18:27,197::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000882439 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) (10721) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) (10721) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:27,198::__init__::225::IOProcess::(_processLogs) (10721) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:27,199::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:29,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:29,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895324 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:29,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5126::DEBUG::2014-09-09 12:18:29,497::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:18:29,497::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5126::DEBUG::2014-09-09 12:18:29,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cde0a5b-a495-45a4-94d6-b40325a5a051`::moving from state init -> state preparing >Thread-5126::INFO::2014-09-09 12:18:29,498::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5126::INFO::2014-09-09 12:18:29,499::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5126::DEBUG::2014-09-09 12:18:29,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cde0a5b-a495-45a4-94d6-b40325a5a051`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5126::DEBUG::2014-09-09 12:18:29,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cde0a5b-a495-45a4-94d6-b40325a5a051`::moving from state preparing -> state finished >Thread-5126::DEBUG::2014-09-09 12:18:29,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5126::DEBUG::2014-09-09 12:18:29,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5126::DEBUG::2014-09-09 12:18:29,499::task::993::Storage.TaskManager.Task::(_decref) Task=`0cde0a5b-a495-45a4-94d6-b40325a5a051`::ref 0 aborting False >Thread-5126::DEBUG::2014-09-09 12:18:29,499::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5126::DEBUG::2014-09-09 12:18:29,499::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:29,528::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:29,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5127::DEBUG::2014-09-09 12:18:29,529::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5127::DEBUG::2014-09-09 12:18:29,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e80d48d-8a48-4bfb-8b43-d88deba9fe1f`::moving from state init -> state preparing >Thread-5127::INFO::2014-09-09 12:18:29,530::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5127::DEBUG::2014-09-09 12:18:29,530::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`913f0e13-796c-414a-bd10-2a359277d402`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5127::DEBUG::2014-09-09 12:18:29,530::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5127::DEBUG::2014-09-09 12:18:29,530::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5127::DEBUG::2014-09-09 12:18:29,530::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`913f0e13-796c-414a-bd10-2a359277d402`::Granted request >Thread-5127::DEBUG::2014-09-09 12:18:29,531::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1e80d48d-8a48-4bfb-8b43-d88deba9fe1f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5127::DEBUG::2014-09-09 12:18:29,531::task::993::Storage.TaskManager.Task::(_decref) Task=`1e80d48d-8a48-4bfb-8b43-d88deba9fe1f`::ref 1 aborting False >Thread-5127::INFO::2014-09-09 12:18:29,532::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5127::DEBUG::2014-09-09 12:18:29,532::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e80d48d-8a48-4bfb-8b43-d88deba9fe1f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5127::DEBUG::2014-09-09 12:18:29,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e80d48d-8a48-4bfb-8b43-d88deba9fe1f`::moving from state preparing -> state finished >Thread-5127::DEBUG::2014-09-09 12:18:29,532::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5127::DEBUG::2014-09-09 12:18:29,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5127::DEBUG::2014-09-09 12:18:29,533::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5127::DEBUG::2014-09-09 12:18:29,533::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5127::DEBUG::2014-09-09 12:18:29,533::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5127::DEBUG::2014-09-09 12:18:29,533::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5127::DEBUG::2014-09-09 12:18:29,533::task::993::Storage.TaskManager.Task::(_decref) Task=`1e80d48d-8a48-4bfb-8b43-d88deba9fe1f`::ref 0 aborting False >Thread-5127::DEBUG::2014-09-09 12:18:29,533::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5127::DEBUG::2014-09-09 12:18:29,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:30,201::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:30,202::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5128::DEBUG::2014-09-09 12:18:30,203::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:18:30,691::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:30,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:30,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:30,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:30,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:30,692::__init__::225::IOProcess::(_processLogs) (10722) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:30,692::__init__::225::IOProcess::(_processLogs) (10722) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:30,692::__init__::225::IOProcess::(_processLogs) (10722) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:30,692::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:18:30,692::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:18:30,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104763 s, 523 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) (10723) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:30,701::__init__::225::IOProcess::(_processLogs) (10723) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:30,702::__init__::225::IOProcess::(_processLogs) (10723) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:30,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:30,702::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:18:30,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) (10724) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) (10724) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) (10724) Building response >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) (10724) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:30,703::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:30,704::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:30,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:30,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) (10725) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) (10725) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) (10725) Building response >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) (10725) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:30,705::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) (10726) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:30,706::__init__::225::IOProcess::(_processLogs) (10726) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:30,707::__init__::225::IOProcess::(_processLogs) (10726) Building response >Thread-19::DEBUG::2014-09-09 12:18:30,707::__init__::225::IOProcess::(_processLogs) (10726) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:30,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:30,707::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:18:31,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:31,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895581 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) (10727) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:32,698::__init__::225::IOProcess::(_processLogs) (10727) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:32,699::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10727) Building response >Thread-23::DEBUG::2014-09-09 12:18:32,699::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:32,699::__init__::225::IOProcess::(_processLogs) (10727) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:32,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:32,706::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:18:32,706::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010962 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:32,707::__init__::225::IOProcess::(_processLogs) (10728) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:32,708::__init__::225::IOProcess::(_processLogs) (10728) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:32,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10728) Building response >Thread-19::DEBUG::2014-09-09 12:18:32,708::__init__::225::IOProcess::(_processLogs) (10728) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:32,708::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:32,709::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:33,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:33,214::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5129::DEBUG::2014-09-09 12:18:33,215::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:33,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:33,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895906 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:18:35,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:35,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0899316 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:36,223::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:36,224::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5130::DEBUG::2014-09-09 12:18:36,225::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) (10729) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:37,200::__init__::225::IOProcess::(_processLogs) (10729) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:37,202::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10729) Building response >Thread-19::DEBUG::2014-09-09 12:18:37,202::__init__::225::IOProcess::(_processLogs) (10729) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:37,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:37,202::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:18:37,203::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:18:37,211::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000873869 s, 406 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:37,211::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:37,211::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:37,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) (10730) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) (10730) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10730) Building response >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) (10730) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:37,212::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:37,213::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:37,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:37,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895716 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:39,233::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:39,234::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5131::DEBUG::2014-09-09 12:18:39,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`319bf94d-386f-4cbf-8e50-2973229ec92f`::moving from state init -> state preparing >Thread-5131::INFO::2014-09-09 12:18:39,236::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5131::INFO::2014-09-09 12:18:39,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010962', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104763', 'lastCheck': '8.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873869', 'lastCheck': '2.0', 'valid': True}} >Thread-5131::DEBUG::2014-09-09 12:18:39,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`319bf94d-386f-4cbf-8e50-2973229ec92f`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010962', 'lastCheck': '6.5', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104763', 'lastCheck': '8.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873869', 'lastCheck': '2.0', 'valid': True}} >Thread-5131::DEBUG::2014-09-09 12:18:39,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`319bf94d-386f-4cbf-8e50-2973229ec92f`::moving from state preparing -> state finished >Thread-5131::DEBUG::2014-09-09 12:18:39,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5131::DEBUG::2014-09-09 12:18:39,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5131::DEBUG::2014-09-09 12:18:39,236::task::993::Storage.TaskManager.Task::(_decref) Task=`319bf94d-386f-4cbf-8e50-2973229ec92f`::ref 0 aborting False >Thread-5131::DEBUG::2014-09-09 12:18:39,237::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:39,248::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:39,248::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5132::DEBUG::2014-09-09 12:18:39,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:39,596::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:39,597::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5133::DEBUG::2014-09-09 12:18:39,597::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5133::DEBUG::2014-09-09 12:18:39,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0cd22b0-318d-4902-900a-3c06cdb31a13`::moving from state init -> state preparing >Thread-5133::INFO::2014-09-09 12:18:39,598::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5133::INFO::2014-09-09 12:18:39,598::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5133::DEBUG::2014-09-09 12:18:39,598::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0cd22b0-318d-4902-900a-3c06cdb31a13`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5133::DEBUG::2014-09-09 12:18:39,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0cd22b0-318d-4902-900a-3c06cdb31a13`::moving from state preparing -> state finished >Thread-5133::DEBUG::2014-09-09 12:18:39,598::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5133::DEBUG::2014-09-09 12:18:39,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5133::DEBUG::2014-09-09 12:18:39,598::task::993::Storage.TaskManager.Task::(_decref) Task=`f0cd22b0-318d-4902-900a-3c06cdb31a13`::ref 0 aborting False >Thread-5133::DEBUG::2014-09-09 12:18:39,598::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5133::DEBUG::2014-09-09 12:18:39,598::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:39,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:39,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5134::DEBUG::2014-09-09 12:18:39,613::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5134::DEBUG::2014-09-09 12:18:39,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7758bf8-f177-418e-bc58-ed89f405b056`::moving from state init -> state preparing >Thread-5134::INFO::2014-09-09 12:18:39,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5134::DEBUG::2014-09-09 12:18:39,614::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`22bbf871-3969-4cd9-95bf-327043b0f172`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5134::DEBUG::2014-09-09 12:18:39,614::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5134::DEBUG::2014-09-09 12:18:39,614::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5134::DEBUG::2014-09-09 12:18:39,614::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`22bbf871-3969-4cd9-95bf-327043b0f172`::Granted request >Thread-5134::DEBUG::2014-09-09 12:18:39,615::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7758bf8-f177-418e-bc58-ed89f405b056`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5134::DEBUG::2014-09-09 12:18:39,615::task::993::Storage.TaskManager.Task::(_decref) Task=`d7758bf8-f177-418e-bc58-ed89f405b056`::ref 1 aborting False >Thread-5134::INFO::2014-09-09 12:18:39,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5134::DEBUG::2014-09-09 12:18:39,616::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7758bf8-f177-418e-bc58-ed89f405b056`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5134::DEBUG::2014-09-09 12:18:39,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7758bf8-f177-418e-bc58-ed89f405b056`::moving from state preparing -> state finished >Thread-5134::DEBUG::2014-09-09 12:18:39,617::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5134::DEBUG::2014-09-09 12:18:39,617::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5134::DEBUG::2014-09-09 12:18:39,617::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5134::DEBUG::2014-09-09 12:18:39,617::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5134::DEBUG::2014-09-09 12:18:39,617::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5134::DEBUG::2014-09-09 12:18:39,617::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5134::DEBUG::2014-09-09 12:18:39,617::task::993::Storage.TaskManager.Task::(_decref) Task=`d7758bf8-f177-418e-bc58-ed89f405b056`::ref 0 aborting False >Thread-5134::DEBUG::2014-09-09 12:18:39,617::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5134::DEBUG::2014-09-09 12:18:39,618::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:39,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:39,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894816 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:40,707::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:40,707::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:40,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:40,707::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:40,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:40,708::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-24::DEBUG::2014-09-09 12:18:40,708::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:40,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:40,714::__init__::225::IOProcess::(_processLogs) (10731) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:40,714::__init__::225::IOProcess::(_processLogs) (10731) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:40,714::__init__::225::IOProcess::(_processLogs) (10731) Building response >Thread-19::DEBUG::2014-09-09 12:18:40,714::__init__::225::IOProcess::(_processLogs) (10731) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:40,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:40,714::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:18:40,716::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000958821 s, 572 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:40,717::__init__::225::IOProcess::(_processLogs) (10732) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:40,718::__init__::225::IOProcess::(_processLogs) (10732) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:40,718::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10732) Building response >Thread-19::DEBUG::2014-09-09 12:18:40,718::__init__::225::IOProcess::(_processLogs) (10732) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:40,718::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:40,719::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:18:40,719::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:40,719::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:18:40,719::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:40,719::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) (10733) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) (10733) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) (10733) Building response >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) (10733) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:40,720::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) (10734) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) (10734) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) (10734) Building response >Thread-19::DEBUG::2014-09-09 12:18:40,721::__init__::225::IOProcess::(_processLogs) (10734) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:40,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:40,722::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:40,722::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:40,722::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:18:40,722::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) (10735) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) (10735) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) (10735) Building response >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) (10735) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:40,723::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:18:41,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:41,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896869 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:42,371::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:42,372::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5135::DEBUG::2014-09-09 12:18:42,373::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:18:42,709::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) (10736) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:42,710::__init__::225::IOProcess::(_processLogs) (10736) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:42,711::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10736) Building response >Thread-19::DEBUG::2014-09-09 12:18:42,711::__init__::225::IOProcess::(_processLogs) (10736) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:42,711::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-23::DEBUG::2014-09-09 12:18:42,712::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:42,712::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:18:42,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00108679 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:42,721::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:42,721::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:42,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:42,721::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:42,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:42,722::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:42,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:42,722::__init__::225::IOProcess::(_processLogs) (10737) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:42,722::__init__::225::IOProcess::(_processLogs) (10737) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:42,722::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10737) Building response >Thread-19::DEBUG::2014-09-09 12:18:42,723::__init__::225::IOProcess::(_processLogs) (10737) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:42,723::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:42,723::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:43,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:43,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895203 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:45,381::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:45,382::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5136::DEBUG::2014-09-09 12:18:45,383::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:45,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:46,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895483 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) (10738) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:47,214::__init__::225::IOProcess::(_processLogs) (10738) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:47,215::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10738) Building response >Thread-19::DEBUG::2014-09-09 12:18:47,215::__init__::225::IOProcess::(_processLogs) (10738) Queuing response >Thread-3443::DEBUG::2014-09-09 12:18:47,215::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:47,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:47,221::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:18:47,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000975532 s, 364 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:47,223::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:47,223::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:47,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:47,223::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) (10739) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) (10739) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10739) Building response >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) (10739) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:47,224::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:47,225::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:48,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:48,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089577 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:48,393::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:48,394::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5137::DEBUG::2014-09-09 12:18:48,395::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:49,658::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:49,659::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5138::DEBUG::2014-09-09 12:18:49,659::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5138::DEBUG::2014-09-09 12:18:49,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2065aff-6aa2-4f77-9149-af8ca0234b3d`::moving from state init -> state preparing >Thread-5138::INFO::2014-09-09 12:18:49,662::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5138::INFO::2014-09-09 12:18:49,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5138::DEBUG::2014-09-09 12:18:49,663::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2065aff-6aa2-4f77-9149-af8ca0234b3d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5138::DEBUG::2014-09-09 12:18:49,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2065aff-6aa2-4f77-9149-af8ca0234b3d`::moving from state preparing -> state finished >Thread-5138::DEBUG::2014-09-09 12:18:49,664::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5138::DEBUG::2014-09-09 12:18:49,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5138::DEBUG::2014-09-09 12:18:49,665::task::993::Storage.TaskManager.Task::(_decref) Task=`a2065aff-6aa2-4f77-9149-af8ca0234b3d`::ref 0 aborting False >Thread-5138::DEBUG::2014-09-09 12:18:49,666::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5138::DEBUG::2014-09-09 12:18:49,666::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:49,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:49,698::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5139::DEBUG::2014-09-09 12:18:49,698::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5139::DEBUG::2014-09-09 12:18:49,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`47f69a5d-3d4b-442d-8b5b-28b177660339`::moving from state init -> state preparing >Thread-5139::INFO::2014-09-09 12:18:49,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5139::DEBUG::2014-09-09 12:18:49,702::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f2a19512-cf7a-4940-9f94-3ad0fd0cf1a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5139::DEBUG::2014-09-09 12:18:49,702::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5139::DEBUG::2014-09-09 12:18:49,703::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5139::DEBUG::2014-09-09 12:18:49,703::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f2a19512-cf7a-4940-9f94-3ad0fd0cf1a9`::Granted request >Thread-5139::DEBUG::2014-09-09 12:18:49,705::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`47f69a5d-3d4b-442d-8b5b-28b177660339`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5139::DEBUG::2014-09-09 12:18:49,705::task::993::Storage.TaskManager.Task::(_decref) Task=`47f69a5d-3d4b-442d-8b5b-28b177660339`::ref 1 aborting False >Thread-5139::INFO::2014-09-09 12:18:49,712::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5139::DEBUG::2014-09-09 12:18:49,713::task::1191::Storage.TaskManager.Task::(prepare) Task=`47f69a5d-3d4b-442d-8b5b-28b177660339`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5139::DEBUG::2014-09-09 12:18:49,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`47f69a5d-3d4b-442d-8b5b-28b177660339`::moving from state preparing -> state finished >Thread-5139::DEBUG::2014-09-09 12:18:49,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5139::DEBUG::2014-09-09 12:18:49,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5139::DEBUG::2014-09-09 12:18:49,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5139::DEBUG::2014-09-09 12:18:49,715::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5139::DEBUG::2014-09-09 12:18:49,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5139::DEBUG::2014-09-09 12:18:49,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5139::DEBUG::2014-09-09 12:18:49,717::task::993::Storage.TaskManager.Task::(_decref) Task=`47f69a5d-3d4b-442d-8b5b-28b177660339`::ref 0 aborting False >Thread-5139::DEBUG::2014-09-09 12:18:49,718::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5139::DEBUG::2014-09-09 12:18:49,718::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:50,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:50,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.093438 s, 11.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:50,723::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:50,723::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:50,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:50,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:50,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:50,723::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:50,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:50,724::__init__::225::IOProcess::(_processLogs) (10740) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:50,724::__init__::225::IOProcess::(_processLogs) (10740) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:50,724::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10740) Building response >Thread-19::DEBUG::2014-09-09 12:18:50,725::__init__::225::IOProcess::(_processLogs) (10740) Queuing response >Thread-24::DEBUG::2014-09-09 12:18:50,725::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:50,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:50,730::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:18:50,733::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00097877 s, 560 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:50,733::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) (10741) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) (10741) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10741) Building response >Thread-19::DEBUG::2014-09-09 12:18:50,734::__init__::225::IOProcess::(_processLogs) (10741) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:50,735::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:50,735::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:18:50,735::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:50,735::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) (10742) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) (10742) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10742) Building response >Thread-19::DEBUG::2014-09-09 12:18:50,736::__init__::225::IOProcess::(_processLogs) (10742) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:50,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) (10743) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) (10743) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10743) Building response >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) (10743) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:50,738::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:50,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:50,740::__init__::225::IOProcess::(_processLogs) (10744) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:18:50,740::__init__::225::IOProcess::(_processLogs) (10744) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:18:50,740::__init__::225::IOProcess::(_processLogs) (10744) Building response >Thread-19::DEBUG::2014-09-09 12:18:50,740::__init__::225::IOProcess::(_processLogs) (10744) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:50,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:50,740::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:51,403::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:51,403::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5140::DEBUG::2014-09-09 12:18:51,404::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:52,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:52,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895917 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:52,723::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) (10745) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) (10745) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:52,724::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10745) Building response >Thread-23::DEBUG::2014-09-09 12:18:52,725::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:18:52,725::__init__::225::IOProcess::(_processLogs) (10745) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:52,730::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:52,731::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:18:52,732::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.0010971 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) (10746) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:52,733::__init__::225::IOProcess::(_processLogs) (10746) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:52,734::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10746) Building response >Thread-19::DEBUG::2014-09-09 12:18:52,734::__init__::225::IOProcess::(_processLogs) (10746) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:52,734::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:18:52,735::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:18:54,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:54,412::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:54,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5141::DEBUG::2014-09-09 12:18:54,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`56d9271d-1e5f-4735-accd-2ad3d286a5ea`::moving from state init -> state preparing >Thread-5141::INFO::2014-09-09 12:18:54,415::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5141::INFO::2014-09-09 12:18:54,415::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010971', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00097877', 'lastCheck': '3.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000975532', 'lastCheck': '7.2', 'valid': True}} >Thread-5141::DEBUG::2014-09-09 12:18:54,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`56d9271d-1e5f-4735-accd-2ad3d286a5ea`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010971', 'lastCheck': '1.7', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00097877', 'lastCheck': '3.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000975532', 'lastCheck': '7.2', 'valid': True}} >Thread-5141::DEBUG::2014-09-09 12:18:54,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`56d9271d-1e5f-4735-accd-2ad3d286a5ea`::moving from state preparing -> state finished >Thread-5141::DEBUG::2014-09-09 12:18:54,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5141::DEBUG::2014-09-09 12:18:54,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5141::DEBUG::2014-09-09 12:18:54,415::task::993::Storage.TaskManager.Task::(_decref) Task=`56d9271d-1e5f-4735-accd-2ad3d286a5ea`::ref 0 aborting False >Thread-5141::DEBUG::2014-09-09 12:18:54,416::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:54,433::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:54,434::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5142::DEBUG::2014-09-09 12:18:54,434::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:54,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896232 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:18:56,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:56,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895192 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:57,225::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) (10747) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) (10747) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10747) Building response >Thread-19::DEBUG::2014-09-09 12:18:57,226::__init__::225::IOProcess::(_processLogs) (10747) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:57,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:57,227::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:18:57,227::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:18:57,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000996726 s, 356 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) (10748) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:18:57,235::__init__::225::IOProcess::(_processLogs) (10748) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:18:57,236::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10748) Building response >Thread-19::DEBUG::2014-09-09 12:18:57,236::__init__::225::IOProcess::(_processLogs) (10748) Queuing response >Thread-19::DEBUG::2014-09-09 12:18:57,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:18:57,236::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:57,554::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:57,555::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5143::DEBUG::2014-09-09 12:18:57,556::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:18:58,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:18:58,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895644 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:59,758::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:59,759::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5144::DEBUG::2014-09-09 12:18:59,759::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5144::DEBUG::2014-09-09 12:18:59,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`33ef3fa3-158b-47ab-b7ff-895130f279b3`::moving from state init -> state preparing >Thread-5144::INFO::2014-09-09 12:18:59,760::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5144::INFO::2014-09-09 12:18:59,760::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5144::DEBUG::2014-09-09 12:18:59,760::task::1191::Storage.TaskManager.Task::(prepare) Task=`33ef3fa3-158b-47ab-b7ff-895130f279b3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5144::DEBUG::2014-09-09 12:18:59,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`33ef3fa3-158b-47ab-b7ff-895130f279b3`::moving from state preparing -> state finished >Thread-5144::DEBUG::2014-09-09 12:18:59,760::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5144::DEBUG::2014-09-09 12:18:59,760::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5144::DEBUG::2014-09-09 12:18:59,760::task::993::Storage.TaskManager.Task::(_decref) Task=`33ef3fa3-158b-47ab-b7ff-895130f279b3`::ref 0 aborting False >Thread-5144::DEBUG::2014-09-09 12:18:59,761::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5144::DEBUG::2014-09-09 12:18:59,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:18:59,781::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:18:59,781::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5145::DEBUG::2014-09-09 12:18:59,781::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5145::DEBUG::2014-09-09 12:18:59,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac76cdcf-e830-4842-a369-7a3f8b89b8a2`::moving from state init -> state preparing >Thread-5145::INFO::2014-09-09 12:18:59,782::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5145::DEBUG::2014-09-09 12:18:59,783::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eb435053-1448-4747-b07b-715b59f3092c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5145::DEBUG::2014-09-09 12:18:59,783::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5145::DEBUG::2014-09-09 12:18:59,783::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5145::DEBUG::2014-09-09 12:18:59,783::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eb435053-1448-4747-b07b-715b59f3092c`::Granted request >Thread-5145::DEBUG::2014-09-09 12:18:59,783::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac76cdcf-e830-4842-a369-7a3f8b89b8a2`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5145::DEBUG::2014-09-09 12:18:59,783::task::993::Storage.TaskManager.Task::(_decref) Task=`ac76cdcf-e830-4842-a369-7a3f8b89b8a2`::ref 1 aborting False >Thread-5145::INFO::2014-09-09 12:18:59,785::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5145::DEBUG::2014-09-09 12:18:59,785::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac76cdcf-e830-4842-a369-7a3f8b89b8a2`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5145::DEBUG::2014-09-09 12:18:59,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac76cdcf-e830-4842-a369-7a3f8b89b8a2`::moving from state preparing -> state finished >Thread-5145::DEBUG::2014-09-09 12:18:59,785::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5145::DEBUG::2014-09-09 12:18:59,785::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5145::DEBUG::2014-09-09 12:18:59,785::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5145::DEBUG::2014-09-09 12:18:59,785::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5145::DEBUG::2014-09-09 12:18:59,785::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5145::DEBUG::2014-09-09 12:18:59,786::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5145::DEBUG::2014-09-09 12:18:59,786::task::993::Storage.TaskManager.Task::(_decref) Task=`ac76cdcf-e830-4842-a369-7a3f8b89b8a2`::ref 0 aborting False >Thread-5145::DEBUG::2014-09-09 12:18:59,786::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5145::DEBUG::2014-09-09 12:18:59,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:00,564::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:00,565::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5146::DEBUG::2014-09-09 12:19:00,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:00,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:00,740::__init__::225::IOProcess::(_processLogs) (10749) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:00,741::__init__::225::IOProcess::(_processLogs) (10749) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:00,816::__init__::225::IOProcess::(_processLogs) (10738) Queuing responseDEBUG|(10749) Building response >Thread-19::DEBUG::2014-09-09 12:19:00,816::__init__::225::IOProcess::(_processLogs) (10749) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:00,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:00,817::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:19:00,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:00,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0972251 s, 10.5 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:19:00,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000939779 s, 583 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:00,827::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:00,828::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:00,828::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:00,829::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:00,829::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:00,830::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:00,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:00,831::__init__::225::IOProcess::(_processLogs) (10750) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:00,832::__init__::225::IOProcess::(_processLogs) (10750) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:00,832::__init__::225::IOProcess::(_processLogs) (10750) Building response >Thread-19::DEBUG::2014-09-09 12:19:00,832::__init__::225::IOProcess::(_processLogs) (10750) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:00,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:00,833::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:19:00,834::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:00,834::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:19:00,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:00,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:00,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:00,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:00,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:00,836::__init__::225::IOProcess::(_processLogs) DEBUG|(10751) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:00,837::__init__::225::IOProcess::(_processLogs) (10751) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:00,837::__init__::225::IOProcess::(_processLogs) (10751) Building response >Thread-19::DEBUG::2014-09-09 12:19:00,838::__init__::225::IOProcess::(_processLogs) (10751) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:00,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:00,838::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:00,839::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:00,839::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:19:00,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:00,840::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:00,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:00,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:00,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:00,842::__init__::225::IOProcess::(_processLogs) (10752) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:00,842::__init__::225::IOProcess::(_processLogs) (10752) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:00,842::__init__::225::IOProcess::(_processLogs) (10752) Building response >Thread-19::DEBUG::2014-09-09 12:19:00,843::__init__::225::IOProcess::(_processLogs) (10752) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:00,843::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:00,844::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:00,844::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:00,845::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:19:00,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:00,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:00,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:00,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:00,847::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:00,847::__init__::225::IOProcess::(_processLogs) (10753) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:00,848::__init__::225::IOProcess::(_processLogs) (10753) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:00,848::__init__::225::IOProcess::(_processLogs) (10753) Building response >Thread-19::DEBUG::2014-09-09 12:19:00,848::__init__::225::IOProcess::(_processLogs) (10753) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:00,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:00,849::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:02,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:02,736::__init__::225::IOProcess::(_processLogs) (10754) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:02,736::__init__::225::IOProcess::(_processLogs) (10754) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:02,736::__init__::225::IOProcess::(_processLogs) DEBUG|(10754) Building response >Thread-23::DEBUG::2014-09-09 12:19:02,736::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:19:02,737::__init__::225::IOProcess::(_processLogs) (10754) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:02,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:02,742::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:19:02,745::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111372 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:02,745::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:02,745::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:02,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:02,745::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) (10755) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) (10755) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) DEBUG|(10755) Building response >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) (10755) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:02,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:02,747::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:19:02,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:02,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895597 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:03,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:03,574::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5147::DEBUG::2014-09-09 12:19:03,575::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:04,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:05,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089569 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:06,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:06,584::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5148::DEBUG::2014-09-09 12:19:06,585::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:07,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:07,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894423 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:07,237::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:07,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:07,237::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:07,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:07,238::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:07,238::__init__::225::IOProcess::(_processLogs) (10756) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:07,238::__init__::225::IOProcess::(_processLogs) (10756) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:07,238::__init__::225::IOProcess::(_processLogs) (10756) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:07,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:19:07,239::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:19:07,246::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00102583 s, 346 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) (10757) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:07,247::__init__::225::IOProcess::(_processLogs) (10757) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:07,248::__init__::225::IOProcess::(_processLogs) (10757) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:07,248::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:19:09,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:09,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895991 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:09,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:09,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5149::DEBUG::2014-09-09 12:19:09,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fa3f1b-1024-48ee-b618-eb42e80e3d6a`::moving from state init -> state preparing >Thread-5149::INFO::2014-09-09 12:19:09,593::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5149::INFO::2014-09-09 12:19:09,593::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111372', 'lastCheck': '6.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939779', 'lastCheck': '8.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102583', 'lastCheck': '2.3', 'valid': True}} >Thread-5149::DEBUG::2014-09-09 12:19:09,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6fa3f1b-1024-48ee-b618-eb42e80e3d6a`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111372', 'lastCheck': '6.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000939779', 'lastCheck': '8.7', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102583', 'lastCheck': '2.3', 'valid': True}} >Thread-5149::DEBUG::2014-09-09 12:19:09,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fa3f1b-1024-48ee-b618-eb42e80e3d6a`::moving from state preparing -> state finished >Thread-5149::DEBUG::2014-09-09 12:19:09,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5149::DEBUG::2014-09-09 12:19:09,594::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5149::DEBUG::2014-09-09 12:19:09,594::task::993::Storage.TaskManager.Task::(_decref) Task=`b6fa3f1b-1024-48ee-b618-eb42e80e3d6a`::ref 0 aborting False >Thread-5149::DEBUG::2014-09-09 12:19:09,595::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:09,603::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:09,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5150::DEBUG::2014-09-09 12:19:09,604::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:09,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:09,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5151::DEBUG::2014-09-09 12:19:09,826::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5151::DEBUG::2014-09-09 12:19:09,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac0b929e-e72d-4c71-8994-cd22a66c0692`::moving from state init -> state preparing >Thread-5151::INFO::2014-09-09 12:19:09,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5151::INFO::2014-09-09 12:19:09,827::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5151::DEBUG::2014-09-09 12:19:09,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac0b929e-e72d-4c71-8994-cd22a66c0692`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5151::DEBUG::2014-09-09 12:19:09,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac0b929e-e72d-4c71-8994-cd22a66c0692`::moving from state preparing -> state finished >Thread-5151::DEBUG::2014-09-09 12:19:09,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5151::DEBUG::2014-09-09 12:19:09,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5151::DEBUG::2014-09-09 12:19:09,827::task::993::Storage.TaskManager.Task::(_decref) Task=`ac0b929e-e72d-4c71-8994-cd22a66c0692`::ref 0 aborting False >Thread-5151::DEBUG::2014-09-09 12:19:09,827::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5151::DEBUG::2014-09-09 12:19:09,828::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:09,856::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:09,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5152::DEBUG::2014-09-09 12:19:09,857::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5152::DEBUG::2014-09-09 12:19:09,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`44154c9e-e79e-4b40-9f1f-9d96ed981c93`::moving from state init -> state preparing >Thread-5152::INFO::2014-09-09 12:19:09,858::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5152::DEBUG::2014-09-09 12:19:09,858::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`dd0a2a3d-699a-4b38-bbf3-c1ec36fe962f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5152::DEBUG::2014-09-09 12:19:09,858::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5152::DEBUG::2014-09-09 12:19:09,858::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5152::DEBUG::2014-09-09 12:19:09,859::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`dd0a2a3d-699a-4b38-bbf3-c1ec36fe962f`::Granted request >Thread-5152::DEBUG::2014-09-09 12:19:09,859::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44154c9e-e79e-4b40-9f1f-9d96ed981c93`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5152::DEBUG::2014-09-09 12:19:09,859::task::993::Storage.TaskManager.Task::(_decref) Task=`44154c9e-e79e-4b40-9f1f-9d96ed981c93`::ref 1 aborting False >Thread-5152::INFO::2014-09-09 12:19:09,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5152::DEBUG::2014-09-09 12:19:09,861::task::1191::Storage.TaskManager.Task::(prepare) Task=`44154c9e-e79e-4b40-9f1f-9d96ed981c93`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5152::DEBUG::2014-09-09 12:19:09,861::task::595::Storage.TaskManager.Task::(_updateState) Task=`44154c9e-e79e-4b40-9f1f-9d96ed981c93`::moving from state preparing -> state finished >Thread-5152::DEBUG::2014-09-09 12:19:09,861::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5152::DEBUG::2014-09-09 12:19:09,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5152::DEBUG::2014-09-09 12:19:09,861::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5152::DEBUG::2014-09-09 12:19:09,861::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5152::DEBUG::2014-09-09 12:19:09,861::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5152::DEBUG::2014-09-09 12:19:09,861::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5152::DEBUG::2014-09-09 12:19:09,861::task::993::Storage.TaskManager.Task::(_decref) Task=`44154c9e-e79e-4b40-9f1f-9d96ed981c93`::ref 0 aborting False >Thread-5152::DEBUG::2014-09-09 12:19:09,861::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5152::DEBUG::2014-09-09 12:19:09,862::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) (10758) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:10,848::__init__::225::IOProcess::(_processLogs) (10758) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:10,849::__init__::225::IOProcess::(_processLogs) (10758) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:10,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:19:10,849::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:19:10,857::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00104174 s, 526 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:10,857::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:10,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:10,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:10,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) (10759) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) (10759) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10759) Building response >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) (10759) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:10,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:10,859::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:19:10,859::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:10,859::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) (10760) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) (10760) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) (10760) Building response >Thread-19::DEBUG::2014-09-09 12:19:10,860::__init__::225::IOProcess::(_processLogs) (10760) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:10,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) (10761) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) (10761) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) (10761) Building response >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) (10761) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:10,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:10,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:10,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:10,863::__init__::225::IOProcess::(_processLogs) (10762) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:10,863::__init__::225::IOProcess::(_processLogs) (10762) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:10,863::__init__::225::IOProcess::(_processLogs) (10762) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:10,863::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:19:11,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:11,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896105 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:12,715::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:12,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5153::DEBUG::2014-09-09 12:19:12,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:12,747::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:12,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:12,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:12,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:12,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:12,748::__init__::225::IOProcess::(_processLogs) (10763) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:12,748::__init__::225::IOProcess::(_processLogs) (10763) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:12,749::__init__::225::IOProcess::(_processLogs) (10763) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:12,749::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:19:12,750::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:19:12,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113661 s, 988 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:12,758::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:12,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:12,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:12,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:12,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:12,759::__init__::225::IOProcess::(_processLogs) (10764) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:12,759::__init__::225::IOProcess::(_processLogs) (10764) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:12,759::__init__::225::IOProcess::(_processLogs) (10764) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:12,759::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:19:13,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:13,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896094 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:19:15,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:15,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896123 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:15,725::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:15,726::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5154::DEBUG::2014-09-09 12:19:15,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) (10765) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:17,249::__init__::225::IOProcess::(_processLogs) (10765) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:17,250::__init__::225::IOProcess::(_processLogs) (10765) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:17,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:19:17,250::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:19:17,258::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00104443 s, 340 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) (10766) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) (10766) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:17,259::__init__::225::IOProcess::(_processLogs) (10766) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:17,260::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:19:17,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:17,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894963 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:18,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:18,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5155::DEBUG::2014-09-09 12:19:18,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:19,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:19,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0939386 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:19,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:19,902::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5156::DEBUG::2014-09-09 12:19:19,902::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5156::DEBUG::2014-09-09 12:19:19,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff54600b-803c-4fab-8b02-12bd745ab971`::moving from state init -> state preparing >Thread-5156::INFO::2014-09-09 12:19:19,906::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5156::INFO::2014-09-09 12:19:19,909::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5156::DEBUG::2014-09-09 12:19:19,909::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff54600b-803c-4fab-8b02-12bd745ab971`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5156::DEBUG::2014-09-09 12:19:19,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff54600b-803c-4fab-8b02-12bd745ab971`::moving from state preparing -> state finished >Thread-5156::DEBUG::2014-09-09 12:19:19,910::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5156::DEBUG::2014-09-09 12:19:19,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5156::DEBUG::2014-09-09 12:19:19,911::task::993::Storage.TaskManager.Task::(_decref) Task=`ff54600b-803c-4fab-8b02-12bd745ab971`::ref 0 aborting False >Thread-5156::DEBUG::2014-09-09 12:19:19,912::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5156::DEBUG::2014-09-09 12:19:19,912::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:19,941::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:19,943::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5157::DEBUG::2014-09-09 12:19:19,943::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5157::DEBUG::2014-09-09 12:19:19,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbc04a9b-5f2b-4849-821c-dee5a7517fba`::moving from state init -> state preparing >Thread-5157::INFO::2014-09-09 12:19:19,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5157::DEBUG::2014-09-09 12:19:19,947::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ae96dc60-4396-41f9-983b-8e17b29e91e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5157::DEBUG::2014-09-09 12:19:19,947::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5157::DEBUG::2014-09-09 12:19:19,948::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5157::DEBUG::2014-09-09 12:19:19,948::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ae96dc60-4396-41f9-983b-8e17b29e91e5`::Granted request >Thread-5157::DEBUG::2014-09-09 12:19:19,950::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bbc04a9b-5f2b-4849-821c-dee5a7517fba`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5157::DEBUG::2014-09-09 12:19:19,950::task::993::Storage.TaskManager.Task::(_decref) Task=`bbc04a9b-5f2b-4849-821c-dee5a7517fba`::ref 1 aborting False >Thread-5157::INFO::2014-09-09 12:19:19,958::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5157::DEBUG::2014-09-09 12:19:19,958::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbc04a9b-5f2b-4849-821c-dee5a7517fba`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5157::DEBUG::2014-09-09 12:19:19,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbc04a9b-5f2b-4849-821c-dee5a7517fba`::moving from state preparing -> state finished >Thread-5157::DEBUG::2014-09-09 12:19:19,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5157::DEBUG::2014-09-09 12:19:19,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5157::DEBUG::2014-09-09 12:19:19,960::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5157::DEBUG::2014-09-09 12:19:19,961::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5157::DEBUG::2014-09-09 12:19:19,961::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5157::DEBUG::2014-09-09 12:19:19,961::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5157::DEBUG::2014-09-09 12:19:19,962::task::993::Storage.TaskManager.Task::(_decref) Task=`bbc04a9b-5f2b-4849-821c-dee5a7517fba`::ref 0 aborting False >Thread-5157::DEBUG::2014-09-09 12:19:19,963::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5157::DEBUG::2014-09-09 12:19:19,964::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:20,864::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:20,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) (10767) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) (10767) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) (10767) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:20,865::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:19:20,866::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:19:20,875::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00107303 s, 511 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:20,875::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:20,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:20,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:20,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:20,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:20,876::__init__::225::IOProcess::(_processLogs) (10768) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:20,876::__init__::225::IOProcess::(_processLogs) (10768) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:20,876::__init__::225::IOProcess::(_processLogs) (10768) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:20,876::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:19:20,877::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:19:20,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:20,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) (10769) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) (10769) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) (10769) Building response >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) (10769) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:20,878::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) (10770) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) (10770) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) (10770) Building response >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) (10770) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:20,879::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:20,880::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:19:20,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:20,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:20,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:20,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:20,880::__init__::225::IOProcess::(_processLogs) (10771) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:20,881::__init__::225::IOProcess::(_processLogs) (10771) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:20,881::__init__::225::IOProcess::(_processLogs) (10771) Building response >Thread-19::DEBUG::2014-09-09 12:19:20,881::__init__::225::IOProcess::(_processLogs) (10771) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:20,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:20,881::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:21,747::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:21,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5158::DEBUG::2014-09-09 12:19:21,748::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:21,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:21,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896748 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:22,760::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) (10772) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) (10772) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) (10772) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:22,761::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:19:22,762::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:19:22,769::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00120753 s, 930 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:22,769::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:22,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) (10773) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) (10773) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) (10773) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:22,770::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:19:23,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:24,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898743 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:24,757::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:24,757::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5159::DEBUG::2014-09-09 12:19:24,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c48fb9-c77f-4186-ab14-145870cec9e9`::moving from state init -> state preparing >Thread-5159::INFO::2014-09-09 12:19:24,758::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5159::INFO::2014-09-09 12:19:24,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120753', 'lastCheck': '2.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107303', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104443', 'lastCheck': '7.5', 'valid': True}} >Thread-5159::DEBUG::2014-09-09 12:19:24,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`59c48fb9-c77f-4186-ab14-145870cec9e9`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120753', 'lastCheck': '2.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107303', 'lastCheck': '3.9', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00104443', 'lastCheck': '7.5', 'valid': True}} >Thread-5159::DEBUG::2014-09-09 12:19:24,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c48fb9-c77f-4186-ab14-145870cec9e9`::moving from state preparing -> state finished >Thread-5159::DEBUG::2014-09-09 12:19:24,759::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5159::DEBUG::2014-09-09 12:19:24,759::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5159::DEBUG::2014-09-09 12:19:24,759::task::993::Storage.TaskManager.Task::(_decref) Task=`59c48fb9-c77f-4186-ab14-145870cec9e9`::ref 0 aborting False >Thread-5159::DEBUG::2014-09-09 12:19:24,760::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:24,769::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:24,769::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5160::DEBUG::2014-09-09 12:19:24,770::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:26,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:26,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896031 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) (10774) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) (10774) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) (10774) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:27,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:19:27,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:19:27,269::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000939406 s, 378 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:27,269::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:27,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:27,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:27,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:27,270::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:27,270::__init__::225::IOProcess::(_processLogs) (10775) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:27,270::__init__::225::IOProcess::(_processLogs) (10775) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:27,270::__init__::225::IOProcess::(_processLogs) (10775) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:27,270::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:27,891::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:27,891::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5161::DEBUG::2014-09-09 12:19:27,892::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:28,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:28,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895263 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:30,002::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:30,003::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5162::DEBUG::2014-09-09 12:19:30,003::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5162::DEBUG::2014-09-09 12:19:30,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad9a3107-6698-4c66-8e0b-a937fe6931f8`::moving from state init -> state preparing >Thread-5162::INFO::2014-09-09 12:19:30,004::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5162::INFO::2014-09-09 12:19:30,004::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5162::DEBUG::2014-09-09 12:19:30,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad9a3107-6698-4c66-8e0b-a937fe6931f8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5162::DEBUG::2014-09-09 12:19:30,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad9a3107-6698-4c66-8e0b-a937fe6931f8`::moving from state preparing -> state finished >Thread-5162::DEBUG::2014-09-09 12:19:30,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5162::DEBUG::2014-09-09 12:19:30,005::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5162::DEBUG::2014-09-09 12:19:30,005::task::993::Storage.TaskManager.Task::(_decref) Task=`ad9a3107-6698-4c66-8e0b-a937fe6931f8`::ref 0 aborting False >Thread-5162::DEBUG::2014-09-09 12:19:30,005::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5162::DEBUG::2014-09-09 12:19:30,005::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:30,083::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:30,084::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5163::DEBUG::2014-09-09 12:19:30,084::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5163::DEBUG::2014-09-09 12:19:30,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b8ffe65-ac84-43a0-9036-74a252682b22`::moving from state init -> state preparing >Thread-5163::INFO::2014-09-09 12:19:30,084::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5163::DEBUG::2014-09-09 12:19:30,086::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`61e55d54-f996-4b30-a98f-79fc32d2cc66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5163::DEBUG::2014-09-09 12:19:30,086::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5163::DEBUG::2014-09-09 12:19:30,086::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5163::DEBUG::2014-09-09 12:19:30,086::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`61e55d54-f996-4b30-a98f-79fc32d2cc66`::Granted request >Thread-5163::DEBUG::2014-09-09 12:19:30,086::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6b8ffe65-ac84-43a0-9036-74a252682b22`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5163::DEBUG::2014-09-09 12:19:30,086::task::993::Storage.TaskManager.Task::(_decref) Task=`6b8ffe65-ac84-43a0-9036-74a252682b22`::ref 1 aborting False >Thread-5163::INFO::2014-09-09 12:19:30,088::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5163::DEBUG::2014-09-09 12:19:30,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b8ffe65-ac84-43a0-9036-74a252682b22`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5163::DEBUG::2014-09-09 12:19:30,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b8ffe65-ac84-43a0-9036-74a252682b22`::moving from state preparing -> state finished >Thread-5163::DEBUG::2014-09-09 12:19:30,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5163::DEBUG::2014-09-09 12:19:30,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5163::DEBUG::2014-09-09 12:19:30,088::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5163::DEBUG::2014-09-09 12:19:30,088::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5163::DEBUG::2014-09-09 12:19:30,088::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5163::DEBUG::2014-09-09 12:19:30,089::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5163::DEBUG::2014-09-09 12:19:30,089::task::993::Storage.TaskManager.Task::(_decref) Task=`6b8ffe65-ac84-43a0-9036-74a252682b22`::ref 0 aborting False >Thread-5163::DEBUG::2014-09-09 12:19:30,089::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283537047552', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5163::DEBUG::2014-09-09 12:19:30,089::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:30,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:30,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895599 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) (10776) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:30,881::__init__::225::IOProcess::(_processLogs) (10776) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:30,882::__init__::225::IOProcess::(_processLogs) (10776) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:30,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:19:30,882::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:19:30,890::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00106193 s, 516 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:30,890::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:30,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) (10777) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) (10777) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) (10777) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:30,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) (10778) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) (10778) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:30,892::__init__::225::IOProcess::(_processLogs) (10778) Building response >Thread-19::DEBUG::2014-09-09 12:19:30,893::__init__::225::IOProcess::(_processLogs) (10778) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:30,893::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:30,893::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:19:30,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) (10779) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) (10779) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) (10779) Building response >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) (10779) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:30,894::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:19:30,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:30,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:30,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:30,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:30,895::__init__::225::IOProcess::(_processLogs) (10780) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:30,895::__init__::225::IOProcess::(_processLogs) (10780) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:30,896::__init__::225::IOProcess::(_processLogs) (10780) Building response >Thread-19::DEBUG::2014-09-09 12:19:30,896::__init__::225::IOProcess::(_processLogs) (10780) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:30,896::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:30,896::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:30,901::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:30,901::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5164::DEBUG::2014-09-09 12:19:30,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:32,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:32,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896428 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:32,771::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:32,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) (10781) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) (10781) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) (10781) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:32,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:19:32,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:19:32,780::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00120373 s, 933 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:32,780::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) (10782) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) (10782) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:32,781::__init__::225::IOProcess::(_processLogs) (10782) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:32,782::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:33,910::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:33,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5165::DEBUG::2014-09-09 12:19:33,912::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:34,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:34,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895862 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:19:36,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:36,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894761 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:36,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:36,920::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5166::DEBUG::2014-09-09 12:19:36,921::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:37,271::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:37,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:37,271::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:37,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:37,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:37,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:37,272::__init__::225::IOProcess::(_processLogs) (10783) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:37,272::__init__::225::IOProcess::(_processLogs) (10783) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:37,273::__init__::225::IOProcess::(_processLogs) (10783) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:37,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:19:37,274::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:19:37,282::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00094854 s, 374 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:37,282::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:37,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:37,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:37,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:37,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:37,283::__init__::225::IOProcess::(_processLogs) (10784) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:37,283::__init__::225::IOProcess::(_processLogs) (10784) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:37,283::__init__::225::IOProcess::(_processLogs) (10784) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:37,283::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:19:38,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:38,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896078 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:39,927::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:39,928::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5167::DEBUG::2014-09-09 12:19:39,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3898210-64a3-4c2e-8f6b-783722f8e506`::moving from state init -> state preparing >Thread-5167::INFO::2014-09-09 12:19:39,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5167::INFO::2014-09-09 12:19:39,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120373', 'lastCheck': '7.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106193', 'lastCheck': '9.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00094854', 'lastCheck': '2.6', 'valid': True}} >Thread-5167::DEBUG::2014-09-09 12:19:39,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3898210-64a3-4c2e-8f6b-783722f8e506`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00120373', 'lastCheck': '7.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106193', 'lastCheck': '9.0', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00094854', 'lastCheck': '2.6', 'valid': True}} >Thread-5167::DEBUG::2014-09-09 12:19:39,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3898210-64a3-4c2e-8f6b-783722f8e506`::moving from state preparing -> state finished >Thread-5167::DEBUG::2014-09-09 12:19:39,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5167::DEBUG::2014-09-09 12:19:39,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5167::DEBUG::2014-09-09 12:19:39,930::task::993::Storage.TaskManager.Task::(_decref) Task=`e3898210-64a3-4c2e-8f6b-783722f8e506`::ref 0 aborting False >Thread-5167::DEBUG::2014-09-09 12:19:39,931::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:39,936::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:39,936::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5168::DEBUG::2014-09-09 12:19:39,937::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:40,161::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:40,162::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5169::DEBUG::2014-09-09 12:19:40,162::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5169::DEBUG::2014-09-09 12:19:40,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b473f53-3338-42a7-b24f-25b735fbf45d`::moving from state init -> state preparing >Thread-5169::INFO::2014-09-09 12:19:40,163::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5169::INFO::2014-09-09 12:19:40,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5169::DEBUG::2014-09-09 12:19:40,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b473f53-3338-42a7-b24f-25b735fbf45d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5169::DEBUG::2014-09-09 12:19:40,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b473f53-3338-42a7-b24f-25b735fbf45d`::moving from state preparing -> state finished >Thread-5169::DEBUG::2014-09-09 12:19:40,163::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5169::DEBUG::2014-09-09 12:19:40,163::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5169::DEBUG::2014-09-09 12:19:40,163::task::993::Storage.TaskManager.Task::(_decref) Task=`4b473f53-3338-42a7-b24f-25b735fbf45d`::ref 0 aborting False >Thread-5169::DEBUG::2014-09-09 12:19:40,163::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5169::DEBUG::2014-09-09 12:19:40,164::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:40,193::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:40,193::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5170::DEBUG::2014-09-09 12:19:40,193::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5170::DEBUG::2014-09-09 12:19:40,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`335ef910-2b95-436e-a589-eb6a247d9281`::moving from state init -> state preparing >Thread-5170::INFO::2014-09-09 12:19:40,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5170::DEBUG::2014-09-09 12:19:40,194::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`815fd2d2-7b83-4548-8454-8c810e8c09a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5170::DEBUG::2014-09-09 12:19:40,194::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5170::DEBUG::2014-09-09 12:19:40,195::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5170::DEBUG::2014-09-09 12:19:40,195::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`815fd2d2-7b83-4548-8454-8c810e8c09a1`::Granted request >Thread-5170::DEBUG::2014-09-09 12:19:40,195::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`335ef910-2b95-436e-a589-eb6a247d9281`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5170::DEBUG::2014-09-09 12:19:40,195::task::993::Storage.TaskManager.Task::(_decref) Task=`335ef910-2b95-436e-a589-eb6a247d9281`::ref 1 aborting False >Thread-5170::INFO::2014-09-09 12:19:40,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5170::DEBUG::2014-09-09 12:19:40,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`335ef910-2b95-436e-a589-eb6a247d9281`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5170::DEBUG::2014-09-09 12:19:40,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`335ef910-2b95-436e-a589-eb6a247d9281`::moving from state preparing -> state finished >Thread-5170::DEBUG::2014-09-09 12:19:40,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5170::DEBUG::2014-09-09 12:19:40,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5170::DEBUG::2014-09-09 12:19:40,197::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5170::DEBUG::2014-09-09 12:19:40,197::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5170::DEBUG::2014-09-09 12:19:40,197::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5170::DEBUG::2014-09-09 12:19:40,197::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5170::DEBUG::2014-09-09 12:19:40,197::task::993::Storage.TaskManager.Task::(_decref) Task=`335ef910-2b95-436e-a589-eb6a247d9281`::ref 0 aborting False >Thread-5170::DEBUG::2014-09-09 12:19:40,198::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5170::DEBUG::2014-09-09 12:19:40,198::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:40,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) (10785) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:40,896::__init__::225::IOProcess::(_processLogs) (10785) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:40,897::__init__::225::IOProcess::(_processLogs) (10785) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:40,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:19:40,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:40,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0962825 s, 10.6 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:19:40,907::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000914677 s, 599 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:40,908::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:40,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:40,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:40,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:40,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:40,911::__init__::225::IOProcess::(_processLogs) (10786) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:40,911::__init__::225::IOProcess::(_processLogs) (10786) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:40,912::__init__::225::IOProcess::(_processLogs) (10786) Building response >Thread-19::DEBUG::2014-09-09 12:19:40,912::__init__::225::IOProcess::(_processLogs) (10786) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:40,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:40,913::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:19:40,914::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:19:40,914::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:40,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:40,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:40,916::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:40,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:40,916::__init__::225::IOProcess::(_processLogs) (10787) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:40,917::__init__::225::IOProcess::(_processLogs) (10787) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:40,918::__init__::225::IOProcess::(_processLogs) (10787) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:40,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:40,919::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:40,919::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:19:40,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:40,920::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:40,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:40,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:40,921::__init__::225::IOProcess::(_processLogs) (10788) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:40,922::__init__::225::IOProcess::(_processLogs) (10788) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:40,922::__init__::225::IOProcess::(_processLogs) (10788) Building response >Thread-19::DEBUG::2014-09-09 12:19:40,923::__init__::225::IOProcess::(_processLogs) (10788) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:40,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:40,923::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:40,924::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:19:40,924::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:40,925::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:40,925::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:40,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:40,926::__init__::225::IOProcess::(_processLogs) (10789) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:40,927::__init__::225::IOProcess::(_processLogs) (10789) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:40,927::__init__::225::IOProcess::(_processLogs) (10789) Building response >Thread-19::DEBUG::2014-09-09 12:19:40,927::__init__::225::IOProcess::(_processLogs) (10789) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:40,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:40,928::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:42,782::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:42,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:42,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:42,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:42,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:42,783::__init__::225::IOProcess::(_processLogs) (10790) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:42,783::__init__::225::IOProcess::(_processLogs) (10790) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:42,784::__init__::225::IOProcess::(_processLogs) (10790) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:42,784::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:19:42,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:19:42,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00109445 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:42,793::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:42,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:42,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:42,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:42,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:42,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:42,794::__init__::225::IOProcess::(_processLogs) (10791) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:42,794::__init__::225::IOProcess::(_processLogs) (10791) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:42,794::__init__::225::IOProcess::(_processLogs) (10791) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:42,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:42,796::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:19:42,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:43,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895283 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:43,193::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:43,194::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5171::DEBUG::2014-09-09 12:19:43,195::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:45,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:45,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897363 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:46,203::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:46,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5172::DEBUG::2014-09-09 12:19:46,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:47,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:47,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898284 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:47,284::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:47,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) (10792) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) (10792) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) (10792) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:47,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:19:47,286::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:19:47,293::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.0010105 s, 351 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:47,293::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:47,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:47,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:47,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:47,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:47,294::__init__::225::IOProcess::(_processLogs) (10793) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:47,294::__init__::225::IOProcess::(_processLogs) (10793) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:47,294::__init__::225::IOProcess::(_processLogs) (10793) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:47,294::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:49,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:49,214::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5173::DEBUG::2014-09-09 12:19:49,215::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:49,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:49,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0937758 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:50,237::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:50,239::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5174::DEBUG::2014-09-09 12:19:50,239::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5174::DEBUG::2014-09-09 12:19:50,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce5bd646-115f-40fa-96cf-7c5e3b77c9bb`::moving from state init -> state preparing >Thread-5174::INFO::2014-09-09 12:19:50,242::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5174::INFO::2014-09-09 12:19:50,243::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5174::DEBUG::2014-09-09 12:19:50,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce5bd646-115f-40fa-96cf-7c5e3b77c9bb`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5174::DEBUG::2014-09-09 12:19:50,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce5bd646-115f-40fa-96cf-7c5e3b77c9bb`::moving from state preparing -> state finished >Thread-5174::DEBUG::2014-09-09 12:19:50,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5174::DEBUG::2014-09-09 12:19:50,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5174::DEBUG::2014-09-09 12:19:50,244::task::993::Storage.TaskManager.Task::(_decref) Task=`ce5bd646-115f-40fa-96cf-7c5e3b77c9bb`::ref 0 aborting False >Thread-5174::DEBUG::2014-09-09 12:19:50,245::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5174::DEBUG::2014-09-09 12:19:50,246::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:50,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:50,279::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5175::DEBUG::2014-09-09 12:19:50,279::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5175::DEBUG::2014-09-09 12:19:50,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c14e941-1aa5-451d-bb14-94a67bb25838`::moving from state init -> state preparing >Thread-5175::INFO::2014-09-09 12:19:50,281::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5175::DEBUG::2014-09-09 12:19:50,283::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ec6659b6-0f79-499b-9711-0c75e0ab3d11`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5175::DEBUG::2014-09-09 12:19:50,283::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5175::DEBUG::2014-09-09 12:19:50,284::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5175::DEBUG::2014-09-09 12:19:50,284::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ec6659b6-0f79-499b-9711-0c75e0ab3d11`::Granted request >Thread-5175::DEBUG::2014-09-09 12:19:50,285::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c14e941-1aa5-451d-bb14-94a67bb25838`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5175::DEBUG::2014-09-09 12:19:50,286::task::993::Storage.TaskManager.Task::(_decref) Task=`6c14e941-1aa5-451d-bb14-94a67bb25838`::ref 1 aborting False >Thread-5175::INFO::2014-09-09 12:19:50,293::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5175::DEBUG::2014-09-09 12:19:50,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c14e941-1aa5-451d-bb14-94a67bb25838`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5175::DEBUG::2014-09-09 12:19:50,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c14e941-1aa5-451d-bb14-94a67bb25838`::moving from state preparing -> state finished >Thread-5175::DEBUG::2014-09-09 12:19:50,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5175::DEBUG::2014-09-09 12:19:50,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5175::DEBUG::2014-09-09 12:19:50,295::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5175::DEBUG::2014-09-09 12:19:50,296::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5175::DEBUG::2014-09-09 12:19:50,296::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5175::DEBUG::2014-09-09 12:19:50,296::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5175::DEBUG::2014-09-09 12:19:50,297::task::993::Storage.TaskManager.Task::(_decref) Task=`6c14e941-1aa5-451d-bb14-94a67bb25838`::ref 0 aborting False >Thread-5175::DEBUG::2014-09-09 12:19:50,298::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5175::DEBUG::2014-09-09 12:19:50,298::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:50,926::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:50,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:50,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:50,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:50,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:50,927::__init__::225::IOProcess::(_processLogs) (10794) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:50,927::__init__::225::IOProcess::(_processLogs) (10794) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:50,928::__init__::225::IOProcess::(_processLogs) (10794) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:50,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:50,928::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:19:50,928::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:19:50,936::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00106862 s, 513 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) (10795) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:50,937::__init__::225::IOProcess::(_processLogs) (10795) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:50,938::__init__::225::IOProcess::(_processLogs) (10795) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:50,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:50,938::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:19:50,938::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:50,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:50,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:50,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:50,939::__init__::225::IOProcess::(_processLogs) (10796) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:50,939::__init__::225::IOProcess::(_processLogs) (10796) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:50,939::__init__::225::IOProcess::(_processLogs) (10796) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:50,939::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) (10797) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:50,940::__init__::225::IOProcess::(_processLogs) (10797) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:50,941::__init__::225::IOProcess::(_processLogs) (10797) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:50,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:50,941::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:19:50,941::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:50,941::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:19:50,942::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:50,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:50,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:50,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:50,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:50,942::__init__::225::IOProcess::(_processLogs) (10798) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:19:50,943::__init__::225::IOProcess::(_processLogs) (10798) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:19:50,943::__init__::225::IOProcess::(_processLogs) (10798) Building response >Thread-19::DEBUG::2014-09-09 12:19:50,943::__init__::225::IOProcess::(_processLogs) (10798) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:50,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:19:50,943::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:19:51,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:51,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896513 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:52,223::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:52,224::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5176::DEBUG::2014-09-09 12:19:52,225::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:19:52,796::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:52,796::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:52,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) (10799) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) (10799) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) DEBUG|(10799) Building response >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) (10799) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:52,797::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:19:52,798::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:19:52,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:19:52,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114252 s, 983 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:52,806::__init__::225::IOProcess::(_processLogs) (10800) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:52,807::__init__::225::IOProcess::(_processLogs) (10800) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:52,807::__init__::225::IOProcess::(_processLogs) (10800) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:52,807::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:19:53,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:53,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895365 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:55,233::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:55,234::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5177::DEBUG::2014-09-09 12:19:55,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`d05b6778-e35f-466e-b82d-e1f6fc149a5d`::moving from state init -> state preparing >Thread-5177::INFO::2014-09-09 12:19:55,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5177::INFO::2014-09-09 12:19:55,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114252', 'lastCheck': '2.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106862', 'lastCheck': '4.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010105', 'lastCheck': '7.9', 'valid': True}} >Thread-5177::DEBUG::2014-09-09 12:19:55,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`d05b6778-e35f-466e-b82d-e1f6fc149a5d`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114252', 'lastCheck': '2.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106862', 'lastCheck': '4.3', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0010105', 'lastCheck': '7.9', 'valid': True}} >Thread-5177::DEBUG::2014-09-09 12:19:55,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`d05b6778-e35f-466e-b82d-e1f6fc149a5d`::moving from state preparing -> state finished >Thread-5177::DEBUG::2014-09-09 12:19:55,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5177::DEBUG::2014-09-09 12:19:55,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5177::DEBUG::2014-09-09 12:19:55,236::task::993::Storage.TaskManager.Task::(_decref) Task=`d05b6778-e35f-466e-b82d-e1f6fc149a5d`::ref 0 aborting False >Thread-5177::DEBUG::2014-09-09 12:19:55,237::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:55,246::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:55,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5178::DEBUG::2014-09-09 12:19:55,247::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:55,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:55,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896044 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:57,295::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) (10801) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) (10801) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) (10801) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:57,296::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:19:57,297::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:19:57,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000955178 s, 372 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:19:57,304::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:19:57,304::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:19:57,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:19:57,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:19:57,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:19:57,305::__init__::225::IOProcess::(_processLogs) (10802) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:19:57,305::__init__::225::IOProcess::(_processLogs) (10802) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:19:57,305::__init__::225::IOProcess::(_processLogs) (10802) Queuing response >Thread-19::DEBUG::2014-09-09 12:19:57,305::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:19:57,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:57,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895957 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:19:58,419::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:19:58,420::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5179::DEBUG::2014-09-09 12:19:58,421::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:19:59,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:19:59,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896956 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:00,338::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:00,338::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5180::DEBUG::2014-09-09 12:20:00,339::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5180::DEBUG::2014-09-09 12:20:00,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e4d14f8-b8c2-42e4-b9ff-07aee23b41ae`::moving from state init -> state preparing >Thread-5180::INFO::2014-09-09 12:20:00,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5180::INFO::2014-09-09 12:20:00,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5180::DEBUG::2014-09-09 12:20:00,340::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e4d14f8-b8c2-42e4-b9ff-07aee23b41ae`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5180::DEBUG::2014-09-09 12:20:00,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e4d14f8-b8c2-42e4-b9ff-07aee23b41ae`::moving from state preparing -> state finished >Thread-5180::DEBUG::2014-09-09 12:20:00,340::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5180::DEBUG::2014-09-09 12:20:00,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5180::DEBUG::2014-09-09 12:20:00,340::task::993::Storage.TaskManager.Task::(_decref) Task=`0e4d14f8-b8c2-42e4-b9ff-07aee23b41ae`::ref 0 aborting False >Thread-5180::DEBUG::2014-09-09 12:20:00,340::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5180::DEBUG::2014-09-09 12:20:00,341::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:00,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5181::DEBUG::2014-09-09 12:20:00,370::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:20:00,370::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5181::DEBUG::2014-09-09 12:20:00,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c37e084-bc32-4af3-87e1-2b2a4fe4efa3`::moving from state init -> state preparing >Thread-5181::INFO::2014-09-09 12:20:00,371::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5181::DEBUG::2014-09-09 12:20:00,371::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d47b4a50-0629-4fdf-a711-578796191e2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5181::DEBUG::2014-09-09 12:20:00,371::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5181::DEBUG::2014-09-09 12:20:00,371::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5181::DEBUG::2014-09-09 12:20:00,371::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`d47b4a50-0629-4fdf-a711-578796191e2f`::Granted request >Thread-5181::DEBUG::2014-09-09 12:20:00,372::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4c37e084-bc32-4af3-87e1-2b2a4fe4efa3`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5181::DEBUG::2014-09-09 12:20:00,372::task::993::Storage.TaskManager.Task::(_decref) Task=`4c37e084-bc32-4af3-87e1-2b2a4fe4efa3`::ref 1 aborting False >Thread-5181::INFO::2014-09-09 12:20:00,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5181::DEBUG::2014-09-09 12:20:00,373::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c37e084-bc32-4af3-87e1-2b2a4fe4efa3`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5181::DEBUG::2014-09-09 12:20:00,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c37e084-bc32-4af3-87e1-2b2a4fe4efa3`::moving from state preparing -> state finished >Thread-5181::DEBUG::2014-09-09 12:20:00,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5181::DEBUG::2014-09-09 12:20:00,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5181::DEBUG::2014-09-09 12:20:00,374::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5181::DEBUG::2014-09-09 12:20:00,374::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5181::DEBUG::2014-09-09 12:20:00,374::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5181::DEBUG::2014-09-09 12:20:00,374::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5181::DEBUG::2014-09-09 12:20:00,374::task::993::Storage.TaskManager.Task::(_decref) Task=`4c37e084-bc32-4af3-87e1-2b2a4fe4efa3`::ref 0 aborting False >Thread-5181::DEBUG::2014-09-09 12:20:00,374::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5181::DEBUG::2014-09-09 12:20:00,375::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:00,942::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) (10803) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) (10803) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) (10803) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:00,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:20:00,944::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:20:00,952::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.00109254 s, 502 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:00,953::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:00,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:00,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:00,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:00,953::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:00,954::__init__::225::IOProcess::(_processLogs) (10804) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:00,954::__init__::225::IOProcess::(_processLogs) (10804) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:00,954::__init__::225::IOProcess::(_processLogs) (10804) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:00,954::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:00,954::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) (10805) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) (10805) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:00,955::__init__::225::IOProcess::(_processLogs) (10805) Building response >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) (10805) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) (10806) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:00,956::__init__::225::IOProcess::(_processLogs) (10806) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) (10806) Building response >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) (10806) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:20:00,957::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) (10807) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) (10807) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) (10807) Building response >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) (10807) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:00,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:00,959::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:01,428::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:01,429::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5182::DEBUG::2014-09-09 12:20:01,430::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:01,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:02,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895105 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:02,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:02,808::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:02,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:02,808::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:02,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:02,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) (10808) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) (10808) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) DEBUG|(10808) Building response >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) (10808) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:02,809::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:20:02,810::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:20:02,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113182 s, 992 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:02,818::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:02,818::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:02,818::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) (10809) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) (10809) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) DEBUG|(10809) Building response >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) (10809) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:02,819::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:02,820::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:20:04,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:04,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896437 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:04,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:04,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5183::DEBUG::2014-09-09 12:20:04,439::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:06,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:06,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896541 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:07,306::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:07,306::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:07,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) (10810) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) (10810) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) DEBUG|(10810) Building response >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) (10810) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:07,307::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-3443::DEBUG::2014-09-09 12:20:07,308::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:20:07,308::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:20:07,316::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00085981 s, 413 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:07,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:07,317::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:07,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:07,317::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:07,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:07,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:07,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:07,318::__init__::225::IOProcess::(_processLogs) (10811) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:07,318::__init__::225::IOProcess::(_processLogs) (10811) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:07,318::__init__::225::IOProcess::(_processLogs) (10811) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:07,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:07,319::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:07,442::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:07,443::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5184::DEBUG::2014-09-09 12:20:07,444::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:08,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:08,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895006 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:20:10,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:10,421::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:10,422::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5185::DEBUG::2014-09-09 12:20:10,421::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5185::DEBUG::2014-09-09 12:20:10,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`8152868c-0076-407c-832a-cc3603508793`::moving from state init -> state preparing >Thread-5185::INFO::2014-09-09 12:20:10,423::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5185::INFO::2014-09-09 12:20:10,423::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5185::DEBUG::2014-09-09 12:20:10,423::task::1191::Storage.TaskManager.Task::(prepare) Task=`8152868c-0076-407c-832a-cc3603508793`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5185::DEBUG::2014-09-09 12:20:10,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`8152868c-0076-407c-832a-cc3603508793`::moving from state preparing -> state finished >Thread-5185::DEBUG::2014-09-09 12:20:10,423::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5185::DEBUG::2014-09-09 12:20:10,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5185::DEBUG::2014-09-09 12:20:10,423::task::993::Storage.TaskManager.Task::(_decref) Task=`8152868c-0076-407c-832a-cc3603508793`::ref 0 aborting False >Thread-5185::DEBUG::2014-09-09 12:20:10,424::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5185::DEBUG::2014-09-09 12:20:10,424::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:10,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0893991 s, 11.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:10,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:10,451::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5186::DEBUG::2014-09-09 12:20:10,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`29b9570e-5add-4d0f-bd33-31f3be242c5c`::moving from state init -> state preparing >Thread-5186::INFO::2014-09-09 12:20:10,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5186::INFO::2014-09-09 12:20:10,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113182', 'lastCheck': '7.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109254', 'lastCheck': '9.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00085981', 'lastCheck': '3.1', 'valid': True}} >Thread-5186::DEBUG::2014-09-09 12:20:10,456::task::1191::Storage.TaskManager.Task::(prepare) Task=`29b9570e-5add-4d0f-bd33-31f3be242c5c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113182', 'lastCheck': '7.6', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109254', 'lastCheck': '9.5', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00085981', 'lastCheck': '3.1', 'valid': True}} >Thread-5186::DEBUG::2014-09-09 12:20:10,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`29b9570e-5add-4d0f-bd33-31f3be242c5c`::moving from state preparing -> state finished >Thread-5186::DEBUG::2014-09-09 12:20:10,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5186::DEBUG::2014-09-09 12:20:10,457::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5186::DEBUG::2014-09-09 12:20:10,457::task::993::Storage.TaskManager.Task::(_decref) Task=`29b9570e-5add-4d0f-bd33-31f3be242c5c`::ref 0 aborting False >Thread-5186::DEBUG::2014-09-09 12:20:10,460::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:10,461::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:10,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5187::DEBUG::2014-09-09 12:20:10,462::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5187::DEBUG::2014-09-09 12:20:10,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`83c0d38b-7eae-436c-8a88-231178af63fb`::moving from state init -> state preparing >Thread-5187::INFO::2014-09-09 12:20:10,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5187::DEBUG::2014-09-09 12:20:10,463::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0eba6ef0-5ca2-4177-9145-cdebf7258434`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5187::DEBUG::2014-09-09 12:20:10,463::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5187::DEBUG::2014-09-09 12:20:10,463::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5187::DEBUG::2014-09-09 12:20:10,463::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`0eba6ef0-5ca2-4177-9145-cdebf7258434`::Granted request >Thread-5187::DEBUG::2014-09-09 12:20:10,464::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`83c0d38b-7eae-436c-8a88-231178af63fb`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5187::DEBUG::2014-09-09 12:20:10,464::task::993::Storage.TaskManager.Task::(_decref) Task=`83c0d38b-7eae-436c-8a88-231178af63fb`::ref 1 aborting False >Thread-5187::INFO::2014-09-09 12:20:10,465::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5187::DEBUG::2014-09-09 12:20:10,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`83c0d38b-7eae-436c-8a88-231178af63fb`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5187::DEBUG::2014-09-09 12:20:10,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`83c0d38b-7eae-436c-8a88-231178af63fb`::moving from state preparing -> state finished >Thread-5187::DEBUG::2014-09-09 12:20:10,466::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5187::DEBUG::2014-09-09 12:20:10,466::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5187::DEBUG::2014-09-09 12:20:10,466::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5187::DEBUG::2014-09-09 12:20:10,466::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5187::DEBUG::2014-09-09 12:20:10,466::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5187::DEBUG::2014-09-09 12:20:10,466::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5187::DEBUG::2014-09-09 12:20:10,467::task::993::Storage.TaskManager.Task::(_decref) Task=`83c0d38b-7eae-436c-8a88-231178af63fb`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:10,467::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5187::DEBUG::2014-09-09 12:20:10,468::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >JsonRpcServer::DEBUG::2014-09-09 12:20:10,469::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5187::DEBUG::2014-09-09 12:20:10,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-5188::DEBUG::2014-09-09 12:20:10,471::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:10,958::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:10,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:10,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:10,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:10,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:10,959::__init__::225::IOProcess::(_processLogs) (10812) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:10,959::__init__::225::IOProcess::(_processLogs) (10812) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:10,959::__init__::225::IOProcess::(_processLogs) (10812) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:10,959::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:20:10,960::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:20:10,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000955963 s, 573 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) (10813) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:10,968::__init__::225::IOProcess::(_processLogs) (10813) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:10,969::__init__::225::IOProcess::(_processLogs) (10813) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:10,969::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:20:10,969::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) (10814) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) (10814) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) (10814) Building response >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) (10814) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:10,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:10,971::__init__::225::IOProcess::(_processLogs) (10815) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) (10815) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) (10815) Building response >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) (10815) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:10,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:10,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:10,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:10,973::__init__::225::IOProcess::(_processLogs) (10816) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:10,973::__init__::225::IOProcess::(_processLogs) (10816) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:10,973::__init__::225::IOProcess::(_processLogs) (10816) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:10,973::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:20:12,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:12,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0937445 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) (10817) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:12,821::__init__::225::IOProcess::(_processLogs) (10817) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:12,822::__init__::225::IOProcess::(_processLogs) (10817) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:12,822::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:20:12,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:20:12,831::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111896 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:12,831::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:12,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:12,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:12,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:12,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:12,832::__init__::225::IOProcess::(_processLogs) (10818) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:12,832::__init__::225::IOProcess::(_processLogs) (10818) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:12,832::__init__::225::IOProcess::(_processLogs) (10818) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:12,832::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:13,622::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:13,623::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5189::DEBUG::2014-09-09 12:20:13,624::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:14,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:14,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894702 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:16,627::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:16,628::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5190::DEBUG::2014-09-09 12:20:16,629::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:16,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:16,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894477 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) (10819) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:17,320::__init__::225::IOProcess::(_processLogs) (10819) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:17,321::__init__::225::IOProcess::(_processLogs) (10819) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:17,321::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:20:17,321::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:20:17,329::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.00102033 s, 348 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:17,329::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) (10820) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) (10820) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:17,330::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10820) Building response >Thread-19::DEBUG::2014-09-09 12:20:17,331::__init__::225::IOProcess::(_processLogs) (10820) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:17,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:17,331::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:20:18,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:18,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895692 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:19,634::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:19,636::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5191::DEBUG::2014-09-09 12:20:19,638::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:20,606::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:20,606::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5192::DEBUG::2014-09-09 12:20:20,606::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5192::DEBUG::2014-09-09 12:20:20,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a6f33e3-2e79-4d35-8deb-cf6fbbf459cc`::moving from state init -> state preparing >Thread-5192::INFO::2014-09-09 12:20:20,607::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5192::INFO::2014-09-09 12:20:20,608::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5192::DEBUG::2014-09-09 12:20:20,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a6f33e3-2e79-4d35-8deb-cf6fbbf459cc`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5192::DEBUG::2014-09-09 12:20:20,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a6f33e3-2e79-4d35-8deb-cf6fbbf459cc`::moving from state preparing -> state finished >Thread-5192::DEBUG::2014-09-09 12:20:20,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5192::DEBUG::2014-09-09 12:20:20,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5192::DEBUG::2014-09-09 12:20:20,608::task::993::Storage.TaskManager.Task::(_decref) Task=`5a6f33e3-2e79-4d35-8deb-cf6fbbf459cc`::ref 0 aborting False >Thread-5192::DEBUG::2014-09-09 12:20:20,608::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5192::DEBUG::2014-09-09 12:20:20,608::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:20,637::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:20,638::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5193::DEBUG::2014-09-09 12:20:20,638::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5193::DEBUG::2014-09-09 12:20:20,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b0abb8a-3cae-4800-8f58-cb1e4308f514`::moving from state init -> state preparing >Thread-5193::INFO::2014-09-09 12:20:20,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5193::DEBUG::2014-09-09 12:20:20,639::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8aeb4211-192d-4bd7-af18-7cba1f368f89`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5193::DEBUG::2014-09-09 12:20:20,639::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5193::DEBUG::2014-09-09 12:20:20,639::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5193::DEBUG::2014-09-09 12:20:20,640::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8aeb4211-192d-4bd7-af18-7cba1f368f89`::Granted request >Thread-5193::DEBUG::2014-09-09 12:20:20,640::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7b0abb8a-3cae-4800-8f58-cb1e4308f514`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5193::DEBUG::2014-09-09 12:20:20,640::task::993::Storage.TaskManager.Task::(_decref) Task=`7b0abb8a-3cae-4800-8f58-cb1e4308f514`::ref 1 aborting False >Thread-5193::INFO::2014-09-09 12:20:20,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5193::DEBUG::2014-09-09 12:20:20,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b0abb8a-3cae-4800-8f58-cb1e4308f514`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5193::DEBUG::2014-09-09 12:20:20,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b0abb8a-3cae-4800-8f58-cb1e4308f514`::moving from state preparing -> state finished >Thread-5193::DEBUG::2014-09-09 12:20:20,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5193::DEBUG::2014-09-09 12:20:20,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5193::DEBUG::2014-09-09 12:20:20,642::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5193::DEBUG::2014-09-09 12:20:20,642::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5193::DEBUG::2014-09-09 12:20:20,642::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5193::DEBUG::2014-09-09 12:20:20,642::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5193::DEBUG::2014-09-09 12:20:20,642::task::993::Storage.TaskManager.Task::(_decref) Task=`7b0abb8a-3cae-4800-8f58-cb1e4308f514`::ref 0 aborting False >Thread-5193::DEBUG::2014-09-09 12:20:20,642::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5193::DEBUG::2014-09-09 12:20:20,643::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:20,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-09-09 12:20:20,974::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:20,974::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:20,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:20,975::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:20,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:20,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:20,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:20,975::__init__::225::IOProcess::(_processLogs) (10821) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:20,975::__init__::225::IOProcess::(_processLogs) (10821) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:20,981::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10821) Building response >Thread-19::DEBUG::2014-09-09 12:20:20,981::__init__::225::IOProcess::(_processLogs) (10821) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:20,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:20,982::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:20:20,984::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:20,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0976454 s, 10.5 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-09-09 12:20:20,992::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000880541 s, 622 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:20,994::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:20,994::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:20,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:20,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:20,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:20,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:20,996::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:20,997::__init__::225::IOProcess::(_processLogs) (10822) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:20,998::__init__::225::IOProcess::(_processLogs) (10822) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:20,998::__init__::225::IOProcess::(_processLogs) (10822) Building response >Thread-19::DEBUG::2014-09-09 12:20:20,998::__init__::225::IOProcess::(_processLogs) (10822) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:20,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:20,999::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:20:21,000::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:21,000::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:20:21,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:21,001::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:21,001::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:21,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:21,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:21,003::__init__::225::IOProcess::(_processLogs) (10823) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:21,003::__init__::225::IOProcess::(_processLogs) (10823) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:21,003::__init__::225::IOProcess::(_processLogs) (10823) Building response >Thread-19::DEBUG::2014-09-09 12:20:21,004::__init__::225::IOProcess::(_processLogs) (10823) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:21,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:21,004::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:21,005::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:21,005::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:20:21,006::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:21,007::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:21,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:21,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:21,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:21,008::__init__::225::IOProcess::(_processLogs) (10824) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:21,008::__init__::225::IOProcess::(_processLogs) (10824) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:21,009::__init__::225::IOProcess::(_processLogs) (10824) Building response >Thread-19::DEBUG::2014-09-09 12:20:21,009::__init__::225::IOProcess::(_processLogs) (10824) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:21,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:21,010::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:21,010::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:21,011::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:20:21,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:21,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:21,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:21,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:21,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:21,013::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(10825) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:21,014::__init__::225::IOProcess::(_processLogs) (10825) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:21,014::__init__::225::IOProcess::(_processLogs) (10825) Building response >Thread-19::DEBUG::2014-09-09 12:20:21,014::__init__::225::IOProcess::(_processLogs) (10825) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:21,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:21,015::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:22,645::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:22,646::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5194::DEBUG::2014-09-09 12:20:22,647::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:22,833::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:22,833::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:22,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) (10826) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) (10826) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:22,834::__init__::225::IOProcess::(_processLogs) DEBUG|(10826) Building response >Thread-19::DEBUG::2014-09-09 12:20:22,835::__init__::225::IOProcess::(_processLogs) (10826) Queuing response >Thread-23::DEBUG::2014-09-09 12:20:22,835::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:20:22,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:22,840::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:20:22,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00106126 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:22,843::__init__::225::IOProcess::(_processLogs) (10827) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:22,844::__init__::225::IOProcess::(_processLogs) (10827) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:22,844::__init__::225::IOProcess::(_processLogs) DEBUG|(10827) Building response >Thread-19::DEBUG::2014-09-09 12:20:22,844::__init__::225::IOProcess::(_processLogs) (10827) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:22,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:22,845::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:20:23,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:23,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895134 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:20:25,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:25,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895796 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:25,653::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:25,654::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5195::DEBUG::2014-09-09 12:20:25,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16c50c3-1f0d-4296-a070-944aa54c71fc`::moving from state init -> state preparing >Thread-5195::INFO::2014-09-09 12:20:25,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5195::INFO::2014-09-09 12:20:25,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106126', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000880541', 'lastCheck': '4.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102033', 'lastCheck': '8.3', 'valid': True}} >Thread-5195::DEBUG::2014-09-09 12:20:25,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`f16c50c3-1f0d-4296-a070-944aa54c71fc`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00106126', 'lastCheck': '2.8', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000880541', 'lastCheck': '4.6', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00102033', 'lastCheck': '8.3', 'valid': True}} >Thread-5195::DEBUG::2014-09-09 12:20:25,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16c50c3-1f0d-4296-a070-944aa54c71fc`::moving from state preparing -> state finished >Thread-5195::DEBUG::2014-09-09 12:20:25,656::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5195::DEBUG::2014-09-09 12:20:25,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5195::DEBUG::2014-09-09 12:20:25,656::task::993::Storage.TaskManager.Task::(_decref) Task=`f16c50c3-1f0d-4296-a070-944aa54c71fc`::ref 0 aborting False >Thread-5195::DEBUG::2014-09-09 12:20:25,657::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:25,663::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:25,664::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5196::DEBUG::2014-09-09 12:20:25,665::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:27,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:27,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896078 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:27,332::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:27,332::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:27,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:27,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:27,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:27,332::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:27,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:27,333::__init__::225::IOProcess::(_processLogs) (10828) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:27,333::__init__::225::IOProcess::(_processLogs) (10828) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:27,333::__init__::225::IOProcess::(_processLogs) DEBUG|(10828) Building response >Thread-19::DEBUG::2014-09-09 12:20:27,333::__init__::225::IOProcess::(_processLogs) (10828) Queuing response >Thread-3443::DEBUG::2014-09-09 12:20:27,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:20:27,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:27,339::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:20:27,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000858998 s, 413 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:27,341::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) (10829) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) (10829) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) DEBUG|(10829) Building response >Thread-19::DEBUG::2014-09-09 12:20:27,342::__init__::225::IOProcess::(_processLogs) (10829) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:27,343::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:27,343::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:28,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:28,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5197::DEBUG::2014-09-09 12:20:28,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:29,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:29,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894558 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:30,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5198::DEBUG::2014-09-09 12:20:30,682::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:20:30,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5198::DEBUG::2014-09-09 12:20:30,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`be19c524-c0ed-41d8-9d78-eec9ac2f87b3`::moving from state init -> state preparing >Thread-5198::INFO::2014-09-09 12:20:30,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5198::INFO::2014-09-09 12:20:30,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5198::DEBUG::2014-09-09 12:20:30,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`be19c524-c0ed-41d8-9d78-eec9ac2f87b3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5198::DEBUG::2014-09-09 12:20:30,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`be19c524-c0ed-41d8-9d78-eec9ac2f87b3`::moving from state preparing -> state finished >Thread-5198::DEBUG::2014-09-09 12:20:30,683::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5198::DEBUG::2014-09-09 12:20:30,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5198::DEBUG::2014-09-09 12:20:30,683::task::993::Storage.TaskManager.Task::(_decref) Task=`be19c524-c0ed-41d8-9d78-eec9ac2f87b3`::ref 0 aborting False >Thread-5198::DEBUG::2014-09-09 12:20:30,684::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5198::DEBUG::2014-09-09 12:20:30,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:30,798::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5199::DEBUG::2014-09-09 12:20:30,798::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:20:30,798::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5199::DEBUG::2014-09-09 12:20:30,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`10a26fbe-c709-4221-ac21-c8b853492589`::moving from state init -> state preparing >Thread-5199::INFO::2014-09-09 12:20:30,799::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5199::DEBUG::2014-09-09 12:20:30,799::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c938f657-f2e6-4377-bc52-306115e98028`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5199::DEBUG::2014-09-09 12:20:30,800::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5199::DEBUG::2014-09-09 12:20:30,800::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5199::DEBUG::2014-09-09 12:20:30,800::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`c938f657-f2e6-4377-bc52-306115e98028`::Granted request >Thread-5199::DEBUG::2014-09-09 12:20:30,800::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`10a26fbe-c709-4221-ac21-c8b853492589`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5199::DEBUG::2014-09-09 12:20:30,800::task::993::Storage.TaskManager.Task::(_decref) Task=`10a26fbe-c709-4221-ac21-c8b853492589`::ref 1 aborting False >Thread-5199::INFO::2014-09-09 12:20:30,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5199::DEBUG::2014-09-09 12:20:30,802::task::1191::Storage.TaskManager.Task::(prepare) Task=`10a26fbe-c709-4221-ac21-c8b853492589`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5199::DEBUG::2014-09-09 12:20:30,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`10a26fbe-c709-4221-ac21-c8b853492589`::moving from state preparing -> state finished >Thread-5199::DEBUG::2014-09-09 12:20:30,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5199::DEBUG::2014-09-09 12:20:30,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5199::DEBUG::2014-09-09 12:20:30,802::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5199::DEBUG::2014-09-09 12:20:30,802::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5199::DEBUG::2014-09-09 12:20:30,802::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5199::DEBUG::2014-09-09 12:20:30,802::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5199::DEBUG::2014-09-09 12:20:30,803::task::993::Storage.TaskManager.Task::(_decref) Task=`10a26fbe-c709-4221-ac21-c8b853492589`::ref 0 aborting False >Thread-5199::DEBUG::2014-09-09 12:20:30,803::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5199::DEBUG::2014-09-09 12:20:30,803::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:31,014::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:31,014::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:31,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:31,014::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:31,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:31,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:31,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:31,015::__init__::225::IOProcess::(_processLogs) (10830) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:31,015::__init__::225::IOProcess::(_processLogs) (10830) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:31,015::__init__::225::IOProcess::(_processLogs) DEBUG|(10830) Building response >Thread-19::DEBUG::2014-09-09 12:20:31,015::__init__::225::IOProcess::(_processLogs) (10830) Queuing response >Thread-24::DEBUG::2014-09-09 12:20:31,016::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:20:31,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:31,021::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:20:31,024::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000975488 s, 562 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:31,024::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:31,024::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:31,024::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:31,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:31,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:31,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:31,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:31,025::__init__::225::IOProcess::(_processLogs) (10831) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:31,025::__init__::225::IOProcess::(_processLogs) (10831) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:31,025::__init__::225::IOProcess::(_processLogs) DEBUG|(10831) Building response >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) (10831) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:31,026::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) (10832) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) (10832) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) (10832) Building response >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) (10832) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:31,027::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) (10833) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:31,028::__init__::225::IOProcess::(_processLogs) (10833) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) (10833) Building response >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) (10833) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:31,029::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) (10834) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) (10834) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) (10834) Building response >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) (10834) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:31,030::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:20:31,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:31,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894752 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:31,798::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:31,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5200::DEBUG::2014-09-09 12:20:31,800::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:32,845::__init__::225::IOProcess::(_processLogs) (10835) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:32,846::__init__::225::IOProcess::(_processLogs) (10835) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:32,846::__init__::225::IOProcess::(_processLogs) DEBUG|(10835) Building response >Thread-19::DEBUG::2014-09-09 12:20:32,846::__init__::225::IOProcess::(_processLogs) (10835) Queuing response >Thread-23::DEBUG::2014-09-09 12:20:32,846::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:20:32,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:32,852::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:20:32,854::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107427 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:32,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) (10836) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) (10836) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) DEBUG|(10836) Building response >Thread-19::DEBUG::2014-09-09 12:20:32,855::__init__::225::IOProcess::(_processLogs) (10836) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:32,856::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:32,856::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:20:33,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:33,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897095 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:34,806::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:34,807::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5201::DEBUG::2014-09-09 12:20:34,808::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:35,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:35,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894741 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) (10837) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:37,344::__init__::225::IOProcess::(_processLogs) (10837) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:37,346::__init__::225::IOProcess::(_processLogs) (10837) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:37,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:37,346::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:20:37,347::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:20:37,354::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000933208 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:37,355::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:37,355::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:37,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:37,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:37,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:37,355::__init__::225::IOProcess::(_processLogs) (10838) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:37,356::__init__::225::IOProcess::(_processLogs) (10838) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:37,356::__init__::225::IOProcess::(_processLogs) (10838) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:37,356::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:20:37,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:37,822::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:37,822::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5202::DEBUG::2014-09-09 12:20:37,823::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:37,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895032 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:20:39,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:39,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896182 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:40,828::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:40,828::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5203::DEBUG::2014-09-09 12:20:40,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b077ef7-ddd8-45ec-aac9-845e86ba8fa5`::moving from state init -> state preparing >Thread-5203::INFO::2014-09-09 12:20:40,830::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5203::INFO::2014-09-09 12:20:40,831::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107427', 'lastCheck': '8.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000975488', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933208', 'lastCheck': '3.5', 'valid': True}} >Thread-5203::DEBUG::2014-09-09 12:20:40,831::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b077ef7-ddd8-45ec-aac9-845e86ba8fa5`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107427', 'lastCheck': '8.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000975488', 'lastCheck': '9.8', 'valid': True}, u'85442237-be11-4bd0-b6c3-43ba60c1b87f': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000933208', 'lastCheck': '3.5', 'valid': True}} >Thread-5203::DEBUG::2014-09-09 12:20:40,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b077ef7-ddd8-45ec-aac9-845e86ba8fa5`::moving from state preparing -> state finished >Thread-5203::DEBUG::2014-09-09 12:20:40,831::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5203::DEBUG::2014-09-09 12:20:40,831::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5203::DEBUG::2014-09-09 12:20:40,831::task::993::Storage.TaskManager.Task::(_decref) Task=`3b077ef7-ddd8-45ec-aac9-845e86ba8fa5`::ref 0 aborting False >Thread-5203::DEBUG::2014-09-09 12:20:40,832::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:40,842::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:40,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5204::DEBUG::2014-09-09 12:20:40,843::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:40,999::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:41,000::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5205::DEBUG::2014-09-09 12:20:40,999::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5205::DEBUG::2014-09-09 12:20:41,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`b867205a-d00a-4b47-8650-17cdb1f33e56`::moving from state init -> state preparing >Thread-5205::INFO::2014-09-09 12:20:41,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5205::INFO::2014-09-09 12:20:41,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5205::DEBUG::2014-09-09 12:20:41,001::task::1191::Storage.TaskManager.Task::(prepare) Task=`b867205a-d00a-4b47-8650-17cdb1f33e56`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5205::DEBUG::2014-09-09 12:20:41,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`b867205a-d00a-4b47-8650-17cdb1f33e56`::moving from state preparing -> state finished >Thread-5205::DEBUG::2014-09-09 12:20:41,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5205::DEBUG::2014-09-09 12:20:41,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5205::DEBUG::2014-09-09 12:20:41,001::task::993::Storage.TaskManager.Task::(_decref) Task=`b867205a-d00a-4b47-8650-17cdb1f33e56`::ref 0 aborting False >Thread-5205::DEBUG::2014-09-09 12:20:41,001::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5205::DEBUG::2014-09-09 12:20:41,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:41,016::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:41,016::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5206::DEBUG::2014-09-09 12:20:41,016::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5206::DEBUG::2014-09-09 12:20:41,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`60cda7bc-2b38-4eb5-8174-f155a342c33e`::moving from state init -> state preparing >Thread-5206::INFO::2014-09-09 12:20:41,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5206::DEBUG::2014-09-09 12:20:41,017::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8da238ed-b5c4-474a-8d5c-5f6e595aee4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5206::DEBUG::2014-09-09 12:20:41,018::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5206::DEBUG::2014-09-09 12:20:41,018::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5206::DEBUG::2014-09-09 12:20:41,018::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8da238ed-b5c4-474a-8d5c-5f6e595aee4e`::Granted request >Thread-5206::DEBUG::2014-09-09 12:20:41,018::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`60cda7bc-2b38-4eb5-8174-f155a342c33e`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5206::DEBUG::2014-09-09 12:20:41,018::task::993::Storage.TaskManager.Task::(_decref) Task=`60cda7bc-2b38-4eb5-8174-f155a342c33e`::ref 1 aborting False >Thread-5206::INFO::2014-09-09 12:20:41,020::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5206::DEBUG::2014-09-09 12:20:41,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`60cda7bc-2b38-4eb5-8174-f155a342c33e`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5206::DEBUG::2014-09-09 12:20:41,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`60cda7bc-2b38-4eb5-8174-f155a342c33e`::moving from state preparing -> state finished >Thread-5206::DEBUG::2014-09-09 12:20:41,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5206::DEBUG::2014-09-09 12:20:41,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5206::DEBUG::2014-09-09 12:20:41,020::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5206::DEBUG::2014-09-09 12:20:41,020::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5206::DEBUG::2014-09-09 12:20:41,020::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5206::DEBUG::2014-09-09 12:20:41,020::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5206::DEBUG::2014-09-09 12:20:41,021::task::993::Storage.TaskManager.Task::(_decref) Task=`60cda7bc-2b38-4eb5-8174-f155a342c33e`::ref 0 aborting False >Thread-5206::DEBUG::2014-09-09 12:20:41,021::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5206::DEBUG::2014-09-09 12:20:41,021::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:41,030::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:41,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:41,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:41,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:41,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:41,031::__init__::225::IOProcess::(_processLogs) (10839) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:41,031::__init__::225::IOProcess::(_processLogs) (10839) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:41,031::__init__::225::IOProcess::(_processLogs) (10839) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:41,031::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:20:41,032::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:20:41,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n548 bytes (548 B) copied, 0.000899674 s, 609 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) (10840) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:41,040::__init__::225::IOProcess::(_processLogs) (10840) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:41,041::__init__::225::IOProcess::(_processLogs) DEBUG|(10840) Building response >Thread-19::DEBUG::2014-09-09 12:20:41,041::__init__::225::IOProcess::(_processLogs) (10840) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:41,041::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:41,041::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:41,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) (10841) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) (10841) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) (10841) Building response >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) (10841) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:41,043::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) (10842) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) (10842) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) (10842) Building response >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) (10842) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:41,044::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:41,045::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:41,045::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:20:41,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:41,045::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:41,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:41,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) (10843) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) (10843) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) (10843) Building response >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) (10843) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:41,046::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:20:41,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:42,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895782 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:42,857::__init__::225::IOProcess::(_processLogs) (10844) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:42,858::__init__::225::IOProcess::(_processLogs) (10844) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:42,858::__init__::225::IOProcess::(_processLogs) DEBUG|(10844) Building response >Thread-19::DEBUG::2014-09-09 12:20:42,859::__init__::225::IOProcess::(_processLogs) (10844) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:42,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:42,859::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:20:42,859::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:20:42,867::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114639 s, 980 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:42,867::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) (10845) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) (10845) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) (10845) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:42,868::__init__::225::IOProcess::(_processLogs) Generating json... >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:43,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:43,921::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5207::DEBUG::2014-09-09 12:20:43,922::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:44,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:44,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895801 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:20:46,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:46,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896209 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:46,929::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:46,929::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5208::DEBUG::2014-09-09 12:20:46,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) (10846) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:47,357::__init__::225::IOProcess::(_processLogs) (10846) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:47,358::__init__::225::IOProcess::(_processLogs) DEBUG|(10846) Building response >Thread-19::DEBUG::2014-09-09 12:20:47,358::__init__::225::IOProcess::(_processLogs) (10846) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:47,358::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:47,358::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-3443::DEBUG::2014-09-09 12:20:47,358::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-3443::DEBUG::2014-09-09 12:20:47,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n355 bytes (355 B) copied, 0.000924973 s, 384 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:47,366::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:47,366::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:20:47,366::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) (10847) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) (10847) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) DEBUG|(10847) Building response >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) (10847) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:47,367::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:47,368::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:20:48,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:48,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897612 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:49,738::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5209::DEBUG::2014-09-09 12:20:49,740::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.deactivate' in bridge with {u'masterVersion': 1, u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'masterSdUUID': u'00000000-0000-0000-0000-000000000000', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >JsonRpcServer::DEBUG::2014-09-09 12:20:49,740::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5209::DEBUG::2014-09-09 12:20:49,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::moving from state init -> state preparing >Thread-5209::INFO::2014-09-09 12:20:49,743::logUtils::44::dispatcher::(wrapper) Run and protect: deactivateStorageDomain(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', msdUUID=u'00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-5209::DEBUG::2014-09-09 12:20:49,744::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca88fe63-b836-4506-a096-95d0ff1b3cb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1227' at 'deactivateStorageDomain' >Thread-5209::DEBUG::2014-09-09 12:20:49,745::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-5209::DEBUG::2014-09-09 12:20:49,746::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-5209::DEBUG::2014-09-09 12:20:49,746::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ca88fe63-b836-4506-a096-95d0ff1b3cb5`::Granted request >Thread-5209::DEBUG::2014-09-09 12:20:49,748::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (exclusive) >Thread-5209::DEBUG::2014-09-09 12:20:49,748::task::993::Storage.TaskManager.Task::(_decref) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::ref 1 aborting False >Thread-5209::DEBUG::2014-09-09 12:20:49,749::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`e2497881-d2d4-4af1-ae6f-5f3f1a15c4b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1228' at 'deactivateStorageDomain' >Thread-5209::DEBUG::2014-09-09 12:20:49,750::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'exclusive' >Thread-5209::DEBUG::2014-09-09 12:20:49,750::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'exclusive' (1 active user) >Thread-5209::DEBUG::2014-09-09 12:20:49,751::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`e2497881-d2d4-4af1-ae6f-5f3f1a15c4b1`::Granted request >Thread-5209::DEBUG::2014-09-09 12:20:49,752::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (exclusive) >Thread-5209::DEBUG::2014-09-09 12:20:49,752::task::993::Storage.TaskManager.Task::(_decref) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::ref 1 aborting False >Thread-5209::INFO::2014-09-09 12:20:49,753::sp::1070::Storage.StoragePool::(deactivateSD) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f spUUID=5745e11d-81b4-4d82-8fed-c8a22ec23383 newMsdUUID=00000000-0000-0000-0000-000000000000 >Thread-5209::DEBUG::2014-09-09 12:20:49,760::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-5209::DEBUG::2014-09-09 12:20:49,761::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-5209::DEBUG::2014-09-09 12:20:49,762::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=245807057b0dd8f851cc6ad4982d74153eb3f5dd'] >Thread-19::DEBUG::2014-09-09 12:20:49,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:49,763::__init__::225::IOProcess::(_processLogs) Message size is 936 >Thread-19::DEBUG::2014-09-09 12:20:49,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:49,764::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:49,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:49,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:49,766::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:49,766::__init__::225::IOProcess::(_processLogs) (10848) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 12:20:49,766::__init__::225::IOProcess::(_processLogs) (10848) Got request for method 'writefile' >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:49,938::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:49,940::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5210::DEBUG::2014-09-09 12:20:49,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:49,978::__init__::225::IOProcess::(_processLogs) DEBUG|(10848) Building response >Thread-19::DEBUG::2014-09-09 12:20:49,979::__init__::225::IOProcess::(_processLogs) (10848) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:49,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:49,979::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-5209::WARNING::2014-09-09 12:20:49,980::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 12:20:49,982::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:49,982::__init__::225::IOProcess::(_processLogs) Message size is 291 >Thread-19::DEBUG::2014-09-09 12:20:49,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:49,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:49,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:49,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:49,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:49,985::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'... >Thread-5209::DEBUG::2014-09-09 12:20:49,985::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-19::DEBUG::2014-09-09 12:20:49,986::__init__::225::IOProcess::(_processLogs) (10849) Got request for method 'rename' >Thread-5209::DEBUG::2014-09-09 12:20:49,986::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-19::DEBUG::2014-09-09 12:20:49,987::__init__::225::IOProcess::(_processLogs) (10849) Building response >Thread-5209::DEBUG::2014-09-09 12:20:49,987::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-19::DEBUG::2014-09-09 12:20:49,988::__init__::225::IOProcess::(_processLogs) (10849) Queuing response >Thread-5209::INFO::2014-09-09 12:20:49,989::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:20:49,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-3443::DEBUG::2014-09-09 12:20:49,990::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:20:49,991::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-3443::DEBUG::2014-09-09 12:20:49,991::clusterlock::116::Storage.SafeLease::(releaseHostId) Host id for domain 85442237-be11-4bd0-b6c3-43ba60c1b87f released successfully (id: 2) >Thread-5209::DEBUG::2014-09-09 12:20:49,992::sp::1407::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `5745e11d-81b4-4d82-8fed-c8a22ec23383` stopped monitoring domain `85442237-be11-4bd0-b6c3-43ba60c1b87f` >Thread-5209::DEBUG::2014-09-09 12:20:49,992::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5209::INFO::2014-09-09 12:20:49,993::logUtils::47::dispatcher::(wrapper) Run and protect: deactivateStorageDomain, Return response: None >Thread-5209::DEBUG::2014-09-09 12:20:49,993::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::finished: None >Thread-5209::DEBUG::2014-09-09 12:20:49,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::moving from state preparing -> state finished >Thread-5209::DEBUG::2014-09-09 12:20:49,994::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>, u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-5209::DEBUG::2014-09-09 12:20:49,994::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5209::DEBUG::2014-09-09 12:20:49,995::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5209::DEBUG::2014-09-09 12:20:49,996::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5209::DEBUG::2014-09-09 12:20:49,996::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5209::DEBUG::2014-09-09 12:20:49,996::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5209::DEBUG::2014-09-09 12:20:49,997::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-5209::DEBUG::2014-09-09 12:20:49,998::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-5209::DEBUG::2014-09-09 12:20:49,998::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-5209::DEBUG::2014-09-09 12:20:49,999::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-5209::DEBUG::2014-09-09 12:20:50,000::task::993::Storage.TaskManager.Task::(_decref) Task=`fbc8c0d3-760f-4277-bc93-ea8c1a9f6c16`::ref 0 aborting False >Thread-5209::DEBUG::2014-09-09 12:20:50,000::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.deactivate' in bridge with True >Thread-5209::DEBUG::2014-09-09 12:20:50,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:50,012::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:50,014::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5211::DEBUG::2014-09-09 12:20:50,014::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connect' in bridge with {u'masterVersion': 1, u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'scsiKey': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'masterSdUUID': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', u'hostID': 2} >Thread-5211::DEBUG::2014-09-09 12:20:50,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e263c4c-891e-4f6a-9faa-0d6e820e62e6`::moving from state init -> state preparing >Thread-5211::INFO::2014-09-09 12:20:50,016::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', hostID=2, msdUUID=u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', masterVersion=1, domainsMap=None, options=None) >Thread-5211::DEBUG::2014-09-09 12:20:50,018::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`8f25fda8-6bd0-4b2c-90d8-9ca035ce8dba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-5211::DEBUG::2014-09-09 12:20:50,018::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-5211::DEBUG::2014-09-09 12:20:50,019::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-5211::DEBUG::2014-09-09 12:20:50,019::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`8f25fda8-6bd0-4b2c-90d8-9ca035ce8dba`::Granted request >Thread-5211::DEBUG::2014-09-09 12:20:50,021::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8578477c-757f-4df6-922f-2a63aea68b27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-5211::DEBUG::2014-09-09 12:20:50,021::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5211::DEBUG::2014-09-09 12:20:50,022::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5211::DEBUG::2014-09-09 12:20:50,022::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`8578477c-757f-4df6-922f-2a63aea68b27`::Granted request >Thread-5211::DEBUG::2014-09-09 12:20:50,023::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,024::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,024::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,025::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,026::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,026::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,027::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-5211::DEBUG::2014-09-09 12:20:50,027::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5211::DEBUG::2014-09-09 12:20:50,028::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-5211::DEBUG::2014-09-09 12:20:50,028::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5211::DEBUG::2014-09-09 12:20:50,028::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-5211::DEBUG::2014-09-09 12:20:50,029::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-5211::DEBUG::2014-09-09 12:20:50,042::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5211::DEBUG::2014-09-09 12:20:50,044::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-5211::DEBUG::2014-09-09 12:20:50,083::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-5211::DEBUG::2014-09-09 12:20:50,084::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,085::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,086::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,086::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,087::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,088::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,089::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-09-09 12:20:50,092::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,093::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:20:50,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,096::__init__::225::IOProcess::(_processLogs) (10850) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,097::__init__::225::IOProcess::(_processLogs) (10850) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,097::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|(10850) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,098::__init__::225::IOProcess::(_processLogs) (10850) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,099::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:20:50,100::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,100::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:20:50,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,103::__init__::225::IOProcess::(_processLogs) (10851) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,104::__init__::225::IOProcess::(_processLogs) (10851) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,105::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|(10851) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,106::__init__::225::IOProcess::(_processLogs) (10851) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,108::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:20:50,110::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,111::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:20:50,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,113::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-5211::DEBUG::2014-09-09 12:20:50,115::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:20:50,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,117::__init__::225::IOProcess::(_processLogs) (10852) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,117::__init__::225::IOProcess::(_processLogs) (10852) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,118::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|(10852) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,119::__init__::225::IOProcess::(_processLogs) (10852) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,120::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:20:50,121::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,121::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 12:20:50,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,122::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,124::__init__::225::IOProcess::(_processLogs) (10853) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:20:50,124::__init__::225::IOProcess::(_processLogs) (10853) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:20:50,304::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|(10853) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,304::__init__::225::IOProcess::(_processLogs) (10853) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,304::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,304::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Sending response sized 57 >Thread-5211::DEBUG::2014-09-09 12:20:50,305::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:20:50,305::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,305::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 12:20:50,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,305::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,306::__init__::225::IOProcess::(_processLogs) (10854) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:20:50,306::__init__::225::IOProcess::(_processLogs) (10854) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:20:50,309::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|(10854) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,309::__init__::225::IOProcess::(_processLogs) (10854) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,309::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Generating json... >Thread-5211::DEBUG::2014-09-09 12:20:50,310::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=245807057b0dd8f851cc6ad4982d74153eb3f5dd'] >Thread-19::DEBUG::2014-09-09 12:20:50,310::__init__::225::IOProcess::(_processLogs) Sending response sized 791 >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) (10849) Finding callback 'rename'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,311::__init__::225::IOProcess::(_processLogs) (10855) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:50,312::__init__::225::IOProcess::(_processLogs) (10855) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:50,312::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|(10855) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) (10855) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,313::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,314::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,314::__init__::225::IOProcess::(_processLogs) (10856) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,314::__init__::225::IOProcess::(_processLogs) (10856) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,315::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|(10856) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,315::__init__::225::IOProcess::(_processLogs) (10856) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,315::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Generating json... >Thread-5211::DEBUG::2014-09-09 12:20:50,315::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:20:50,316::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-5211::INFO::2014-09-09 12:20:50,316::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-5211::INFO::2014-09-09 12:20:50,316::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-5211::DEBUG::2014-09-09 12:20:50,316::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf verified, version 1 >Thread-5211::DEBUG::2014-09-09 12:20:50,316::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-5211::DEBUG::2014-09-09 12:20:50,316::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5211::DEBUG::2014-09-09 12:20:50,316::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5211::DEBUG::2014-09-09 12:20:50,317::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-5211::WARNING::2014-09-09 12:20:50,317::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 already exists >Thread-5211::DEBUG::2014-09-09 12:20:50,317::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-5211::DEBUG::2014-09-09 12:20:50,317::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e453999e-ec9f-420b-941c-a9f9cc4432bb (cwd None) >Thread-5211::DEBUG::2014-09-09 12:20:50,338::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found\n Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb\n'; <rc> = 5 >Thread-5211::WARNING::2014-09-09 12:20:50,339::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!', ' Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found', ' Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb'] >Thread-5211::DEBUG::2014-09-09 12:20:50,339::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-09-09 12:20:50,341::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) (10857) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) (10857) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,342::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|(10857) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) (10857) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Message size is 175DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,343::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) (10858) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) (10858) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:50,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:50,345::__init__::225::IOProcess::(_processLogs) (10859) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:50,345::__init__::225::IOProcess::(_processLogs) (10859) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:50,345::__init__::225::IOProcess::(_processLogs) (10859) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,345::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:20:50,345::__init__::225::IOProcess::(_processLogs) (10858) Building response >Thread-19::DEBUG::2014-09-09 12:20:50,346::__init__::225::IOProcess::(_processLogs) (10858) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:50,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:50,346::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-5211::INFO::2014-09-09 12:20:50,346::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-5211::DEBUG::2014-09-09 12:20:50,346::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-5211::INFO::2014-09-09 12:20:50,346::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-5211::DEBUG::2014-09-09 12:20:50,346::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-5211::INFO::2014-09-09 12:20:50,347::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-5211::DEBUG::2014-09-09 12:20:50,347::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-5211::DEBUG::2014-09-09 12:20:50,347::sp::1221::Storage.StoragePool::(__rebuild) collecting stale storage domain link /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-5211::DEBUG::2014-09-09 12:20:50,347::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5211::DEBUG::2014-09-09 12:20:50,347::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5211::DEBUG::2014-09-09 12:20:50,347::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5211::DEBUG::2014-09-09 12:20:50,347::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5211::DEBUG::2014-09-09 12:20:50,347::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-5211::DEBUG::2014-09-09 12:20:50,347::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-5211::DEBUG::2014-09-09 12:20:50,348::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-5211::DEBUG::2014-09-09 12:20:50,348::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-5211::INFO::2014-09-09 12:20:50,348::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-5211::DEBUG::2014-09-09 12:20:50,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e263c4c-891e-4f6a-9faa-0d6e820e62e6`::finished: True >Thread-5211::DEBUG::2014-09-09 12:20:50,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e263c4c-891e-4f6a-9faa-0d6e820e62e6`::moving from state preparing -> state finished >Thread-5211::DEBUG::2014-09-09 12:20:50,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5211::DEBUG::2014-09-09 12:20:50,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5211::DEBUG::2014-09-09 12:20:50,348::task::993::Storage.TaskManager.Task::(_decref) Task=`9e263c4c-891e-4f6a-9faa-0d6e820e62e6`::ref 0 aborting False >Thread-5211::DEBUG::2014-09-09 12:20:50,348::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connect' in bridge with True >Thread-5211::DEBUG::2014-09-09 12:20:50,348::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:50,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:50,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:50,474::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5218::DEBUG::2014-09-09 12:20:50,475::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.disconnectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >Thread-5218::DEBUG::2014-09-09 12:20:50,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e45b9c7-133d-4e97-954f-b4cc3921fc99`::moving from state init -> state preparing >Thread-5218::INFO::2014-09-09 12:20:50,479::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-5218::DEBUG::2014-09-09 12:20:50,481::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:50,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103199 s, 9.9 MB/s\n'; <rc> = 0 >Thread-5218::DEBUG::2014-09-09 12:20:50,503::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-5218::DEBUG::2014-09-09 12:20:50,503::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5218::DEBUG::2014-09-09 12:20:50,503::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-5218::DEBUG::2014-09-09 12:20:50,503::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5218::DEBUG::2014-09-09 12:20:50,503::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-5218::DEBUG::2014-09-09 12:20:50,504::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-5218::DEBUG::2014-09-09 12:20:50,513::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5218::DEBUG::2014-09-09 12:20:50,515::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-5218::DEBUG::2014-09-09 12:20:50,531::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-5218::DEBUG::2014-09-09 12:20:50,532::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5218::DEBUG::2014-09-09 12:20:50,532::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5218::DEBUG::2014-09-09 12:20:50,532::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5218::DEBUG::2014-09-09 12:20:50,532::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5218::DEBUG::2014-09-09 12:20:50,532::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5218::DEBUG::2014-09-09 12:20:50,532::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5218::DEBUG::2014-09-09 12:20:50,533::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5218::INFO::2014-09-09 12:20:50,533::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-5218::DEBUG::2014-09-09 12:20:50,533::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e45b9c7-133d-4e97-954f-b4cc3921fc99`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-5218::DEBUG::2014-09-09 12:20:50,533::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e45b9c7-133d-4e97-954f-b4cc3921fc99`::moving from state preparing -> state finished >Thread-5218::DEBUG::2014-09-09 12:20:50,533::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5218::DEBUG::2014-09-09 12:20:50,533::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5218::DEBUG::2014-09-09 12:20:50,533::task::993::Storage.TaskManager.Task::(_decref) Task=`9e45b9c7-133d-4e97-954f-b4cc3921fc99`::ref 0 aborting False >Thread-5218::DEBUG::2014-09-09 12:20:50,533::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.disconnectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-5218::DEBUG::2014-09-09 12:20:50,534::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:51,046::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:51,046::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:51,046::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:51,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:51,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:51,046::__init__::225::IOProcess::(_processLogs) (10860) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:51,047::__init__::225::IOProcess::(_processLogs) (10860) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:51,047::__init__::225::IOProcess::(_processLogs) (10860) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:51,047::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:20:51,048::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:20:51,055::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n550 bytes (550 B) copied, 0.000940525 s, 585 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:51,056::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:20:51,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:51,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:51,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:51,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:51,057::__init__::225::IOProcess::(_processLogs) (10861) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:51,057::__init__::225::IOProcess::(_processLogs) (10861) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:51,057::__init__::225::IOProcess::(_processLogs) (10861) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:51,057::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) (10862) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:51,058::__init__::225::IOProcess::(_processLogs) (10862) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:51,059::__init__::225::IOProcess::(_processLogs) (10862) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:51,059::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:51,059::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:20:51,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:51,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:51,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:51,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:51,060::__init__::225::IOProcess::(_processLogs) (10863) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:51,060::__init__::225::IOProcess::(_processLogs) (10863) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:51,060::__init__::225::IOProcess::(_processLogs) (10863) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:51,061::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-19::DEBUG::2014-09-09 12:20:51,061::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:51,062::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpcServer::DEBUG::2014-09-09 12:20:51,062::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5219::DEBUG::2014-09-09 12:20:51,062::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-19::DEBUG::2014-09-09 12:20:51,065::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-5219::DEBUG::2014-09-09 12:20:51,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`7487112d-2031-4f26-818a-0f2ead337397`::moving from state init -> state preparing >Thread-19::DEBUG::2014-09-09 12:20:51,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-5219::INFO::2014-09-09 12:20:51,066::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-19::DEBUG::2014-09-09 12:20:51,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-5219::INFO::2014-09-09 12:20:51,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-19::DEBUG::2014-09-09 12:20:51,068::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-5219::DEBUG::2014-09-09 12:20:51,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`7487112d-2031-4f26-818a-0f2ead337397`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-19::DEBUG::2014-09-09 12:20:51,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-5219::DEBUG::2014-09-09 12:20:51,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`7487112d-2031-4f26-818a-0f2ead337397`::moving from state preparing -> state finished >Thread-5219::DEBUG::2014-09-09 12:20:51,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-09-09 12:20:51,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-5219::DEBUG::2014-09-09 12:20:51,070::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-09-09 12:20:51,071::__init__::225::IOProcess::(_processLogs) (10864) Finding callback 'access'... >Thread-5219::DEBUG::2014-09-09 12:20:51,071::task::993::Storage.TaskManager.Task::(_decref) Task=`7487112d-2031-4f26-818a-0f2ead337397`::ref 0 aborting False >Thread-19::DEBUG::2014-09-09 12:20:51,072::__init__::225::IOProcess::(_processLogs) (10864) Got request for method 'access' >Thread-5219::DEBUG::2014-09-09 12:20:51,072::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-19::DEBUG::2014-09-09 12:20:51,072::__init__::225::IOProcess::(_processLogs) (10864) Building response >Thread-5219::DEBUG::2014-09-09 12:20:51,073::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:20:51,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:51,075::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:51,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:51,085::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5220::DEBUG::2014-09-09 12:20:51,085::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5220::DEBUG::2014-09-09 12:20:51,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`04753b50-4b66-408b-a6dc-26c59781cf02`::moving from state init -> state preparing >Thread-5220::INFO::2014-09-09 12:20:51,085::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5220::DEBUG::2014-09-09 12:20:51,086::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`207ee903-8195-41a0-a667-612d3beb91ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5220::DEBUG::2014-09-09 12:20:51,086::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5220::DEBUG::2014-09-09 12:20:51,086::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5220::DEBUG::2014-09-09 12:20:51,086::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`207ee903-8195-41a0-a667-612d3beb91ba`::Granted request >Thread-5220::DEBUG::2014-09-09 12:20:51,086::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04753b50-4b66-408b-a6dc-26c59781cf02`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5220::DEBUG::2014-09-09 12:20:51,086::task::993::Storage.TaskManager.Task::(_decref) Task=`04753b50-4b66-408b-a6dc-26c59781cf02`::ref 1 aborting False >Thread-5220::INFO::2014-09-09 12:20:51,088::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-5220::DEBUG::2014-09-09 12:20:51,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`04753b50-4b66-408b-a6dc-26c59781cf02`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-5220::DEBUG::2014-09-09 12:20:51,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`04753b50-4b66-408b-a6dc-26c59781cf02`::moving from state preparing -> state finished >Thread-5220::DEBUG::2014-09-09 12:20:51,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5220::DEBUG::2014-09-09 12:20:51,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5220::DEBUG::2014-09-09 12:20:51,088::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5220::DEBUG::2014-09-09 12:20:51,088::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5220::DEBUG::2014-09-09 12:20:51,088::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5220::DEBUG::2014-09-09 12:20:51,088::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5220::DEBUG::2014-09-09 12:20:51,089::task::993::Storage.TaskManager.Task::(_decref) Task=`04753b50-4b66-408b-a6dc-26c59781cf02`::ref 0 aborting False >Thread-5220::DEBUG::2014-09-09 12:20:51,089::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-5220::DEBUG::2014-09-09 12:20:51,089::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:52,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:52,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897593 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:52,870::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) (10865) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) (10865) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:20:52,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,872::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,872::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,872::__init__::225::IOProcess::(_processLogs) (10866) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:52,872::__init__::225::IOProcess::(_processLogs) (10866) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:52,872::__init__::225::IOProcess::(_processLogs) (10865) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:52,873::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:20:52,873::__init__::225::IOProcess::(_processLogs) (10866) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,873::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:52,874::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-23::DEBUG::2014-09-09 12:20:52,876::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) (10867) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:20:52,876::__init__::225::IOProcess::(_processLogs) (10867) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:20:52,889::__init__::225::IOProcess::(_processLogs) (10867) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,890::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-23::DEBUG::2014-09-09 12:20:52,890::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:20:52,890::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 12:20:52,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,891::__init__::225::IOProcess::(_processLogs) (10868) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:20:52,891::__init__::225::IOProcess::(_processLogs) (10868) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:20:52,893::__init__::225::IOProcess::(_processLogs) (10868) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,893::__init__::225::IOProcess::(_processLogs) Sending response sized 1555 >Thread-23::DEBUG::2014-09-09 12:20:52,894::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 12:20:52,894::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 12:20:52,894::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) (10869) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) (10869) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) (10869) Building response >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) (10869) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:20:52,895::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) (10870) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:20:52,896::__init__::225::IOProcess::(_processLogs) (10870) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:20:52,897::__init__::225::IOProcess::(_processLogs) (10870) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,897::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-23::DEBUG::2014-09-09 12:20:52,897::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-23::INFO::2014-09-09 12:20:52,898::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 12:20:52,898::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:20:52,898::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:52,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,899::__init__::225::IOProcess::(_processLogs) (10871) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:52,899::__init__::225::IOProcess::(_processLogs) (10871) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:52,899::__init__::225::IOProcess::(_processLogs) (10871) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,899::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:20:52,900::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:20:52,907::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111838 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:20:52,907::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) (10872) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) (10872) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) (10872) Queuing response >Thread-19::DEBUG::2014-09-09 12:20:52,908::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:52,953::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:52,954::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5223::DEBUG::2014-09-09 12:20:52,955::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:54,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:54,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896133 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:55,962::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:55,963::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5224::DEBUG::2014-09-09 12:20:55,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`c953084f-7add-4f9f-a50f-6189cb87c4fb`::moving from state init -> state preparing >Thread-5224::INFO::2014-09-09 12:20:55,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5224::INFO::2014-09-09 12:20:55,964::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111838', 'lastCheck': '3.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000940525', 'lastCheck': '4.9', 'valid': True}} >Thread-5224::DEBUG::2014-09-09 12:20:55,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`c953084f-7add-4f9f-a50f-6189cb87c4fb`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111838', 'lastCheck': '3.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000940525', 'lastCheck': '4.9', 'valid': True}} >Thread-5224::DEBUG::2014-09-09 12:20:55,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`c953084f-7add-4f9f-a50f-6189cb87c4fb`::moving from state preparing -> state finished >Thread-5224::DEBUG::2014-09-09 12:20:55,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5224::DEBUG::2014-09-09 12:20:55,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5224::DEBUG::2014-09-09 12:20:55,965::task::993::Storage.TaskManager.Task::(_decref) Task=`c953084f-7add-4f9f-a50f-6189cb87c4fb`::ref 0 aborting False >Thread-5224::DEBUG::2014-09-09 12:20:55,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:55,978::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:55,978::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5225::DEBUG::2014-09-09 12:20:55,979::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:20:56,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:56,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895516 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:20:58,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:20:58,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897356 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:20:59,076::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:20:59,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5226::DEBUG::2014-09-09 12:20:59,078::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:00,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:01,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894933 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) (10873) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:01,075::__init__::225::IOProcess::(_processLogs) (10873) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:01,076::__init__::225::IOProcess::(_processLogs) (10873) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:01,076::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:21:01,076::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:21:01,085::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n550 bytes (550 B) copied, 0.000980556 s, 561 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:01,085::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) (10874) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) (10874) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) (10874) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:01,086::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:21:01,087::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:21:01,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) (10875) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) (10875) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) (10875) Building response >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) (10875) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:01,088::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) (10876) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) (10876) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:01,089::__init__::225::IOProcess::(_processLogs) (10876) Building response >Thread-19::DEBUG::2014-09-09 12:21:01,090::__init__::225::IOProcess::(_processLogs) (10876) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:01,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:01,090::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:01,090::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:21:01,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) (10877) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) (10877) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) (10877) Building response >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) (10877) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:01,091::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:01,122::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5227::DEBUG::2014-09-09 12:21:01,122::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:21:01,122::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5227::DEBUG::2014-09-09 12:21:01,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ae22c0c-9688-4733-b3f5-6fbcc691d709`::moving from state init -> state preparing >Thread-5227::INFO::2014-09-09 12:21:01,123::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5227::INFO::2014-09-09 12:21:01,124::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5227::DEBUG::2014-09-09 12:21:01,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ae22c0c-9688-4733-b3f5-6fbcc691d709`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5227::DEBUG::2014-09-09 12:21:01,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ae22c0c-9688-4733-b3f5-6fbcc691d709`::moving from state preparing -> state finished >Thread-5227::DEBUG::2014-09-09 12:21:01,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5227::DEBUG::2014-09-09 12:21:01,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5227::DEBUG::2014-09-09 12:21:01,124::task::993::Storage.TaskManager.Task::(_decref) Task=`4ae22c0c-9688-4733-b3f5-6fbcc691d709`::ref 0 aborting False >Thread-5227::DEBUG::2014-09-09 12:21:01,124::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5227::DEBUG::2014-09-09 12:21:01,124::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:01,152::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:01,152::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5228::DEBUG::2014-09-09 12:21:01,152::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5228::DEBUG::2014-09-09 12:21:01,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`028db601-6633-4c67-afc0-08e43de60055`::moving from state init -> state preparing >Thread-5228::INFO::2014-09-09 12:21:01,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5228::DEBUG::2014-09-09 12:21:01,154::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a242645f-804e-4598-8f09-55dd40447036`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5228::DEBUG::2014-09-09 12:21:01,154::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5228::DEBUG::2014-09-09 12:21:01,154::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5228::DEBUG::2014-09-09 12:21:01,154::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a242645f-804e-4598-8f09-55dd40447036`::Granted request >Thread-5228::DEBUG::2014-09-09 12:21:01,154::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`028db601-6633-4c67-afc0-08e43de60055`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5228::DEBUG::2014-09-09 12:21:01,154::task::993::Storage.TaskManager.Task::(_decref) Task=`028db601-6633-4c67-afc0-08e43de60055`::ref 1 aborting False >Thread-5228::INFO::2014-09-09 12:21:01,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-5228::DEBUG::2014-09-09 12:21:01,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`028db601-6633-4c67-afc0-08e43de60055`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-5228::DEBUG::2014-09-09 12:21:01,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`028db601-6633-4c67-afc0-08e43de60055`::moving from state preparing -> state finished >Thread-5228::DEBUG::2014-09-09 12:21:01,156::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5228::DEBUG::2014-09-09 12:21:01,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5228::DEBUG::2014-09-09 12:21:01,156::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5228::DEBUG::2014-09-09 12:21:01,156::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5228::DEBUG::2014-09-09 12:21:01,156::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5228::DEBUG::2014-09-09 12:21:01,156::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5228::DEBUG::2014-09-09 12:21:01,157::task::993::Storage.TaskManager.Task::(_decref) Task=`028db601-6633-4c67-afc0-08e43de60055`::ref 0 aborting False >Thread-5228::DEBUG::2014-09-09 12:21:01,157::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active,85442237-be11-4bd0-b6c3-43ba60c1b87f:Attached', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, '85442237-be11-4bd0-b6c3-43ba60c1b87f': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-5228::DEBUG::2014-09-09 12:21:01,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:02,087::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:02,087::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5229::DEBUG::2014-09-09 12:21:02,088::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:21:02,909::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) (10878) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) (10878) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:02,910::__init__::225::IOProcess::(_processLogs) (10878) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:02,911::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:21:02,911::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:21:02,919::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114494 s, 981 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) (10879) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) (10879) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:02,920::__init__::225::IOProcess::(_processLogs) (10879) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:02,921::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:21:03,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:03,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089638 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:05,094::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:05,095::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5230::DEBUG::2014-09-09 12:21:05,096::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:05,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:05,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894996 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:07,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:07,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895829 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:08,102::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:08,103::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5231::DEBUG::2014-09-09 12:21:08,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:09,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:09,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896169 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:10,801::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5232::DEBUG::2014-09-09 12:21:10,802::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >JsonRpcServer::DEBUG::2014-09-09 12:21:10,802::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5232::DEBUG::2014-09-09 12:21:10,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`544eb85f-4ffb-4627-a032-78d3dc7a3f59`::moving from state init -> state preparing >Thread-5232::INFO::2014-09-09 12:21:10,803::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-5232::DEBUG::2014-09-09 12:21:10,804::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-5232::DEBUG::2014-09-09 12:21:10,804::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 192.168.2.1:/home/storage/data2 /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 (cwd None) >Thread-19::DEBUG::2014-09-09 12:21:11,025::__init__::225::IOProcess::(_processLogs) Message size is 123 >Thread-19::DEBUG::2014-09-09 12:21:11,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) (10880) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) (10880) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) DEBUG|(10880) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) (10880) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,026::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,027::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-5232::DEBUG::2014-09-09 12:21:11,031::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 >Thread-19::DEBUG::2014-09-09 12:21:11,031::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,031::__init__::225::IOProcess::(_processLogs) Message size is 150 >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) (10881) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,032::__init__::225::IOProcess::(_processLogs) (10881) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,092::__init__::225::IOProcess::(_processLogs) (10882) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:11,093::__init__::225::IOProcess::(_processLogs) (10882) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:11,093::__init__::225::IOProcess::(_processLogs) DEBUG|(10882) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,093::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUG|(10882) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,094::__init__::225::IOProcess::(_processLogs) (10881) Queuing response >Thread-24::DEBUG::2014-09-09 12:21:11,094::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:21:11,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,099::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:21:11,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,100::__init__::225::IOProcess::(_processLogs) Sending response sized 147 >Thread-5232::DEBUG::2014-09-09 12:21:11,100::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'85442237-be11-4bd0-b6c3-43ba60c1b87f',) >Thread-5232::DEBUG::2014-09-09 12:21:11,100::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {e453999e-ec9f-420b-941c-a9f9cc4432bb: storage.nfsSD.findDomain, caf02237-e8a4-49fe-ab6d-4d23843f0edf: storage.nfsSD.findDomain, 85442237-be11-4bd0-b6c3-43ba60c1b87f: storage.nfsSD.findDomain} >Thread-5232::INFO::2014-09-09 12:21:11,100::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-5232::DEBUG::2014-09-09 12:21:11,100::task::1191::Storage.TaskManager.Task::(prepare) Task=`544eb85f-4ffb-4627-a032-78d3dc7a3f59`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-5232::DEBUG::2014-09-09 12:21:11,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`544eb85f-4ffb-4627-a032-78d3dc7a3f59`::moving from state preparing -> state finished >Thread-5232::DEBUG::2014-09-09 12:21:11,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5232::DEBUG::2014-09-09 12:21:11,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5232::DEBUG::2014-09-09 12:21:11,101::task::993::Storage.TaskManager.Task::(_decref) Task=`544eb85f-4ffb-4627-a032-78d3dc7a3f59`::ref 0 aborting False >Thread-5232::DEBUG::2014-09-09 12:21:11,101::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-5232::DEBUG::2014-09-09 12:21:11,101::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-24::DEBUG::2014-09-09 12:21:11,102::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n550 bytes (550 B) copied, 0.00109495 s, 502 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:11,102::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,102::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:11,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) (10883) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) (10883) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10883) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) (10883) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,103::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,104::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:21:11,104::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,104::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:21:11,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) (10884) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) (10884) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) (10884) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) (10884) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,105::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) (10885) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) (10885) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) (10885) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) (10885) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) (10886) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) (10886) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10886) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) (10886) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,108::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,109::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,111::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:11,111::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5233::DEBUG::2014-09-09 12:21:11,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5c9cfac-58c1-467d-a12f-326408c0093c`::moving from state init -> state preparing >Thread-5233::INFO::2014-09-09 12:21:11,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5233::INFO::2014-09-09 12:21:11,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114494', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109495', 'lastCheck': '0.0', 'valid': True}} >Thread-5233::DEBUG::2014-09-09 12:21:11,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5c9cfac-58c1-467d-a12f-326408c0093c`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114494', 'lastCheck': '8.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109495', 'lastCheck': '0.0', 'valid': True}} >Thread-5233::DEBUG::2014-09-09 12:21:11,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5c9cfac-58c1-467d-a12f-326408c0093c`::moving from state preparing -> state finished >Thread-5233::DEBUG::2014-09-09 12:21:11,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5233::DEBUG::2014-09-09 12:21:11,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5233::DEBUG::2014-09-09 12:21:11,113::task::993::Storage.TaskManager.Task::(_decref) Task=`e5c9cfac-58c1-467d-a12f-326408c0093c`::ref 0 aborting False >Thread-5233::DEBUG::2014-09-09 12:21:11,114::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:11,120::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5234::DEBUG::2014-09-09 12:21:11,121::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,173::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:11,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5235::DEBUG::2014-09-09 12:21:11,174::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StorageDomain.detach' in bridge with {u'masterVersion': 1, u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'masterSdUUID': u'00000000-0000-0000-0000-000000000000', u'storagedomainID': u'85442237-be11-4bd0-b6c3-43ba60c1b87f'} >Thread-5235::DEBUG::2014-09-09 12:21:11,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::moving from state init -> state preparing >Thread-5235::INFO::2014-09-09 12:21:11,174::logUtils::44::dispatcher::(wrapper) Run and protect: detachStorageDomain(sdUUID=u'85442237-be11-4bd0-b6c3-43ba60c1b87f', spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', msdUUID=u'00000000-0000-0000-0000-000000000000', masterVersion=1, options=None) >Thread-5235::DEBUG::2014-09-09 12:21:11,175::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`91faa569-adda-40bd-b1df-a90052c585b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '814' at 'detachStorageDomain' >Thread-5235::DEBUG::2014-09-09 12:21:11,175::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'exclusive' >Thread-5235::DEBUG::2014-09-09 12:21:11,175::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'exclusive' (1 active user) >Thread-5235::DEBUG::2014-09-09 12:21:11,175::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`91faa569-adda-40bd-b1df-a90052c585b7`::Granted request >Thread-5235::DEBUG::2014-09-09 12:21:11,175::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (exclusive) >Thread-5235::DEBUG::2014-09-09 12:21:11,175::task::993::Storage.TaskManager.Task::(_decref) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::ref 1 aborting False >Thread-5235::DEBUG::2014-09-09 12:21:11,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`7da29039-3b70-4b0f-9db2-c6cdd2f26ac3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '815' at 'detachStorageDomain' >Thread-5235::DEBUG::2014-09-09 12:21:11,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' for lock type 'exclusive' >Thread-5235::DEBUG::2014-09-09 12:21:11,176::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free. Now locking as 'exclusive' (1 active user) >Thread-5235::DEBUG::2014-09-09 12:21:11,176::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f`ReqID=`7da29039-3b70-4b0f-9db2-c6cdd2f26ac3`::Granted request >Thread-5235::DEBUG::2014-09-09 12:21:11,176::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::_resourcesAcquired: Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f (exclusive) >Thread-5235::DEBUG::2014-09-09 12:21:11,176::task::993::Storage.TaskManager.Task::(_decref) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::ref 1 aborting False >Thread-5235::INFO::2014-09-09 12:21:11,176::sp::954::Storage.StoragePool::(detachSD) sdUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f spUUID=5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-5235::DEBUG::2014-09-09 12:21:11,176::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-5235::DEBUG::2014-09-09 12:21:11,176::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5235::DEBUG::2014-09-09 12:21:11,176::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-5235::DEBUG::2014-09-09 12:21:11,177::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5235::DEBUG::2014-09-09 12:21:11,177::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-5235::DEBUG::2014-09-09 12:21:11,177::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-5235::DEBUG::2014-09-09 12:21:11,186::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5235::DEBUG::2014-09-09 12:21:11,188::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-5235::DEBUG::2014-09-09 12:21:11,204::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-5235::DEBUG::2014-09-09 12:21:11,205::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5235::DEBUG::2014-09-09 12:21:11,205::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5235::DEBUG::2014-09-09 12:21:11,205::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5235::DEBUG::2014-09-09 12:21:11,205::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5235::DEBUG::2014-09-09 12:21:11,205::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5235::DEBUG::2014-09-09 12:21:11,205::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5235::DEBUG::2014-09-09 12:21:11,205::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-09-09 12:21:11,207::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) (10887) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,208::__init__::225::IOProcess::(_processLogs) (10887) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) (10888) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) (10888) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,209::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,210::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Message size is 128 >Thread-19::DEBUG::2014-09-09 12:21:11,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,214::__init__::225::IOProcess::(_processLogs) (10887) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,215::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,216::__init__::225::IOProcess::(_processLogs) (10887) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,219::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:21:11,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-5235::DEBUG::2014-09-09 12:21:11,220::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data2/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-19::DEBUG::2014-09-09 12:21:11,221::__init__::225::IOProcess::(_processLogs) (10889) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,221::__init__::225::IOProcess::(_processLogs) (10889) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,221::__init__::225::IOProcess::(_processLogs) (10889) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,221::__init__::225::IOProcess::(_processLogs) (10889) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,221::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:21:11,222::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10888) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,222::__init__::225::IOProcess::(_processLogs) (10888) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,222::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) Message size is 159 >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) (10890) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:21:11,223::__init__::225::IOProcess::(_processLogs) (10890) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:21:11,288::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10890) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,288::__init__::225::IOProcess::(_processLogs) (10890) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,289::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Generating json... >Thread-5235::DEBUG::2014-09-09 12:21:11,289::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:21:11,289::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,290::__init__::225::IOProcess::(_processLogs) (10891) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:21:11,291::__init__::225::IOProcess::(_processLogs) (10891) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:21:11,294::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10891) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,294::__init__::225::IOProcess::(_processLogs) (10891) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,294::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Generating json... >Thread-5235::DEBUG::2014-09-09 12:21:11,294::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 12:21:11,295::__init__::225::IOProcess::(_processLogs) Sending response sized 531 >Thread-19::DEBUG::2014-09-09 12:21:11,296::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,296::__init__::225::IOProcess::(_processLogs) Message size is 176 >Thread-19::DEBUG::2014-09-09 12:21:11,296::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) (10892) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) (10892) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) (10892) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) (10892) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,297::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) (10893) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,298::__init__::225::IOProcess::(_processLogs) (10893) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,300::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10893) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,300::__init__::225::IOProcess::(_processLogs) (10893) Queuing response >Thread-5235::DEBUG::2014-09-09 12:21:11,301::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-09-09 12:21:11,301::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Generating json... >Thread-5235::INFO::2014-09-09 12:21:11,301::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_imageNS already registered >Thread-5235::INFO::2014-09-09 12:21:11,302::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 85442237-be11-4bd0-b6c3-43ba60c1b87f_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:21:11,302::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-5235::INFO::2014-09-09 12:21:11,303::sd::533::Storage.StorageDomain::(detach) detaching storage domain 85442237-be11-4bd0-b6c3-43ba60c1b87f from pool 5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-19::DEBUG::2014-09-09 12:21:11,303::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,303::__init__::225::IOProcess::(_processLogs) Message size is 183 >Thread-19::DEBUG::2014-09-09 12:21:11,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,303::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,304::__init__::225::IOProcess::(_processLogs) (10894) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:21:11,304::__init__::225::IOProcess::(_processLogs) (10894) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:21:11,306::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|(10894) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,306::__init__::225::IOProcess::(_processLogs) (10894) Queuing response >Thread-5235::DEBUG::2014-09-09 12:21:11,306::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=8916c19f21870c63ed96b9f984e04bb1533438bd'] >Thread-19::DEBUG::2014-09-09 12:21:11,306::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Generating json... >Thread-5235::DEBUG::2014-09-09 12:21:11,307::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-19::DEBUG::2014-09-09 12:21:11,307::__init__::225::IOProcess::(_processLogs) Sending response sized 531 >Thread-5235::DEBUG::2014-09-09 12:21:11,308::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-5235::DEBUG::2014-09-09 12:21:11,308::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-5235::DEBUG::2014-09-09 12:21:11,308::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-5235::DEBUG::2014-09-09 12:21:11,309::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data2-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=', 'REMOTE_PATH=192.168.2.1:/home/storage/data2', 'ROLE=Regular', 'SDUUID=85442237-be11-4bd0-b6c3-43ba60c1b87f', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ea327df6b5978b3b73cba0ad43c7c553febb19bc'] >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) (10881) Building responseDEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,309::__init__::225::IOProcess::(_processLogs) (10895) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 12:21:11,310::__init__::225::IOProcess::(_processLogs) (10895) Got request for method 'writefile' >Thread-19::DEBUG::2014-09-09 12:21:11,422::__init__::225::IOProcess::(_processLogs) (10895) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,422::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-5235::WARNING::2014-09-09 12:21:11,422::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) Message size is 293 >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) (10896) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 12:21:11,423::__init__::225::IOProcess::(_processLogs) (10896) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 12:21:11,424::__init__::225::IOProcess::(_processLogs) (10896) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,424::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-5235::DEBUG::2014-09-09 12:21:11,424::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-5235::WARNING::2014-09-09 12:21:11,425::sp::927::Storage.StoragePool::(forcedDetachSD) Force detaching domain `85442237-be11-4bd0-b6c3-43ba60c1b87f` >Thread-5235::DEBUG::2014-09-09 12:21:11,425::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-5235::DEBUG::2014-09-09 12:21:11,425::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-5235::DEBUG::2014-09-09 12:21:11,425::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=db9437313b925c8c90666a5b2cbfdac59b1332b8'] >Thread-19::DEBUG::2014-09-09 12:21:11,425::__init__::225::IOProcess::(_processLogs) Message size is 872 >Thread-19::DEBUG::2014-09-09 12:21:11,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,426::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,426::__init__::225::IOProcess::(_processLogs) (10897) Finding callback 'writefile'... >Thread-19::DEBUG::2014-09-09 12:21:11,426::__init__::225::IOProcess::(_processLogs) (10897) Got request for method 'writefile' >Dummy-97::DEBUG::2014-09-09 12:21:11,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:11,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894917 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:11,564::__init__::225::IOProcess::(_processLogs) (10897) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,564::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-5235::WARNING::2014-09-09 12:21:11,564::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-09-09 12:21:11,565::__init__::225::IOProcess::(_processLogs) Message size is 291 >Thread-19::DEBUG::2014-09-09 12:21:11,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,566::__init__::225::IOProcess::(_processLogs) (10898) Finding callback 'rename'... >Thread-19::DEBUG::2014-09-09 12:21:11,566::__init__::225::IOProcess::(_processLogs) (10898) Got request for method 'rename' >Thread-19::DEBUG::2014-09-09 12:21:11,568::__init__::225::IOProcess::(_processLogs) (10898) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,568::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-5235::DEBUG::2014-09-09 12:21:11,568::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-5235::DEBUG::2014-09-09 12:21:11,569::sp::1143::Storage.StoragePool::(_cleanupDomainLinks) Removing: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/85442237-be11-4bd0-b6c3-43ba60c1b87f >Thread-5235::DEBUG::2014-09-09 12:21:11,569::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-5235::DEBUG::2014-09-09 12:21:11,569::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5235::DEBUG::2014-09-09 12:21:11,569::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5235::DEBUG::2014-09-09 12:21:11,569::sp::944::Storage.StoragePool::(forcedDetachSD) Force detach for domain `85442237-be11-4bd0-b6c3-43ba60c1b87f` is done >Thread-5235::INFO::2014-09-09 12:21:11,569::logUtils::47::dispatcher::(wrapper) Run and protect: detachStorageDomain, Return response: None >Thread-5235::DEBUG::2014-09-09 12:21:11,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::finished: None >Thread-5235::DEBUG::2014-09-09 12:21:11,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::moving from state preparing -> state finished >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>, u'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f': < ResourceRef 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', isValid: 'True' obj: 'None'>} >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5235::DEBUG::2014-09-09 12:21:11,570::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' >Thread-5235::DEBUG::2014-09-09 12:21:11,571::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' (0 active users) >Thread-5235::DEBUG::2014-09-09 12:21:11,571::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f' is free, finding out if anyone is waiting for it. >Thread-5235::DEBUG::2014-09-09 12:21:11,571::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.85442237-be11-4bd0-b6c3-43ba60c1b87f', Clearing records. >Thread-5235::DEBUG::2014-09-09 12:21:11,571::task::993::Storage.TaskManager.Task::(_decref) Task=`56a54948-242d-4efa-9003-32d3dc89dcf4`::ref 0 aborting False >Thread-5235::DEBUG::2014-09-09 12:21:11,571::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StorageDomain.detach' in bridge with True >Thread-5235::DEBUG::2014-09-09 12:21:11,571::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,575::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5239::DEBUG::2014-09-09 12:21:11,576::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:21:11,576::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5239::DEBUG::2014-09-09 12:21:11,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f7282ac-b358-425e-8e06-a90cbe33d54a`::moving from state init -> state preparing >Thread-5239::INFO::2014-09-09 12:21:11,577::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5239::INFO::2014-09-09 12:21:11,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5239::DEBUG::2014-09-09 12:21:11,577::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f7282ac-b358-425e-8e06-a90cbe33d54a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5239::DEBUG::2014-09-09 12:21:11,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f7282ac-b358-425e-8e06-a90cbe33d54a`::moving from state preparing -> state finished >Thread-5239::DEBUG::2014-09-09 12:21:11,577::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5239::DEBUG::2014-09-09 12:21:11,577::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5239::DEBUG::2014-09-09 12:21:11,577::task::993::Storage.TaskManager.Task::(_decref) Task=`0f7282ac-b358-425e-8e06-a90cbe33d54a`::ref 0 aborting False >Thread-5239::DEBUG::2014-09-09 12:21:11,577::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5239::DEBUG::2014-09-09 12:21:11,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,581::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5240::DEBUG::2014-09-09 12:21:11,582::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connect' in bridge with {u'masterVersion': 1, u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'scsiKey': u'5745e11d-81b4-4d82-8fed-c8a22ec23383', u'masterSdUUID': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', u'hostID': 2} >JsonRpcServer::DEBUG::2014-09-09 12:21:11,582::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5240::DEBUG::2014-09-09 12:21:11,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`89feb2c7-5fb4-4933-8b0f-3a69109db665`::moving from state init -> state preparing >Thread-5240::INFO::2014-09-09 12:21:11,583::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', hostID=2, msdUUID=u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', masterVersion=1, domainsMap=None, options=None) >Thread-5240::DEBUG::2014-09-09 12:21:11,583::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`7d1227ee-d4d5-4160-85e2-ccf66dc08629`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-5240::DEBUG::2014-09-09 12:21:11,583::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-5240::DEBUG::2014-09-09 12:21:11,583::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-5240::DEBUG::2014-09-09 12:21:11,583::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`7d1227ee-d4d5-4160-85e2-ccf66dc08629`::Granted request >Thread-5240::DEBUG::2014-09-09 12:21:11,584::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f02f0c3a-f64e-4b3c-9a27-d72d5bbf9881`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1049' at '_connectStoragePool' >Thread-5240::DEBUG::2014-09-09 12:21:11,584::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5240::DEBUG::2014-09-09 12:21:11,584::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5240::DEBUG::2014-09-09 12:21:11,584::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f02f0c3a-f64e-4b3c-9a27-d72d5bbf9881`::Granted request >Thread-5240::DEBUG::2014-09-09 12:21:11,584::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,584::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,585::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,585::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,585::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,585::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,585::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-5240::DEBUG::2014-09-09 12:21:11,585::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5240::DEBUG::2014-09-09 12:21:11,585::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-5240::DEBUG::2014-09-09 12:21:11,585::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5240::DEBUG::2014-09-09 12:21:11,585::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-5240::DEBUG::2014-09-09 12:21:11,585::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-5240::DEBUG::2014-09-09 12:21:11,594::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5240::DEBUG::2014-09-09 12:21:11,596::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-5240::DEBUG::2014-09-09 12:21:11,610::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-5240::DEBUG::2014-09-09 12:21:11,611::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,611::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,611::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,611::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,611::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,611::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5240::DEBUG::2014-09-09 12:21:11,611::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-09-09 12:21:11,613::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) (10899) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,614::__init__::225::IOProcess::(_processLogs) (10899) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,615::__init__::225::IOProcess::(_processLogs) (10899) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,615::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:21:11,615::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:21:11,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) (10900) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,616::__init__::225::IOProcess::(_processLogs) DEBUG|(10900) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,617::__init__::225::IOProcess::(_processLogs) (10901) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,617::__init__::225::IOProcess::(_processLogs) (10901) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,617::__init__::225::IOProcess::(_processLogs) (10901) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,617::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:21:11,618::__init__::225::IOProcess::(_processLogs) (10900) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,618::__init__::225::IOProcess::(_processLogs) (10900) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,618::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-5240::DEBUG::2014-09-09 12:21:11,619::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) Message size is 158 >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) (10902) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:21:11,620::__init__::225::IOProcess::(_processLogs) (10902) Got request for method 'touch' >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:11,678::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5244::DEBUG::2014-09-09 12:21:11,678::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5244::DEBUG::2014-09-09 12:21:11,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`d88dfd71-db5f-4241-88e5-ae3225717598`::moving from state init -> state preparing >Thread-5244::INFO::2014-09-09 12:21:11,679::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5244::DEBUG::2014-09-09 12:21:11,680::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`22c7f0de-f146-4f8d-a5e2-3f24155c5689`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5244::DEBUG::2014-09-09 12:21:11,680::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5244::DEBUG::2014-09-09 12:21:11,680::resourceManager::566::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-5244::DEBUG::2014-09-09 12:21:11,680::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`22c7f0de-f146-4f8d-a5e2-3f24155c5689`::Granted request >Thread-5244::DEBUG::2014-09-09 12:21:11,680::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d88dfd71-db5f-4241-88e5-ae3225717598`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5244::DEBUG::2014-09-09 12:21:11,680::task::993::Storage.TaskManager.Task::(_decref) Task=`d88dfd71-db5f-4241-88e5-ae3225717598`::ref 1 aborting False >Thread-19::DEBUG::2014-09-09 12:21:11,719::__init__::225::IOProcess::(_processLogs) (10902) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,719::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-5240::DEBUG::2014-09-09 12:21:11,720::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:21:11,720::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-09-09 12:21:11,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,721::__init__::225::IOProcess::(_processLogs) (10903) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:21:11,721::__init__::225::IOProcess::(_processLogs) (10903) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:21:11,724::__init__::225::IOProcess::(_processLogs) (10903) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,724::__init__::225::IOProcess::(_processLogs) Sending response sized 727 >Thread-5240::DEBUG::2014-09-09 12:21:11,724::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=data-nfs', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=nfs', 'POOL_DOMAINS=e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'POOL_SPM_ID=2', 'POOL_SPM_LVER=3', 'POOL_UUID=5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/data', 'ROLE=Master', 'SDUUID=caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=db9437313b925c8c90666a5b2cbfdac59b1332b8'] >Thread-19::DEBUG::2014-09-09 12:21:11,725::__init__::225::IOProcess::(_processLogs) Message size is 175 >Thread-19::DEBUG::2014-09-09 12:21:11,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,726::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,726::__init__::225::IOProcess::(_processLogs) (10904) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:11,726::__init__::225::IOProcess::(_processLogs) (10904) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:11,727::__init__::225::IOProcess::(_processLogs) (10904) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,727::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:11,727::__init__::225::IOProcess::(_processLogs) Message size is 169 >Thread-19::DEBUG::2014-09-09 12:21:11,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) (10905) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) (10905) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) (10905) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,728::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-5240::DEBUG::2014-09-09 12:21:11,728::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-5240::INFO::2014-09-09 12:21:11,729::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_imageNS already registered >Thread-5240::INFO::2014-09-09 12:21:11,729::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace caf02237-e8a4-49fe-ab6d-4d23843f0edf_volumeNS already registered >Thread-5240::DEBUG::2014-09-09 12:21:11,730::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain caf02237-e8a4-49fe-ab6d-4d23843f0edf verified, version 1 >Thread-5240::DEBUG::2014-09-09 12:21:11,730::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-5240::DEBUG::2014-09-09 12:21:11,731::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5240::DEBUG::2014-09-09 12:21:11,732::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5240::DEBUG::2014-09-09 12:21:11,732::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 >Thread-5240::WARNING::2014-09-09 12:21:11,733::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383 already exists >Thread-5240::DEBUG::2014-09-09 12:21:11,735::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-5244::INFO::2014-09-09 12:21:11,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5240::DEBUG::2014-09-09 12:21:11,737::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name e453999e-ec9f-420b-941c-a9f9cc4432bb (cwd None) >Thread-5244::DEBUG::2014-09-09 12:21:11,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`d88dfd71-db5f-4241-88e5-ae3225717598`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5244::DEBUG::2014-09-09 12:21:11,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`d88dfd71-db5f-4241-88e5-ae3225717598`::moving from state preparing -> state finished >Thread-5244::DEBUG::2014-09-09 12:21:11,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5244::DEBUG::2014-09-09 12:21:11,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5244::DEBUG::2014-09-09 12:21:11,743::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5244::DEBUG::2014-09-09 12:21:11,743::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (1 active users) >Thread-5244::DEBUG::2014-09-09 12:21:11,743::task::993::Storage.TaskManager.Task::(_decref) Task=`d88dfd71-db5f-4241-88e5-ae3225717598`::ref 0 aborting False >Thread-5244::DEBUG::2014-09-09 12:21:11,744::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5244::DEBUG::2014-09-09 12:21:11,744::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-5240::DEBUG::2014-09-09 12:21:11,754::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found\n Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb\n'; <rc> = 5 >Thread-5240::WARNING::2014-09-09 12:21:11,754::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!', ' Volume group "e453999e-ec9f-420b-941c-a9f9cc4432bb" not found', ' Skipping volume group e453999e-ec9f-420b-941c-a9f9cc4432bb'] >Thread-5240::DEBUG::2014-09-09 12:21:11,754::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-09-09 12:21:11,756::__init__::225::IOProcess::(_processLogs) Message size is 130 >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) (10906) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) (10906) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,757::__init__::225::IOProcess::(_processLogs) (10906) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Sending response sized 154 >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,758::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) (10907) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) (10907) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) (10908) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:11,759::__init__::225::IOProcess::(_processLogs) (10908) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) (10908) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) Sending response sized 152 >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) (10907) Building response >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) (10907) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:11,760::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-5240::INFO::2014-09-09 12:21:11,761::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-5240::DEBUG::2014-09-09 12:21:11,761::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-5240::INFO::2014-09-09 12:21:11,761::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-5240::DEBUG::2014-09-09 12:21:11,761::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/caf02237-e8a4-49fe-ab6d-4d23843f0edf >Thread-5240::INFO::2014-09-09 12:21:11,761::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf to /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-5240::DEBUG::2014-09-09 12:21:11,761::sp::1131::Storage.StoragePool::(_linkStorageDomain) link already present skipping creation for /rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-5240::DEBUG::2014-09-09 12:21:11,762::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-5240::INFO::2014-09-09 12:21:11,762::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-5240::DEBUG::2014-09-09 12:21:11,762::task::1191::Storage.TaskManager.Task::(prepare) Task=`89feb2c7-5fb4-4933-8b0f-3a69109db665`::finished: True >Thread-5240::DEBUG::2014-09-09 12:21:11,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`89feb2c7-5fb4-4933-8b0f-3a69109db665`::moving from state preparing -> state finished >Thread-5240::DEBUG::2014-09-09 12:21:11,763::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5240::DEBUG::2014-09-09 12:21:11,763::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5240::DEBUG::2014-09-09 12:21:11,763::task::993::Storage.TaskManager.Task::(_decref) Task=`89feb2c7-5fb4-4933-8b0f-3a69109db665`::ref 0 aborting False >Thread-5240::DEBUG::2014-09-09 12:21:11,763::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connect' in bridge with True >Thread-5240::DEBUG::2014-09-09 12:21:11,763::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:11,770::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:11,770::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5248::DEBUG::2014-09-09 12:21:11,770::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.disconnectStorageServer' in bridge with {u'connectionParams': [{u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u''}], u'storagepoolID': u'00000000-0000-0000-0000-000000000000', u'domainType': 1} >Thread-5248::DEBUG::2014-09-09 12:21:11,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`3508add4-a6d2-4627-ab7b-35506fc84752`::moving from state init -> state preparing >Thread-5248::INFO::2014-09-09 12:21:11,772::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'connection': u'192.168.2.1:/home/storage/data2', u'iqn': u'', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'061feb48-6a99-495a-8370-faed867e7de6', u'port': u''}], options=None) >Thread-5248::DEBUG::2014-09-09 12:21:11,772::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/umount -f -l /rhev/data-center/mnt/192.168.2.1:_home_storage_data2 (cwd None) >Thread-5248::DEBUG::2014-09-09 12:21:11,791::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-5248::DEBUG::2014-09-09 12:21:11,792::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5248::DEBUG::2014-09-09 12:21:11,792::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-5248::DEBUG::2014-09-09 12:21:11,792::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-5248::DEBUG::2014-09-09 12:21:11,792::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-5248::DEBUG::2014-09-09 12:21:11,792::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-5248::DEBUG::2014-09-09 12:21:11,801::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5248::DEBUG::2014-09-09 12:21:11,802::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-5248::DEBUG::2014-09-09 12:21:11,825::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-5248::DEBUG::2014-09-09 12:21:11,826::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5248::DEBUG::2014-09-09 12:21:11,826::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5248::DEBUG::2014-09-09 12:21:11,826::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5248::DEBUG::2014-09-09 12:21:11,826::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5248::DEBUG::2014-09-09 12:21:11,826::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-5248::DEBUG::2014-09-09 12:21:11,826::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-5248::DEBUG::2014-09-09 12:21:11,826::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-5248::INFO::2014-09-09 12:21:11,826::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-5248::DEBUG::2014-09-09 12:21:11,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`3508add4-a6d2-4627-ab7b-35506fc84752`::finished: {'statuslist': [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}]} >Thread-5248::DEBUG::2014-09-09 12:21:11,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`3508add4-a6d2-4627-ab7b-35506fc84752`::moving from state preparing -> state finished >Thread-5248::DEBUG::2014-09-09 12:21:11,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5248::DEBUG::2014-09-09 12:21:11,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5248::DEBUG::2014-09-09 12:21:11,827::task::993::Storage.TaskManager.Task::(_decref) Task=`3508add4-a6d2-4627-ab7b-35506fc84752`::ref 0 aborting False >Thread-5248::DEBUG::2014-09-09 12:21:11,827::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.disconnectStorageServer' in bridge with [{'status': 0, 'id': u'061feb48-6a99-495a-8370-faed867e7de6'}] >Thread-5248::DEBUG::2014-09-09 12:21:11,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Message size is 129 >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) (10909) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) (10909) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:12,923::__init__::225::IOProcess::(_processLogs) Message size is 128 >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) (10910) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) (10910) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:12,924::__init__::225::IOProcess::(_processLogs) (10909) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:12,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:12,925::__init__::225::IOProcess::(_processLogs) Sending response sized 153 >Thread-19::DEBUG::2014-09-09 12:21:12,925::__init__::225::IOProcess::(_processLogs) (10910) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:12,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:21:12,927::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) Message size is 157 >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) (10911) Finding callback 'touch'... >Thread-19::DEBUG::2014-09-09 12:21:12,927::__init__::225::IOProcess::(_processLogs) (10911) Got request for method 'touch' >Thread-19::DEBUG::2014-09-09 12:21:13,006::__init__::225::IOProcess::(_processLogs) (10911) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:13,007::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:13,007::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-23::DEBUG::2014-09-09 12:21:13,007::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-09-09 12:21:13,007::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-09-09 12:21:13,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:13,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:13,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:13,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:13,008::__init__::225::IOProcess::(_processLogs) (10912) Finding callback 'readfile'... >Thread-19::DEBUG::2014-09-09 12:21:13,008::__init__::225::IOProcess::(_processLogs) (10912) Got request for method 'readfile' >Thread-19::DEBUG::2014-09-09 12:21:13,010::__init__::225::IOProcess::(_processLogs) (10912) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:13,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:21:13,010::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=iso', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000047,6d2495f3-efe4-4aa1-ab93-bdb0f6860cee,ff41f65c-09ac-40aa-8917-4b3ca8719aec,a69c4d84-3114-4937-aace-2079ce66b10b,7b90a9ec-ecb3-4105-b817-306ffc0b8245,be744655-2a19-4919-92f3-e7c20ac03193,0650ae6a-530a-4208-a13a-668025352382,528420e2-28d3-42c0-a243-a72c2dc0bd04,5fa7190c-833d-4b62-8524-a114f6ce5a79,4ed9221c-909e-4b58-998d-6140b9c241d0,00000002-0002-0002-0002-00000000034b,ca74573b-dc89-4785-92a8-5fdcc079f4df,00000002-0002-0002-0002-0000000001e1,aab45993-c5cf-436e-b55a-873bd83681d2,1ac20b5a-4433-4c04-bbc7-33d7eb3fd41f,d0089906-9093-4e45-91f4-2c73256f3dd3,9d8913f8-c9ee-4216-b161-a9ead1047fb9,f201c1d3-166d-42b0-ab69-0920a6dc279f,a1d01b58-6574-432d-b2df-2054ffca7eab,25a09b8a-177c-40af-865d-22436da5cc66,aed40d3c-15fc-45d2-bcba-da1398ae3d14,5745e11d-81b4-4d82-8fed-c8a22ec23383', 'REMOTE_PATH=192.168.2.1:/home/storage/iso', 'ROLE=Regular', 'SDUUID=e453999e-ec9f-420b-941c-a9f9cc4432bb', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=3ab7cad61661fbee975ab14bc6a1ca5540004e85'] >Thread-19::DEBUG::2014-09-09 12:21:13,011::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-09-09 12:21:13,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:13,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) (10913) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) (10913) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) (10913) Building response >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) (10913) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Message size is 168 >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:13,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:13,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:13,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:13,013::__init__::225::IOProcess::(_processLogs) (10914) Finding callback 'glob'... >Thread-19::DEBUG::2014-09-09 12:21:13,013::__init__::225::IOProcess::(_processLogs) (10914) Got request for method 'glob' >Thread-19::DEBUG::2014-09-09 12:21:13,013::__init__::225::IOProcess::(_processLogs) (10914) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:13,013::__init__::225::IOProcess::(_processLogs) Sending response sized 55 >Thread-23::DEBUG::2014-09-09 12:21:13,013::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-23::INFO::2014-09-09 12:21:13,014::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_imageNS already registered >Thread-23::INFO::2014-09-09 12:21:13,014::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace e453999e-ec9f-420b-941c-a9f9cc4432bb_volumeNS already registered >Thread-19::DEBUG::2014-09-09 12:21:13,014::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:13,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:13,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:13,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:13,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:13,015::__init__::225::IOProcess::(_processLogs) (10915) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:13,015::__init__::225::IOProcess::(_processLogs) (10915) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:13,015::__init__::225::IOProcess::(_processLogs) (10915) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:13,015::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:21:13,016::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:21:13,023::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00117177 s, 958 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) (10916) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:13,024::__init__::225::IOProcess::(_processLogs) (10916) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:13,025::__init__::225::IOProcess::(_processLogs) (10916) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:13,025::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:21:13,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:13,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089812 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:14,947::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:14,948::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5251::DEBUG::2014-09-09 12:21:14,949::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:15,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:15,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895862 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:17,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:17,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896015 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:17,955::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:17,955::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5252::DEBUG::2014-09-09 12:21:17,956::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:19,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:19,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0937513 s, 10.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:20,964::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:20,965::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5253::DEBUG::2014-09-09 12:21:20,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:21:21,109::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:21,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:21,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:21,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:21,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:21,110::__init__::225::IOProcess::(_processLogs) (10917) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:21,110::__init__::225::IOProcess::(_processLogs) (10917) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:21,110::__init__::225::IOProcess::(_processLogs) (10917) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:21,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:21:21,110::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:21:21,119::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.00110993 s, 454 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:21,120::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:21,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:21,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:21,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:21,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:21,120::__init__::225::IOProcess::(_processLogs) (10918) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:21,121::__init__::225::IOProcess::(_processLogs) (10918) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:21,121::__init__::225::IOProcess::(_processLogs) (10918) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:21,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) (10919) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) (10919) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) (10919) Building response >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) (10919) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:21,122::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:21,123::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:21,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:21,123::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:21,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) (10920) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) (10920) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) (10920) Building response >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) (10920) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:21:21,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) (10921) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) (10921) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) (10921) Building response >Thread-19::DEBUG::2014-09-09 12:21:21,125::__init__::225::IOProcess::(_processLogs) (10921) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:21,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:21,126::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:21,839::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5254::DEBUG::2014-09-09 12:21:21,840::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:21:21,840::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5254::DEBUG::2014-09-09 12:21:21,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ed793d4-a8e2-460c-88dc-3e15dff9c771`::moving from state init -> state preparing >Thread-5254::INFO::2014-09-09 12:21:21,841::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5254::INFO::2014-09-09 12:21:21,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5254::DEBUG::2014-09-09 12:21:21,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ed793d4-a8e2-460c-88dc-3e15dff9c771`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5254::DEBUG::2014-09-09 12:21:21,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ed793d4-a8e2-460c-88dc-3e15dff9c771`::moving from state preparing -> state finished >Thread-5254::DEBUG::2014-09-09 12:21:21,842::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5254::DEBUG::2014-09-09 12:21:21,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5254::DEBUG::2014-09-09 12:21:21,842::task::993::Storage.TaskManager.Task::(_decref) Task=`0ed793d4-a8e2-460c-88dc-3e15dff9c771`::ref 0 aborting False >Thread-5254::DEBUG::2014-09-09 12:21:21,842::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5254::DEBUG::2014-09-09 12:21:21,842::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:21,889::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:21,889::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5255::DEBUG::2014-09-09 12:21:21,889::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5255::DEBUG::2014-09-09 12:21:21,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6564a6b-d8e9-4b46-9f07-ceec703f9874`::moving from state init -> state preparing >Thread-5255::INFO::2014-09-09 12:21:21,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5255::DEBUG::2014-09-09 12:21:21,891::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a1d0f82b-31f8-4ce7-b116-62bc4038e9e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5255::DEBUG::2014-09-09 12:21:21,891::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5255::DEBUG::2014-09-09 12:21:21,891::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5255::DEBUG::2014-09-09 12:21:21,891::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`a1d0f82b-31f8-4ce7-b116-62bc4038e9e8`::Granted request >Thread-5255::DEBUG::2014-09-09 12:21:21,891::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b6564a6b-d8e9-4b46-9f07-ceec703f9874`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5255::DEBUG::2014-09-09 12:21:21,891::task::993::Storage.TaskManager.Task::(_decref) Task=`b6564a6b-d8e9-4b46-9f07-ceec703f9874`::ref 1 aborting False >Thread-5255::INFO::2014-09-09 12:21:21,893::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5255::DEBUG::2014-09-09 12:21:21,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6564a6b-d8e9-4b46-9f07-ceec703f9874`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5255::DEBUG::2014-09-09 12:21:21,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6564a6b-d8e9-4b46-9f07-ceec703f9874`::moving from state preparing -> state finished >Thread-5255::DEBUG::2014-09-09 12:21:21,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5255::DEBUG::2014-09-09 12:21:21,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5255::DEBUG::2014-09-09 12:21:21,893::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5255::DEBUG::2014-09-09 12:21:21,893::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5255::DEBUG::2014-09-09 12:21:21,893::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5255::DEBUG::2014-09-09 12:21:21,893::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5255::DEBUG::2014-09-09 12:21:21,894::task::993::Storage.TaskManager.Task::(_decref) Task=`b6564a6b-d8e9-4b46-9f07-ceec703f9874`::ref 0 aborting False >Thread-5255::DEBUG::2014-09-09 12:21:21,894::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5255::DEBUG::2014-09-09 12:21:21,894::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:22,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:22,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897034 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:23,026::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:23,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:23,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:23,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:23,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:23,027::__init__::225::IOProcess::(_processLogs) (10922) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:23,027::__init__::225::IOProcess::(_processLogs) (10922) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:23,027::__init__::225::IOProcess::(_processLogs) (10922) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:23,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:21:23,028::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:21:23,028::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:21:23,035::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00112002 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:23,036::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:23,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:23,036::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:23,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:23,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:23,036::__init__::225::IOProcess::(_processLogs) (10923) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:23,037::__init__::225::IOProcess::(_processLogs) (10923) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:23,037::__init__::225::IOProcess::(_processLogs) (10923) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:23,037::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:23,976::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:23,977::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5256::DEBUG::2014-09-09 12:21:23,978::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:24,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:24,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896191 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:26,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:26,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896557 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:26,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:26,988::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5257::DEBUG::2014-09-09 12:21:26,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`264af73d-a891-44a4-8f83-7867132dacf7`::moving from state init -> state preparing >Thread-5257::INFO::2014-09-09 12:21:26,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5257::INFO::2014-09-09 12:21:26,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112002', 'lastCheck': '4.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110993', 'lastCheck': '5.9', 'valid': True}} >Thread-5257::DEBUG::2014-09-09 12:21:26,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`264af73d-a891-44a4-8f83-7867132dacf7`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00112002', 'lastCheck': '4.0', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00110993', 'lastCheck': '5.9', 'valid': True}} >Thread-5257::DEBUG::2014-09-09 12:21:26,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`264af73d-a891-44a4-8f83-7867132dacf7`::moving from state preparing -> state finished >Thread-5257::DEBUG::2014-09-09 12:21:26,989::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5257::DEBUG::2014-09-09 12:21:26,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5257::DEBUG::2014-09-09 12:21:26,990::task::993::Storage.TaskManager.Task::(_decref) Task=`264af73d-a891-44a4-8f83-7867132dacf7`::ref 0 aborting False >Thread-5257::DEBUG::2014-09-09 12:21:26,990::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:27,000::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:27,001::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5258::DEBUG::2014-09-09 12:21:27,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:28,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:28,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898245 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:30,086::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:30,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5259::DEBUG::2014-09-09 12:21:30,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:30,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:30,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089524 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:31,125::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:31,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:31,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:31,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:31,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:31,126::__init__::225::IOProcess::(_processLogs) (10924) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:31,126::__init__::225::IOProcess::(_processLogs) (10924) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:31,127::__init__::225::IOProcess::(_processLogs) (10924) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:31,127::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:21:31,127::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:21:31,135::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000966316 s, 522 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:31,135::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) (10925) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) (10925) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) (10925) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:31,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:31,137::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:21:31,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:31,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) (10926) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) (10926) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) (10926) Building response >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) (10926) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:31,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) (10927) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) (10927) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) (10927) Building response >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) (10927) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:31,139::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:31,140::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:21:31,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:31,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:31,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:31,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:31,141::__init__::225::IOProcess::(_processLogs) (10928) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:31,141::__init__::225::IOProcess::(_processLogs) (10928) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:31,141::__init__::225::IOProcess::(_processLogs) (10928) Building response >Thread-19::DEBUG::2014-09-09 12:21:31,141::__init__::225::IOProcess::(_processLogs) (10928) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:31,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:31,141::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:31,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:31,925::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5260::DEBUG::2014-09-09 12:21:31,925::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5260::DEBUG::2014-09-09 12:21:31,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1921479-167c-4b48-9451-125c8ddd51cf`::moving from state init -> state preparing >Thread-5260::INFO::2014-09-09 12:21:31,926::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5260::INFO::2014-09-09 12:21:31,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5260::DEBUG::2014-09-09 12:21:31,927::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1921479-167c-4b48-9451-125c8ddd51cf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5260::DEBUG::2014-09-09 12:21:31,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1921479-167c-4b48-9451-125c8ddd51cf`::moving from state preparing -> state finished >Thread-5260::DEBUG::2014-09-09 12:21:31,927::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5260::DEBUG::2014-09-09 12:21:31,927::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5260::DEBUG::2014-09-09 12:21:31,927::task::993::Storage.TaskManager.Task::(_decref) Task=`f1921479-167c-4b48-9451-125c8ddd51cf`::ref 0 aborting False >Thread-5260::DEBUG::2014-09-09 12:21:31,927::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5260::DEBUG::2014-09-09 12:21:31,927::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:31,940::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:31,940::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5261::DEBUG::2014-09-09 12:21:31,940::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5261::DEBUG::2014-09-09 12:21:31,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1b521a0-9cdb-4e21-8554-0901f87b37b8`::moving from state init -> state preparing >Thread-5261::INFO::2014-09-09 12:21:31,941::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5261::DEBUG::2014-09-09 12:21:31,942::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e51851c8-12d2-494a-9bde-2a2bf4fbb8c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5261::DEBUG::2014-09-09 12:21:31,942::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5261::DEBUG::2014-09-09 12:21:31,942::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5261::DEBUG::2014-09-09 12:21:31,942::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`e51851c8-12d2-494a-9bde-2a2bf4fbb8c1`::Granted request >Thread-5261::DEBUG::2014-09-09 12:21:31,942::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c1b521a0-9cdb-4e21-8554-0901f87b37b8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5261::DEBUG::2014-09-09 12:21:31,942::task::993::Storage.TaskManager.Task::(_decref) Task=`c1b521a0-9cdb-4e21-8554-0901f87b37b8`::ref 1 aborting False >Thread-5261::INFO::2014-09-09 12:21:31,944::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5261::DEBUG::2014-09-09 12:21:31,944::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1b521a0-9cdb-4e21-8554-0901f87b37b8`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5261::DEBUG::2014-09-09 12:21:31,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1b521a0-9cdb-4e21-8554-0901f87b37b8`::moving from state preparing -> state finished >Thread-5261::DEBUG::2014-09-09 12:21:31,944::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5261::DEBUG::2014-09-09 12:21:31,944::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5261::DEBUG::2014-09-09 12:21:31,944::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5261::DEBUG::2014-09-09 12:21:31,944::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5261::DEBUG::2014-09-09 12:21:31,944::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5261::DEBUG::2014-09-09 12:21:31,945::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5261::DEBUG::2014-09-09 12:21:31,945::task::993::Storage.TaskManager.Task::(_decref) Task=`c1b521a0-9cdb-4e21-8554-0901f87b37b8`::ref 0 aborting False >Thread-5261::DEBUG::2014-09-09 12:21:31,945::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283535998976', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5261::DEBUG::2014-09-09 12:21:31,945::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:32,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:32,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895538 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:33,038::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:33,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:33,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:33,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:33,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:33,039::__init__::225::IOProcess::(_processLogs) (10929) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:33,039::__init__::225::IOProcess::(_processLogs) (10929) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:33,039::__init__::225::IOProcess::(_processLogs) (10929) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:33,039::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:21:33,040::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:21:33,047::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00114656 s, 979 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:33,047::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:33,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) (10930) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) (10930) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) (10930) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:33,048::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:33,095::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:33,096::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5262::DEBUG::2014-09-09 12:21:33,096::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:34,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:34,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894637 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:36,105::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:36,105::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5263::DEBUG::2014-09-09 12:21:36,107::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:36,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:36,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089523 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:38,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:38,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895571 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:39,113::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:39,114::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5264::DEBUG::2014-09-09 12:21:39,115::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:40,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:41,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089659 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) (10931) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:41,141::__init__::225::IOProcess::(_processLogs) (10931) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:41,142::__init__::225::IOProcess::(_processLogs) (10931) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:41,142::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:21:41,143::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:21:41,151::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000964096 s, 523 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) (10932) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:41,152::__init__::225::IOProcess::(_processLogs) (10932) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:41,153::__init__::225::IOProcess::(_processLogs) (10932) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:41,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:41,153::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:21:41,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:41,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) (10933) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) (10933) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) (10933) Building response >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) (10933) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:41,154::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) (10934) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:41,155::__init__::225::IOProcess::(_processLogs) (10934) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) (10934) Building response >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) (10934) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:41,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) (10935) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) (10935) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) (10935) Building response >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) (10935) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:41,157::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:41,975::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:41,976::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5265::DEBUG::2014-09-09 12:21:41,976::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5265::DEBUG::2014-09-09 12:21:41,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b976e52-fa84-4a46-a226-2df8403e2433`::moving from state init -> state preparing >Thread-5265::INFO::2014-09-09 12:21:41,977::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5265::INFO::2014-09-09 12:21:41,977::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5265::DEBUG::2014-09-09 12:21:41,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b976e52-fa84-4a46-a226-2df8403e2433`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5265::DEBUG::2014-09-09 12:21:41,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b976e52-fa84-4a46-a226-2df8403e2433`::moving from state preparing -> state finished >Thread-5265::DEBUG::2014-09-09 12:21:41,978::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5265::DEBUG::2014-09-09 12:21:41,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5265::DEBUG::2014-09-09 12:21:41,978::task::993::Storage.TaskManager.Task::(_decref) Task=`9b976e52-fa84-4a46-a226-2df8403e2433`::ref 0 aborting False >Thread-5265::DEBUG::2014-09-09 12:21:41,978::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5265::DEBUG::2014-09-09 12:21:41,978::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:41,993::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:41,994::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5266::DEBUG::2014-09-09 12:21:41,994::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5266::DEBUG::2014-09-09 12:21:41,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f504235-dd98-47d9-81e7-f2c81ebcc10f`::moving from state init -> state preparing >Thread-5266::INFO::2014-09-09 12:21:41,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5266::DEBUG::2014-09-09 12:21:41,995::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`42d0040c-0a14-49d9-812e-33af0759ec4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5266::DEBUG::2014-09-09 12:21:41,995::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5266::DEBUG::2014-09-09 12:21:41,995::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5266::DEBUG::2014-09-09 12:21:41,995::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`42d0040c-0a14-49d9-812e-33af0759ec4a`::Granted request >Thread-5266::DEBUG::2014-09-09 12:21:41,995::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7f504235-dd98-47d9-81e7-f2c81ebcc10f`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5266::DEBUG::2014-09-09 12:21:41,995::task::993::Storage.TaskManager.Task::(_decref) Task=`7f504235-dd98-47d9-81e7-f2c81ebcc10f`::ref 1 aborting False >Thread-5266::INFO::2014-09-09 12:21:41,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5266::DEBUG::2014-09-09 12:21:41,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f504235-dd98-47d9-81e7-f2c81ebcc10f`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5266::DEBUG::2014-09-09 12:21:41,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f504235-dd98-47d9-81e7-f2c81ebcc10f`::moving from state preparing -> state finished >Thread-5266::DEBUG::2014-09-09 12:21:41,997::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5266::DEBUG::2014-09-09 12:21:41,997::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5266::DEBUG::2014-09-09 12:21:41,997::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5266::DEBUG::2014-09-09 12:21:41,998::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5266::DEBUG::2014-09-09 12:21:41,998::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5266::DEBUG::2014-09-09 12:21:41,998::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5266::DEBUG::2014-09-09 12:21:41,998::task::993::Storage.TaskManager.Task::(_decref) Task=`7f504235-dd98-47d9-81e7-f2c81ebcc10f`::ref 0 aborting False >Thread-5266::DEBUG::2014-09-09 12:21:41,998::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5266::DEBUG::2014-09-09 12:21:41,998::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:42,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:42,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5267::DEBUG::2014-09-09 12:21:42,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`65e9e242-51be-4e20-ac60-53596556a1f5`::moving from state init -> state preparing >Thread-5267::INFO::2014-09-09 12:21:42,122::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5267::INFO::2014-09-09 12:21:42,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114656', 'lastCheck': '9.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964096', 'lastCheck': '1.0', 'valid': True}} >Thread-5267::DEBUG::2014-09-09 12:21:42,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`65e9e242-51be-4e20-ac60-53596556a1f5`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00114656', 'lastCheck': '9.1', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000964096', 'lastCheck': '1.0', 'valid': True}} >Thread-5267::DEBUG::2014-09-09 12:21:42,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`65e9e242-51be-4e20-ac60-53596556a1f5`::moving from state preparing -> state finished >Thread-5267::DEBUG::2014-09-09 12:21:42,122::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5267::DEBUG::2014-09-09 12:21:42,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5267::DEBUG::2014-09-09 12:21:42,123::task::993::Storage.TaskManager.Task::(_decref) Task=`65e9e242-51be-4e20-ac60-53596556a1f5`::ref 0 aborting False >Thread-5267::DEBUG::2014-09-09 12:21:42,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:42,134::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:42,134::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5268::DEBUG::2014-09-09 12:21:42,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) (10936) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:43,050::__init__::225::IOProcess::(_processLogs) (10936) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:43,051::__init__::225::IOProcess::(_processLogs) (10936) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:43,051::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:21:43,052::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:21:43,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00115173 s, 975 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:43,060::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:43,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) (10937) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) (10937) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) (10937) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:43,061::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:21:43,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:43,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897847 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:45,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:45,201::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:45,201::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5269::DEBUG::2014-09-09 12:21:45,203::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:45,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894777 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:47,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:47,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896925 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:48,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:48,212::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5270::DEBUG::2014-09-09 12:21:48,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:49,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:49,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0937819 s, 10.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:51,157::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:51,157::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:51,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:51,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:51,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:51,158::__init__::225::IOProcess::(_processLogs) (10938) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:51,158::__init__::225::IOProcess::(_processLogs) (10938) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:51,159::__init__::225::IOProcess::(_processLogs) (10938) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:51,159::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:21:51,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:21:51,167::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000946761 s, 532 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:51,167::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) (10939) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) (10939) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:51,168::__init__::225::IOProcess::(_processLogs) (10939) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:51,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:51,169::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:21:51,169::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:21:51,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:51,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:51,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:51,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:51,170::__init__::225::IOProcess::(_processLogs) (10940) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:51,170::__init__::225::IOProcess::(_processLogs) (10940) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:51,170::__init__::225::IOProcess::(_processLogs) (10940) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:51,170::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) (10941) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) (10941) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:51,171::__init__::225::IOProcess::(_processLogs) (10941) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:51,172::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:21:51,172::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:21:51,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:51,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) (10942) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) (10942) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) (10942) Building response >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) (10942) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:21:51,173::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:51,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:51,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5271::DEBUG::2014-09-09 12:21:51,223::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:51,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:51,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896768 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:52,029::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5272::DEBUG::2014-09-09 12:21:52,030::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:21:52,030::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5272::DEBUG::2014-09-09 12:21:52,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`331fd718-6da8-46fd-9154-a3d672f6463c`::moving from state init -> state preparing >Thread-5272::INFO::2014-09-09 12:21:52,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5272::INFO::2014-09-09 12:21:52,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5272::DEBUG::2014-09-09 12:21:52,032::task::1191::Storage.TaskManager.Task::(prepare) Task=`331fd718-6da8-46fd-9154-a3d672f6463c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5272::DEBUG::2014-09-09 12:21:52,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`331fd718-6da8-46fd-9154-a3d672f6463c`::moving from state preparing -> state finished >Thread-5272::DEBUG::2014-09-09 12:21:52,032::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5272::DEBUG::2014-09-09 12:21:52,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5272::DEBUG::2014-09-09 12:21:52,032::task::993::Storage.TaskManager.Task::(_decref) Task=`331fd718-6da8-46fd-9154-a3d672f6463c`::ref 0 aborting False >Thread-5272::DEBUG::2014-09-09 12:21:52,032::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5272::DEBUG::2014-09-09 12:21:52,032::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:52,077::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:52,078::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5273::DEBUG::2014-09-09 12:21:52,078::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5273::DEBUG::2014-09-09 12:21:52,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`594070ab-0958-4e64-ad15-69ac1b846ea7`::moving from state init -> state preparing >Thread-5273::INFO::2014-09-09 12:21:52,079::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5273::DEBUG::2014-09-09 12:21:52,080::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`41749179-cb7f-4f8e-8318-6f129c37aaeb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5273::DEBUG::2014-09-09 12:21:52,080::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5273::DEBUG::2014-09-09 12:21:52,080::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5273::DEBUG::2014-09-09 12:21:52,080::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`41749179-cb7f-4f8e-8318-6f129c37aaeb`::Granted request >Thread-5273::DEBUG::2014-09-09 12:21:52,081::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`594070ab-0958-4e64-ad15-69ac1b846ea7`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5273::DEBUG::2014-09-09 12:21:52,081::task::993::Storage.TaskManager.Task::(_decref) Task=`594070ab-0958-4e64-ad15-69ac1b846ea7`::ref 1 aborting False >Thread-5273::INFO::2014-09-09 12:21:52,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5273::DEBUG::2014-09-09 12:21:52,083::task::1191::Storage.TaskManager.Task::(prepare) Task=`594070ab-0958-4e64-ad15-69ac1b846ea7`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5273::DEBUG::2014-09-09 12:21:52,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`594070ab-0958-4e64-ad15-69ac1b846ea7`::moving from state preparing -> state finished >Thread-5273::DEBUG::2014-09-09 12:21:52,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5273::DEBUG::2014-09-09 12:21:52,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5273::DEBUG::2014-09-09 12:21:52,083::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5273::DEBUG::2014-09-09 12:21:52,083::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5273::DEBUG::2014-09-09 12:21:52,083::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5273::DEBUG::2014-09-09 12:21:52,083::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5273::DEBUG::2014-09-09 12:21:52,083::task::993::Storage.TaskManager.Task::(_decref) Task=`594070ab-0958-4e64-ad15-69ac1b846ea7`::ref 0 aborting False >Thread-5273::DEBUG::2014-09-09 12:21:52,083::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5273::DEBUG::2014-09-09 12:21:52,084::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:21:53,062::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) (10943) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) (10943) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:53,063::__init__::225::IOProcess::(_processLogs) (10943) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:53,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:21:53,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-09 12:21:53,064::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:21:53,072::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00111078 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:21:53,072::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:21:53,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:21:53,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:21:53,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:21:53,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:21:53,073::__init__::225::IOProcess::(_processLogs) (10944) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:21:53,073::__init__::225::IOProcess::(_processLogs) (10944) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:21:53,073::__init__::225::IOProcess::(_processLogs) (10944) Queuing response >Thread-19::DEBUG::2014-09-09 12:21:53,073::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:21:53,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:53,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089796 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:54,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:54,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5274::DEBUG::2014-09-09 12:21:54,234::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:55,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:55,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895839 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:57,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:57,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5275::DEBUG::2014-09-09 12:21:57,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`30a7d9cd-ab0e-408c-b89a-e5a5f8eaf96b`::moving from state init -> state preparing >Thread-5275::INFO::2014-09-09 12:21:57,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5275::INFO::2014-09-09 12:21:57,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111078', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000946761', 'lastCheck': '6.1', 'valid': True}} >Thread-5275::DEBUG::2014-09-09 12:21:57,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`30a7d9cd-ab0e-408c-b89a-e5a5f8eaf96b`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111078', 'lastCheck': '4.2', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000946761', 'lastCheck': '6.1', 'valid': True}} >Thread-5275::DEBUG::2014-09-09 12:21:57,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`30a7d9cd-ab0e-408c-b89a-e5a5f8eaf96b`::moving from state preparing -> state finished >Thread-5275::DEBUG::2014-09-09 12:21:57,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5275::DEBUG::2014-09-09 12:21:57,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5275::DEBUG::2014-09-09 12:21:57,245::task::993::Storage.TaskManager.Task::(_decref) Task=`30a7d9cd-ab0e-408c-b89a-e5a5f8eaf96b`::ref 0 aborting False >Thread-5275::DEBUG::2014-09-09 12:21:57,246::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:21:57,258::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:21:57,259::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5276::DEBUG::2014-09-09 12:21:57,260::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:21:57,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:21:57,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894044 s, 11.5 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:21:59,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:00,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896011 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:00,318::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:00,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5277::DEBUG::2014-09-09 12:22:00,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:22:01,173::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:01,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:01,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:01,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:01,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:01,174::__init__::225::IOProcess::(_processLogs) (10945) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:01,174::__init__::225::IOProcess::(_processLogs) (10945) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:01,174::__init__::225::IOProcess::(_processLogs) (10945) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:01,174::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:22:01,175::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:22:01,182::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.00101884 s, 495 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:01,183::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:01,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:01,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:01,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:01,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:01,184::__init__::225::IOProcess::(_processLogs) (10946) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:01,184::__init__::225::IOProcess::(_processLogs) (10946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:01,184::__init__::225::IOProcess::(_processLogs) (10946) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:01,184::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:22:01,185::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:22:01,185::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:01,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:01,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:01,185::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) (10947) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) (10947) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) (10947) Building response >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) (10947) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:22:01,186::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) (10948) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) (10948) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) (10948) Building response >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) (10948) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:01,187::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) (10949) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) (10949) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) (10949) Building response >Thread-19::DEBUG::2014-09-09 12:22:01,188::__init__::225::IOProcess::(_processLogs) (10949) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:01,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:01,189::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:22:02,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:02,121::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5278::DEBUG::2014-09-09 12:22:02,123::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:22:02,123::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5278::DEBUG::2014-09-09 12:22:02,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`626d5b2d-ce26-4a24-aa2e-21ab250e6f31`::moving from state init -> state preparing >Thread-5278::INFO::2014-09-09 12:22:02,124::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5278::INFO::2014-09-09 12:22:02,124::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5278::DEBUG::2014-09-09 12:22:02,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`626d5b2d-ce26-4a24-aa2e-21ab250e6f31`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5278::DEBUG::2014-09-09 12:22:02,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`626d5b2d-ce26-4a24-aa2e-21ab250e6f31`::moving from state preparing -> state finished >Thread-5278::DEBUG::2014-09-09 12:22:02,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5278::DEBUG::2014-09-09 12:22:02,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5278::DEBUG::2014-09-09 12:22:02,124::task::993::Storage.TaskManager.Task::(_decref) Task=`626d5b2d-ce26-4a24-aa2e-21ab250e6f31`::ref 0 aborting False >Thread-5278::DEBUG::2014-09-09 12:22:02,125::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5278::DEBUG::2014-09-09 12:22:02,125::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:02,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894837 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:02,189::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5279::DEBUG::2014-09-09 12:22:02,189::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:22:02,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5279::DEBUG::2014-09-09 12:22:02,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`793e97e2-c0be-4630-ade5-52ff2dd69c2d`::moving from state init -> state preparing >Thread-5279::INFO::2014-09-09 12:22:02,190::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5279::DEBUG::2014-09-09 12:22:02,191::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eb5e73de-63c1-41f3-a2f0-a85438e2be78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5279::DEBUG::2014-09-09 12:22:02,191::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5279::DEBUG::2014-09-09 12:22:02,191::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5279::DEBUG::2014-09-09 12:22:02,191::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`eb5e73de-63c1-41f3-a2f0-a85438e2be78`::Granted request >Thread-5279::DEBUG::2014-09-09 12:22:02,191::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`793e97e2-c0be-4630-ade5-52ff2dd69c2d`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5279::DEBUG::2014-09-09 12:22:02,191::task::993::Storage.TaskManager.Task::(_decref) Task=`793e97e2-c0be-4630-ade5-52ff2dd69c2d`::ref 1 aborting False >Thread-5279::INFO::2014-09-09 12:22:02,193::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5279::DEBUG::2014-09-09 12:22:02,193::task::1191::Storage.TaskManager.Task::(prepare) Task=`793e97e2-c0be-4630-ade5-52ff2dd69c2d`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5279::DEBUG::2014-09-09 12:22:02,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`793e97e2-c0be-4630-ade5-52ff2dd69c2d`::moving from state preparing -> state finished >Thread-5279::DEBUG::2014-09-09 12:22:02,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5279::DEBUG::2014-09-09 12:22:02,193::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5279::DEBUG::2014-09-09 12:22:02,193::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5279::DEBUG::2014-09-09 12:22:02,193::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5279::DEBUG::2014-09-09 12:22:02,193::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5279::DEBUG::2014-09-09 12:22:02,194::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5279::DEBUG::2014-09-09 12:22:02,194::task::993::Storage.TaskManager.Task::(_decref) Task=`793e97e2-c0be-4630-ade5-52ff2dd69c2d`::ref 0 aborting False >Thread-5279::DEBUG::2014-09-09 12:22:02,194::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5279::DEBUG::2014-09-09 12:22:02,194::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:22:03,074::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:22:03,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) (10950) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) (10950) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) (10950) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:03,075::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:22:03,076::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:22:03,083::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00107242 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:03,084::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:22:03,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:03,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:03,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:03,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:03,085::__init__::225::IOProcess::(_processLogs) (10951) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:03,085::__init__::225::IOProcess::(_processLogs) (10951) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:03,085::__init__::225::IOProcess::(_processLogs) (10951) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:03,085::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:03,325::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:03,326::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5280::DEBUG::2014-09-09 12:22:03,327::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:04,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:04,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0898215 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:22:06,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:06,340::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:06,341::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5281::DEBUG::2014-09-09 12:22:06,342::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:06,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0893793 s, 11.5 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:22:08,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:08,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895161 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:09,349::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:09,350::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5282::DEBUG::2014-09-09 12:22:09,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:10,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:10,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896972 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:11,188::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) (10952) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) (10952) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) (10952) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:11,189::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:22:11,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:22:11,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000915365 s, 551 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) (10953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:11,199::__init__::225::IOProcess::(_processLogs) (10953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:11,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10953) Building response >Thread-19::DEBUG::2014-09-09 12:22:11,200::__init__::225::IOProcess::(_processLogs) (10953) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:11,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:22:11,200::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:11,201::__init__::225::IOProcess::(_processLogs) (10954) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) (10954) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) (10954) Building response >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) (10954) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:22:11,202::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) (10955) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) (10955) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) (10955) Building response >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) (10955) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:11,203::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) (10956) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) (10956) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:11,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10956) Building response >Thread-19::DEBUG::2014-09-09 12:22:11,205::__init__::225::IOProcess::(_processLogs) (10956) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:11,205::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:11,205::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:12,298::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:12,299::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5283::DEBUG::2014-09-09 12:22:12,299::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5283::DEBUG::2014-09-09 12:22:12,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`31f53adf-9575-4a4b-86ba-eac813597afe`::moving from state init -> state preparing >Thread-5283::INFO::2014-09-09 12:22:12,300::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5283::INFO::2014-09-09 12:22:12,300::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5283::DEBUG::2014-09-09 12:22:12,300::task::1191::Storage.TaskManager.Task::(prepare) Task=`31f53adf-9575-4a4b-86ba-eac813597afe`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5283::DEBUG::2014-09-09 12:22:12,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`31f53adf-9575-4a4b-86ba-eac813597afe`::moving from state preparing -> state finished >Thread-5283::DEBUG::2014-09-09 12:22:12,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5283::DEBUG::2014-09-09 12:22:12,300::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5283::DEBUG::2014-09-09 12:22:12,300::task::993::Storage.TaskManager.Task::(_decref) Task=`31f53adf-9575-4a4b-86ba-eac813597afe`::ref 0 aborting False >Thread-5283::DEBUG::2014-09-09 12:22:12,301::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5283::DEBUG::2014-09-09 12:22:12,301::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:12,337::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:12,338::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5284::DEBUG::2014-09-09 12:22:12,338::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5284::DEBUG::2014-09-09 12:22:12,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`34085a3c-d542-4603-8979-8f8be555be28`::moving from state init -> state preparing >Thread-5284::INFO::2014-09-09 12:22:12,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5284::DEBUG::2014-09-09 12:22:12,339::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ea190fa6-8114-4806-8dd7-4d5f628c7bdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5284::DEBUG::2014-09-09 12:22:12,339::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5284::DEBUG::2014-09-09 12:22:12,340::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5284::DEBUG::2014-09-09 12:22:12,340::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`ea190fa6-8114-4806-8dd7-4d5f628c7bdb`::Granted request >Thread-5284::DEBUG::2014-09-09 12:22:12,340::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`34085a3c-d542-4603-8979-8f8be555be28`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5284::DEBUG::2014-09-09 12:22:12,340::task::993::Storage.TaskManager.Task::(_decref) Task=`34085a3c-d542-4603-8979-8f8be555be28`::ref 1 aborting False >Thread-5284::INFO::2014-09-09 12:22:12,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5284::DEBUG::2014-09-09 12:22:12,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`34085a3c-d542-4603-8979-8f8be555be28`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5284::DEBUG::2014-09-09 12:22:12,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`34085a3c-d542-4603-8979-8f8be555be28`::moving from state preparing -> state finished >Thread-5284::DEBUG::2014-09-09 12:22:12,342::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5284::DEBUG::2014-09-09 12:22:12,342::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5284::DEBUG::2014-09-09 12:22:12,342::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5284::DEBUG::2014-09-09 12:22:12,342::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5284::DEBUG::2014-09-09 12:22:12,342::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5284::DEBUG::2014-09-09 12:22:12,342::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5284::DEBUG::2014-09-09 12:22:12,342::task::993::Storage.TaskManager.Task::(_decref) Task=`34085a3c-d542-4603-8979-8f8be555be28`::ref 0 aborting False >Thread-5284::DEBUG::2014-09-09 12:22:12,342::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5284::DEBUG::2014-09-09 12:22:12,343::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:12,357::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:12,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5285::DEBUG::2014-09-09 12:22:12,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0c5c09b-012f-4d7d-845c-cd21ae57ff54`::moving from state init -> state preparing >Thread-5285::INFO::2014-09-09 12:22:12,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5285::INFO::2014-09-09 12:22:12,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107242', 'lastCheck': '9.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000915365', 'lastCheck': '1.2', 'valid': True}} >Thread-5285::DEBUG::2014-09-09 12:22:12,359::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0c5c09b-012f-4d7d-845c-cd21ae57ff54`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107242', 'lastCheck': '9.3', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000915365', 'lastCheck': '1.2', 'valid': True}} >Thread-5285::DEBUG::2014-09-09 12:22:12,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0c5c09b-012f-4d7d-845c-cd21ae57ff54`::moving from state preparing -> state finished >Thread-5285::DEBUG::2014-09-09 12:22:12,359::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5285::DEBUG::2014-09-09 12:22:12,359::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5285::DEBUG::2014-09-09 12:22:12,359::task::993::Storage.TaskManager.Task::(_decref) Task=`c0c5c09b-012f-4d7d-845c-cd21ae57ff54`::ref 0 aborting False >Thread-5285::DEBUG::2014-09-09 12:22:12,360::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:12,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:12,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5286::DEBUG::2014-09-09 12:22:12,370::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:12,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:12,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0897851 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:13,086::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:22:13,086::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) (10957) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:13,087::__init__::225::IOProcess::(_processLogs) (10957) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:13,088::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10957) Building response >Thread-19::DEBUG::2014-09-09 12:22:13,088::__init__::225::IOProcess::(_processLogs) (10957) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:13,088::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-09-09 12:22:13,089::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-23::DEBUG::2014-09-09 12:22:13,089::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:22:13,097::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00105119 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:13,097::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) (10958) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) (10958) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:13,098::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(10958) Building response >Thread-19::DEBUG::2014-09-09 12:22:13,099::__init__::225::IOProcess::(_processLogs) (10958) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:13,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:13,099::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 245 >Dummy-97::DEBUG::2014-09-09 12:22:14,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:14,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089647 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:15,419::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:15,420::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5287::DEBUG::2014-09-09 12:22:15,421::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:16,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:16,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896028 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:18,430::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:18,430::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5288::DEBUG::2014-09-09 12:22:18,432::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:18,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:19,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895434 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:22:21,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:21,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895628 s, 11.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:21,205::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-09-09 12:22:21,205::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) (10959) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:21,206::__init__::225::IOProcess::(_processLogs) (10959) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:21,207::__init__::225::IOProcess::(_processLogs) (10959) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:21,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-24::DEBUG::2014-09-09 12:22:21,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:22:21,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.00105416 s, 478 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) (10960) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:21,217::__init__::225::IOProcess::(_processLogs) (10960) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:21,218::__init__::225::IOProcess::(_processLogs) (10960) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:21,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:21,218::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:22:21,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:21,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) (10961) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) (10961) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) (10961) Building response >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) (10961) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:21,219::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) (10962) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) (10962) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) (10962) Building response >Thread-19::DEBUG::2014-09-09 12:22:21,220::__init__::225::IOProcess::(_processLogs) (10962) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:21,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:21,221::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:21,221::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:22:21,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:21,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) (10963) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) (10963) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) (10963) Building response >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) (10963) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:21,222::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:21,446::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:21,447::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5289::DEBUG::2014-09-09 12:22:21,448::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:22,373::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-5290::DEBUG::2014-09-09 12:22:22,373::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >JsonRpcServer::DEBUG::2014-09-09 12:22:22,373::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5290::DEBUG::2014-09-09 12:22:22,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`c400b4db-d17e-4905-939a-196529e3d09b`::moving from state init -> state preparing >Thread-5290::INFO::2014-09-09 12:22:22,375::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5290::INFO::2014-09-09 12:22:22,375::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5290::DEBUG::2014-09-09 12:22:22,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`c400b4db-d17e-4905-939a-196529e3d09b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5290::DEBUG::2014-09-09 12:22:22,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`c400b4db-d17e-4905-939a-196529e3d09b`::moving from state preparing -> state finished >Thread-5290::DEBUG::2014-09-09 12:22:22,375::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5290::DEBUG::2014-09-09 12:22:22,375::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5290::DEBUG::2014-09-09 12:22:22,375::task::993::Storage.TaskManager.Task::(_decref) Task=`c400b4db-d17e-4905-939a-196529e3d09b`::ref 0 aborting False >Thread-5290::DEBUG::2014-09-09 12:22:22,375::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5290::DEBUG::2014-09-09 12:22:22,375::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:22,442::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:22,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5291::DEBUG::2014-09-09 12:22:22,442::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5291::DEBUG::2014-09-09 12:22:22,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae404737-c57a-459f-b7b9-78c8b7d8b5e6`::moving from state init -> state preparing >Thread-5291::INFO::2014-09-09 12:22:22,443::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5291::DEBUG::2014-09-09 12:22:22,444::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9c0ab039-3997-46b5-954b-790375da9b0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5291::DEBUG::2014-09-09 12:22:22,444::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5291::DEBUG::2014-09-09 12:22:22,444::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5291::DEBUG::2014-09-09 12:22:22,444::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`9c0ab039-3997-46b5-954b-790375da9b0e`::Granted request >Thread-5291::DEBUG::2014-09-09 12:22:22,444::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ae404737-c57a-459f-b7b9-78c8b7d8b5e6`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5291::DEBUG::2014-09-09 12:22:22,444::task::993::Storage.TaskManager.Task::(_decref) Task=`ae404737-c57a-459f-b7b9-78c8b7d8b5e6`::ref 1 aborting False >Thread-5291::INFO::2014-09-09 12:22:22,446::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5291::DEBUG::2014-09-09 12:22:22,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae404737-c57a-459f-b7b9-78c8b7d8b5e6`::finished: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5291::DEBUG::2014-09-09 12:22:22,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae404737-c57a-459f-b7b9-78c8b7d8b5e6`::moving from state preparing -> state finished >Thread-5291::DEBUG::2014-09-09 12:22:22,446::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383': < ResourceRef 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', isValid: 'True' obj: 'None'>} >Thread-5291::DEBUG::2014-09-09 12:22:22,446::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5291::DEBUG::2014-09-09 12:22:22,446::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' >Thread-5291::DEBUG::2014-09-09 12:22:22,446::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' (0 active users) >Thread-5291::DEBUG::2014-09-09 12:22:22,446::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free, finding out if anyone is waiting for it. >Thread-5291::DEBUG::2014-09-09 12:22:22,446::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383', Clearing records. >Thread-5291::DEBUG::2014-09-09 12:22:22,446::task::993::Storage.TaskManager.Task::(_decref) Task=`ae404737-c57a-459f-b7b9-78c8b7d8b5e6`::ref 0 aborting False >Thread-5291::DEBUG::2014-09-09 12:22:22,447::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >Thread-5291::DEBUG::2014-09-09 12:22:22,447::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:22:23,100::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:22:23,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:23,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:23,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:23,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:23,100::__init__::225::IOProcess::(_processLogs) (10964) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:23,101::__init__::225::IOProcess::(_processLogs) (10964) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:23,101::__init__::225::IOProcess::(_processLogs) (10964) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:23,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-23::DEBUG::2014-09-09 12:22:23,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-23::DEBUG::2014-09-09 12:22:23,108::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n1123 bytes (1.1 kB) copied, 0.00113066 s, 993 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) (10965) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:23,109::__init__::225::IOProcess::(_processLogs) (10965) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:23,110::__init__::225::IOProcess::(_processLogs) (10965) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:23,110::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-97::DEBUG::2014-09-09 12:22:23,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:23,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895675 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:24,456::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:24,457::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5292::DEBUG::2014-09-09 12:22:24,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:25,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:25,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895933 s, 11.4 MB/s\n'; <rc> = 0 >Dummy-97::DEBUG::2014-09-09 12:22:27,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:27,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895948 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:27,468::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:27,469::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5293::DEBUG::2014-09-09 12:22:27,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e3fc53a-fd22-4d3d-b155-4c824d9f5850`::moving from state init -> state preparing >Thread-5293::INFO::2014-09-09 12:22:27,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-5293::INFO::2014-09-09 12:22:27,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113066', 'lastCheck': '4.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105416', 'lastCheck': '6.2', 'valid': True}} >Thread-5293::DEBUG::2014-09-09 12:22:27,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e3fc53a-fd22-4d3d-b155-4c824d9f5850`::finished: {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113066', 'lastCheck': '4.4', 'valid': True}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00105416', 'lastCheck': '6.2', 'valid': True}} >Thread-5293::DEBUG::2014-09-09 12:22:27,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e3fc53a-fd22-4d3d-b155-4c824d9f5850`::moving from state preparing -> state finished >Thread-5293::DEBUG::2014-09-09 12:22:27,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5293::DEBUG::2014-09-09 12:22:27,471::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5293::DEBUG::2014-09-09 12:22:27,471::task::993::Storage.TaskManager.Task::(_decref) Task=`2e3fc53a-fd22-4d3d-b155-4c824d9f5850`::ref 0 aborting False >Thread-5293::DEBUG::2014-09-09 12:22:27,471::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:27,482::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:27,483::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5294::DEBUG::2014-09-09 12:22:27,484::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-97::DEBUG::2014-09-09 12:22:29,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:29,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0896138 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:30,633::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:30,634::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5295::DEBUG::2014-09-09 12:22:30,635::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-09 12:22:31,222::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:31,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:31,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:31,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:31,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:31,222::__init__::225::IOProcess::(_processLogs) (10966) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:31,223::__init__::225::IOProcess::(_processLogs) (10966) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:31,223::__init__::225::IOProcess::(_processLogs) (10966) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:31,223::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-24::DEBUG::2014-09-09 12:22:31,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/192.168.2.1:_home_storage_data/caf02237-e8a4-49fe-ab6d-4d23843f0edf/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-24::DEBUG::2014-09-09 12:22:31,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n504 bytes (504 B) copied, 0.000944018 s, 534 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) Message size is 149 >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) (10967) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-09-09 12:22:31,232::__init__::225::IOProcess::(_processLogs) (10967) Got request for method 'statvfs' >Thread-19::DEBUG::2014-09-09 12:22:31,233::__init__::225::IOProcess::(_processLogs) (10967) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:31,233::__init__::225::IOProcess::(_processLogs) Sending response sized 245 >Thread-19::DEBUG::2014-09-09 12:22:31,233::__init__::225::IOProcess::(_processLogs) Message size is 166 >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) (10968) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) (10968) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) (10968) Building response >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) (10968) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:31,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) Message size is 170 >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:31,235::__init__::225::IOProcess::(_processLogs) (10969) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) (10969) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) (10969) Building response >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) (10969) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-09-09 12:22:31,236::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) (10970) Finding callback 'access'... >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) (10970) Got request for method 'access' >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) (10970) Building response >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) (10970) Queuing response >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-09-09 12:22:31,237::__init__::225::IOProcess::(_processLogs) Sending response sized 57 >Dummy-97::DEBUG::2014-09-09 12:22:31,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/5745e11d-81b4-4d82-8fed-c8a22ec23383/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-97::DEBUG::2014-09-09 12:22:31,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0895555 s, 11.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:32,483::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:32,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5296::DEBUG::2014-09-09 12:22:32,484::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5296::DEBUG::2014-09-09 12:22:32,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`33b6d0f4-0f7b-4ec9-8a5e-f8d1e9476ddf`::moving from state init -> state preparing >Thread-5296::INFO::2014-09-09 12:22:32,485::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5296::INFO::2014-09-09 12:22:32,485::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5296::DEBUG::2014-09-09 12:22:32,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`33b6d0f4-0f7b-4ec9-8a5e-f8d1e9476ddf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3}} >Thread-5296::DEBUG::2014-09-09 12:22:32,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`33b6d0f4-0f7b-4ec9-8a5e-f8d1e9476ddf`::moving from state preparing -> state finished >Thread-5296::DEBUG::2014-09-09 12:22:32,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-5296::DEBUG::2014-09-09 12:22:32,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-5296::DEBUG::2014-09-09 12:22:32,486::task::993::Storage.TaskManager.Task::(_decref) Task=`33b6d0f4-0f7b-4ec9-8a5e-f8d1e9476ddf`::ref 0 aborting False >Thread-5296::DEBUG::2014-09-09 12:22:32,486::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 3} >Thread-5296::DEBUG::2014-09-09 12:22:32,486::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-09 12:22:32,547::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-09 12:22:32,548::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-5297::DEBUG::2014-09-09 12:22:32,548::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'5745e11d-81b4-4d82-8fed-c8a22ec23383'} >Thread-5297::DEBUG::2014-09-09 12:22:32,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`62a0973f-5d7f-40c9-a007-22271a1d9bb8`::moving from state init -> state preparing >Thread-5297::INFO::2014-09-09 12:22:32,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'5745e11d-81b4-4d82-8fed-c8a22ec23383', options=None) >Thread-5297::DEBUG::2014-09-09 12:22:32,549::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f6573056-5707-450f-8ab7-a516db86c055`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-5297::DEBUG::2014-09-09 12:22:32,549::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' for lock type 'shared' >Thread-5297::DEBUG::2014-09-09 12:22:32,549::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383' is free. Now locking as 'shared' (1 active user) >Thread-5297::DEBUG::2014-09-09 12:22:32,550::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383`ReqID=`f6573056-5707-450f-8ab7-a516db86c055`::Granted request >Thread-5297::DEBUG::2014-09-09 12:22:32,550::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`62a0973f-5d7f-40c9-a007-22271a1d9bb8`::_resourcesAcquired: Storage.5745e11d-81b4-4d82-8fed-c8a22ec23383 (shared) >Thread-5297::DEBUG::2014-09-09 12:22:32,550::task::993::Storage.TaskManager.Task::(_decref) Task=`62a0973f-5d7f-40c9-a007-22271a1d9bb8`::ref 1 aborting False >Thread-5297::INFO::2014-09-09 12:22:32,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'nfs', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'pool_status': 'connected', 'lver': 3, 'domains': 'e453999e-ec9f-420b-941c-a9f9cc4432bb:Active,caf02237-e8a4-49fe-ab6d-4d23843f0edf:Active', 'master_uuid': u'caf02237-e8a4-49fe-ab6d-4d23843f0edf', 'version': '0', 'spm_id': 2, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'e453999e-ec9f-420b-941c-a9f9cc4432bb': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': u'/rhev/data-center/mnt/192.168.2.1:_home_storage_iso/e453999e-ec9f-420b-941c-a9f9cc4432bb/images/11111111-1111-1111-1111-111111111111', 'alerts': [], 'disktotal': '430684766208', 'version': 0}, 'caf02237-e8a4-49fe-ab6d-4d23843f0edf': {'status': 'Active', 'diskfree': '283534950400', 'isoprefix': '', 'alerts': [], 'disktotal': '430684766208', 'version': 0}}} >